-- Logs begin at Sat 2022-07-30 20:01:15 UTC, end at Sat 2022-07-30 22:32:27 UTC. -- Jul 30 20:49:02.012137 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 20:49:02.021737 ncdv-master-1 devstack@n-api.service[114940]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 30 20:49:02 2022] *** Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: nodename: ncdv-master-1 Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: machine: x86_64 Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: clock source: unix Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: pcre jit disabled Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: detected number of CPU cores: 4 Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: current working directory: / Jul 30 20:49:02.023793 ncdv-master-1 devstack@n-api.service[114940]: detected binary path: /usr/bin/uwsgi-core Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: your processes number limit is 47680 Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: your memory page size is 4096 bytes Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: detected max file descriptor number: 2048 Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: lock engine: pthread robust mutexes Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: thunder lock: enabled Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 20:49:02.024478 ncdv-master-1 devstack@n-api.service[114940]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 30 20:49:02.067921 ncdv-master-1 devstack@n-api.service[114940]: Python main interpreter initialized at 0x562efe5cf9c0 Jul 30 20:49:02.067921 ncdv-master-1 devstack@n-api.service[114940]: python threads support enabled Jul 30 20:49:02.067921 ncdv-master-1 devstack@n-api.service[114940]: your server socket listen backlog is limited to 100 connections Jul 30 20:49:02.067921 ncdv-master-1 devstack@n-api.service[114940]: your mercy for graceful operations on workers is 90 seconds Jul 30 20:49:02.068269 ncdv-master-1 devstack@n-api.service[114940]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 20:49:02.068345 ncdv-master-1 devstack@n-api.service[114940]: *** Operational MODE: preforking *** Jul 30 20:49:02.068574 ncdv-master-1 devstack@n-api.service[114940]: *** uWSGI is running in multiple interpreter mode *** Jul 30 20:49:02.068574 ncdv-master-1 devstack@n-api.service[114940]: spawned uWSGI master process (pid: 114940) Jul 30 20:49:02.068757 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 30 20:49:02.069299 ncdv-master-1 devstack@n-api.service[114940]: spawned uWSGI worker 1 (pid: 114941, cores: 1) Jul 30 20:49:02.069642 ncdv-master-1 devstack@n-api.service[114940]: spawned uWSGI worker 2 (pid: 114942, cores: 1) Jul 30 20:49:02.069805 ncdv-master-1 devstack@n-api.service[114940]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 20:49:03.299060 ncdv-master-1 devstack@n-api.service[114942]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 20:49:03.322750 ncdv-master-1 devstack@n-api.service[114941]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 20:49:03.981671 ncdv-master-1 devstack@n-api.service[114942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:49:03.981671 ncdv-master-1 devstack@n-api.service[114942]: from cryptography.utils import int_from_bytes Jul 30 20:49:03.982003 ncdv-master-1 devstack@n-api.service[114942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:49:03.982003 ncdv-master-1 devstack@n-api.service[114942]: from cryptography.utils import int_from_bytes Jul 30 20:49:03.987998 ncdv-master-1 devstack@n-api.service[114941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:49:03.987998 ncdv-master-1 devstack@n-api.service[114941]: from cryptography.utils import int_from_bytes Jul 30 20:49:03.988336 ncdv-master-1 devstack@n-api.service[114941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:49:03.988336 ncdv-master-1 devstack@n-api.service[114941]: from cryptography.utils import int_from_bytes Jul 30 20:49:06.610624 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:49:06.611203 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:49:06.611601 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:49:06.611689 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:49:06.611776 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:49:06.611846 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:49:06.611911 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:49:06.611978 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:49:06.612050 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:49:06.612183 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:49:06.612390 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.612575 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.612717 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.612906 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613043 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613233 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613366 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613556 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613699 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.613889 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614015 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614203 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614340 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614526 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614665 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614851 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.614995 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615203 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615366 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615475 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615594 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615796 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.615925 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616125 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616258 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616450 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616571 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616768 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.616885 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617087 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617193 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617411 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617509 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617721 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.617819 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.618066 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.618200 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.618359 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.618589 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.618864 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619033 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619183 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619372 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619525 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619692 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.619862 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620048 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620178 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620353 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620494 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620667 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620809 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.620993 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.621133 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.621306 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.621690 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.622432 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.622594 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.622751 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.622869 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623150 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623270 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623504 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623612 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623823 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.623916 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624144 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624231 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624562 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624680 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624878 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.624988 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625193 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625294 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625519 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625623 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625845 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.625932 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626155 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626253 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626480 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626572 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626803 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.626897 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627124 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627218 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627474 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627562 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627779 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.627866 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628088 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628197 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628402 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628496 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628720 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.628808 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629028 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629114 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629333 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629419 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629589 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629684 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629897 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.629982 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630220 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630315 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630541 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630648 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630864 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.630955 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631118 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631212 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631397 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631487 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631718 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.631814 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632038 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632126 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632350 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632463 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632655 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632747 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.632963 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633065 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633272 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633359 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633578 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633678 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633887 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.633980 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634191 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634286 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634498 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634595 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634814 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.634913 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635129 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635230 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635475 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635563 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635784 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.635953 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636108 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636203 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636503 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636595 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636757 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.636857 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637068 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637160 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637426 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637518 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637751 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.637848 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638061 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638147 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638380 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638471 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638704 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.638790 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639010 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639095 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639342 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639456 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639653 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639750 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.639973 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640078 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640299 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640392 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640606 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640698 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640860 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.640954 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641166 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641268 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641471 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641563 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641793 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.641895 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642098 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642199 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642406 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642503 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642715 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.642828 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643018 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643112 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643347 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643448 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643659 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643744 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.643967 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644062 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644274 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644365 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644581 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644667 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644888 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.644981 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645198 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645283 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645506 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645637 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645813 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.645899 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646137 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646232 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646457 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646543 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646767 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.646863 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647077 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647162 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647406 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647515 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647716 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.647812 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648036 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648129 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648344 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648430 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648653 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648750 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.648974 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649067 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649281 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649366 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649586 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649672 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649905 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.649990 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650213 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650304 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650522 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650617 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650842 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.650929 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651144 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651237 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651479 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651574 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651801 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.651887 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652110 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652208 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652417 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652509 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652723 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.652809 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653047 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653150 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653356 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653443 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653664 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653750 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.653968 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654069 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654290 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654421 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654574 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654660 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654895 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.654994 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655215 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655347 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655551 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655646 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655860 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.655958 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.656173 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.656260 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.656494 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.656586 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:49:06.656831 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.656926 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657167 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657259 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657510 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657602 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657827 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.657922 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658162 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658250 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658498 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658595 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658820 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.658909 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659138 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659223 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659483 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659586 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659813 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.659906 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660127 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660219 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660441 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660535 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660757 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.660850 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661077 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661170 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661399 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661581 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661731 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.661831 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662052 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662145 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662374 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662469 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662697 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.662783 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663013 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663099 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663360 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663465 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663693 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.663778 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664015 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664100 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664332 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664435 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664674 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.664762 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665022 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665154 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665341 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665428 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665669 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665754 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.665995 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666083 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666557 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666733 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666733 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666946 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.666946 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667104 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667238 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667341 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667589 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667674 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667906 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.667992 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.668233 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.668319 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.668549 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.668643 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.669393 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.669491 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.669709 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.669795 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670025 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670110 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670338 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670434 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670680 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.670768 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671003 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671087 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671342 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671448 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671662 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671748 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.671983 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672077 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672299 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672393 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672613 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672699 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.672928 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673013 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673239 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673356 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673542 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673635 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673849 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.673940 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674160 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674247 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674468 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674561 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674791 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.674884 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675122 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675209 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675458 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675557 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675797 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.675883 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676110 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676208 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676428 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676544 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676745 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.676845 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677057 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677152 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677363 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677465 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677678 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.677786 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678000 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678096 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678295 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678385 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678618 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678713 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.678930 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679014 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679236 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679410 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679588 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679720 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679897 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.679990 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680205 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680292 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680521 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680617 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680833 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.680927 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681148 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681235 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681461 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681548 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681774 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.681869 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682101 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682186 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682415 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682501 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682729 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.682814 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683065 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683149 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683421 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683516 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683731 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.683816 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.684057 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.684143 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.684431 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685052 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685287 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685375 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685596 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685691 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.685908 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686002 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686218 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686309 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686523 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686620 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686833 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.686921 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687147 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687233 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687483 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687664 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687791 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.687878 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688098 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688183 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688401 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688495 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688709 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.688795 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689033 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689126 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689342 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689428 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689649 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689743 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.689952 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690038 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690259 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690347 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690602 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690688 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690909 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.690995 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.691253 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.691362 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.691620 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.691774 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692007 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692130 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692339 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692461 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692659 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692780 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.692980 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693101 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693298 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693421 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693615 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693738 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.693931 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694055 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694247 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694371 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694571 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694695 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.694886 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695010 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695210 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695340 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695554 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695645 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.695881 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.696046 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.696226 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.696523 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.696617 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.696830 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.697073 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.697169 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.697479 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.697590 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.697815 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.698134 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.698236 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.698461 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.698651 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.698776 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.699096 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.699215 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.699438 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.699756 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.699851 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.700103 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.700420 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.700506 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.700745 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.701018 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.701107 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.701366 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.701485 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.701682 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702017 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702109 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702321 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702573 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702662 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.702936 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703080 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703253 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703505 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703595 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703849 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.703945 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704181 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704277 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704520 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704607 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704841 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.704936 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705158 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705252 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705471 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705564 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705786 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.705883 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706100 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706199 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706409 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706500 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706723 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.706811 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707040 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707131 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707379 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707470 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707695 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.707783 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708003 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708097 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708321 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708408 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708633 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708730 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.708943 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709031 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709251 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709346 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709596 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709740 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.709922 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710010 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710238 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710338 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710566 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710654 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710884 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.710970 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711190 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711338 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711527 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711615 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711843 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.711928 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712155 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712256 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712462 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712548 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712770 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.712858 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713079 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713175 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713402 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713495 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713729 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.713824 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714039 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714127 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714353 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714438 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714665 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714752 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.714976 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715070 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715305 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715395 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715659 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715793 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.715975 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716064 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716307 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716440 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716625 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716713 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.716939 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717027 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717254 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717341 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717567 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717654 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717881 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.717987 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718195 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718282 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718517 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718685 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718828 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.718914 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719141 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719226 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719489 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719591 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719799 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.719887 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.720113 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.720207 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.720427 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.720524 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.720744 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721000 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721089 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721337 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721424 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721659 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721747 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.721972 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722059 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722287 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722388 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722602 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722697 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722910 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.722999 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.723223 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.723360 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.723569 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.723707 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.723908 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724139 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724235 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724481 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724578 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724805 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.724892 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725119 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725204 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725430 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725527 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725742 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.725837 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726056 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726189 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726371 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726510 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726678 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726766 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.726985 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727082 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727312 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727421 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727622 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727711 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.727941 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728039 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728248 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728336 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728557 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728645 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728861 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.728954 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729168 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729262 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729482 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729571 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729788 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.729915 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730094 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730189 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730399 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730485 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730707 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.730800 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.731029 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.731126 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.731896 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.731986 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732218 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732305 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732531 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732620 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732858 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.732953 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733173 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733260 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733483 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733571 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733792 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.733878 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734100 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734185 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734406 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734493 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734720 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.734808 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735032 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735119 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735364 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735457 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735681 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735769 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.735994 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736091 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736308 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736394 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736626 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736725 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.736931 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737028 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737243 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737330 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737550 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737643 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737866 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.737961 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738173 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738259 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738480 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738568 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738783 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.738879 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739095 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739189 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739432 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739519 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739739 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.739827 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740046 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740131 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740349 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740442 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740656 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740743 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.740962 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741049 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741268 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741354 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741574 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741661 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741882 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.741969 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742192 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742276 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742499 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742593 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742806 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.742898 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743129 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743357 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743453 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743535 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743751 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.743864 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744061 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744171 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744366 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744456 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744671 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744756 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.744984 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745076 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745298 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745384 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745608 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745701 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.745914 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.746019 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.746225 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.746319 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.746820 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.747497 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.747679 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.747776 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.747987 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.748072 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.748301 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.748613 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.748917 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.749223 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.749310 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.749565 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.749888 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.750222 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.750385 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.750546 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.750705 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.750865 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751042 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751182 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751390 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751519 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751706 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.751830 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752019 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752140 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752330 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752457 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752682 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752770 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.752993 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753089 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753357 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753443 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753666 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753753 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.753976 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754091 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754298 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754400 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754609 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754718 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.754919 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755025 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755229 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755339 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755564 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755659 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755895 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.755998 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756204 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756299 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756523 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756619 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756836 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.756935 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757149 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757243 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757483 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757576 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757800 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.757894 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758115 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758215 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758440 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758551 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758749 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.758842 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759073 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759167 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759405 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759500 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759722 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.759819 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760032 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760142 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760344 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760453 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760656 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760756 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.760985 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761077 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761283 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761386 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761599 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761692 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.761916 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762005 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762233 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762327 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762567 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762650 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762876 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.762960 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763190 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763282 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763533 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763619 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763843 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.763940 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764158 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764243 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764473 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764560 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764779 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.764871 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765093 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765181 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765401 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765486 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765715 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.765799 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766021 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766114 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766333 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766450 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766648 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766765 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.766957 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767079 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767318 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767409 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767621 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767721 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.767931 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768025 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768252 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768347 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768561 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768660 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768876 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.768965 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.769185 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.769327 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.769617 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.769716 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.769935 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770021 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770246 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770331 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770553 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770650 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770859 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.770943 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771173 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771257 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771517 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771649 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771825 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.771909 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772135 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772220 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772446 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772558 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772773 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.772859 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773082 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773180 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773409 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773505 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773774 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.773860 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774085 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774177 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774385 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774475 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774718 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.774813 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775029 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775124 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775367 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775458 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775678 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.775764 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776005 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776103 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776315 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776401 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776643 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776731 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.776983 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777077 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777304 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777389 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777633 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777719 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.777962 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778086 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778305 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778426 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778624 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778712 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.778933 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779018 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779261 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779427 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779613 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779707 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.779932 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780026 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780258 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780346 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780572 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780681 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.780902 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781010 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781232 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781319 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781547 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781641 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781868 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.781961 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782180 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782267 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782508 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782596 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782837 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.782923 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783144 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783236 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783483 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783571 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783815 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.783912 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784126 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784220 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784444 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784538 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784756 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.784918 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785069 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785156 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785377 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785463 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785685 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.785780 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786012 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786100 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786321 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786406 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786629 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786731 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.786950 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787036 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787258 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787409 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787601 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787689 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.787918 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788002 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788238 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788321 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788548 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788641 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788855 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.788940 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789162 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789255 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789468 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789555 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789791 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.789876 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790108 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790194 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790429 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790511 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790751 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.790843 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791060 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791156 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791406 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791496 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791717 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.791813 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792027 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792123 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792336 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792423 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792646 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792731 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.792989 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.793091 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.793295 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.793381 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.793601 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.794286 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.794452 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.794549 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.794762 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.794860 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795072 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795159 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795408 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795499 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795723 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.795810 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796030 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796182 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796324 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796409 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796630 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796717 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.796960 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797047 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797268 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797355 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797593 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797680 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797901 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.797999 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798208 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798294 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798515 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798600 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798821 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.798914 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799130 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799223 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799464 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799563 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799776 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.799875 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800104 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800192 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800412 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800498 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800740 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.800845 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801054 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801141 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801365 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801489 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801675 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801771 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.801985 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802087 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802302 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802386 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802620 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802707 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.802940 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803026 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803257 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803383 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803602 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803699 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.803915 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804003 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804234 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804319 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804549 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804634 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804868 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.804961 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.805189 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.805391 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.805509 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.805727 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.805821 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806047 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806133 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806365 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806453 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806683 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.806770 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807007 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807094 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807345 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807435 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807664 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807751 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.807980 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808070 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808295 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808512 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808600 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808855 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.808941 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809177 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809273 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809565 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809664 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809887 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.809974 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810210 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810299 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810531 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810627 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810852 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.810938 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811170 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811258 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811513 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811667 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811831 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.811927 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812159 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812252 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812479 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812567 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812800 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.812899 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813118 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813206 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813435 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813521 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813750 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.813845 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814070 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814156 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814389 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814475 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814707 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.814799 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815022 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815116 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815362 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815455 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815685 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.815771 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816006 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816093 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816328 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816424 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816647 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816741 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.816966 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817052 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817282 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817376 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817598 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817683 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.817913 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818120 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818227 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818440 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818547 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818779 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.818865 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819111 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819207 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819467 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819569 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819792 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.819880 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820115 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820215 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820462 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820547 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820786 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.820872 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821120 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821312 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821437 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821634 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821752 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.821975 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822100 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822308 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822396 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822640 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822727 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.822966 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823062 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823339 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823430 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823624 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823710 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.823945 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824158 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824246 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824507 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824593 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824829 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.824941 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825188 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825289 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825515 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825601 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825834 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.825921 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826142 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826244 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826466 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826558 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826781 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.826876 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.827116 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.827339 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.827430 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.827695 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.827782 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828022 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828118 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828340 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828426 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828655 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828741 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.828971 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829067 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829278 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829365 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829592 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829687 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829900 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.829988 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830209 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830294 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830528 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830621 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830839 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.830925 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831147 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831232 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831483 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831588 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831792 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.831877 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832101 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832188 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832407 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832501 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832713 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.832807 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833021 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833106 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833330 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833424 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833645 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833739 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.833953 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834039 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834315 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834451 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834557 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834659 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834874 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.834994 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835183 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835354 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835517 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835607 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835827 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.835934 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836140 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836233 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836449 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836544 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836765 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.836851 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837075 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837162 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837393 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837479 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837702 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.837805 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838015 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838103 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838357 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838449 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838694 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.838895 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839004 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839239 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839364 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839606 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839694 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.839947 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.840034 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.840274 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.840361 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841126 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841221 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841443 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841529 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841757 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.841843 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842092 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842195 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842412 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842626 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842733 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.842963 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.843048 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.843339 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.843472 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.843650 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.843859 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844045 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844230 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844420 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844643 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844766 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.844872 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.845188 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.845507 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.845725 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.845816 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846047 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846134 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846367 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846463 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846690 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.846780 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847009 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847104 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847338 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847440 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847658 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847744 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.847974 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848061 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848290 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848377 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848604 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848692 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.848920 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849006 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849238 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849325 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849550 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849674 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849865 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.849958 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850184 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850278 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850500 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850587 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850814 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.850900 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851130 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851216 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851477 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851565 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851796 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.851894 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852107 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852196 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852420 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852533 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852735 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.852856 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853059 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853181 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853393 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853507 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853713 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.853807 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854022 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854139 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854449 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854543 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854768 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.854855 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855100 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855230 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855433 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855522 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855748 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.855834 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.856076 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.856187 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.856967 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857057 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857287 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857382 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857603 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857688 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.857916 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858014 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858227 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858313 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858543 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858629 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858866 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.858968 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859183 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859271 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859521 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859609 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859832 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.859939 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860141 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860226 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860450 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860536 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860806 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.860908 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861072 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861159 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861381 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861465 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861691 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861779 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.861999 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862123 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862308 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862402 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862616 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862709 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.862921 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863014 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863228 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863343 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863566 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863655 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863872 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.863965 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864178 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864277 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864484 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864568 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864792 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.864878 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865099 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865200 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865405 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865493 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865720 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.865814 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866026 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866128 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866335 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866428 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866643 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866730 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.866951 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867045 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867256 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867409 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867614 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867701 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.867939 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868038 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868259 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868345 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868578 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868670 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868895 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.868983 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869220 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869304 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869533 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869619 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869847 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.869934 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870167 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870252 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870485 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870570 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870798 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.870884 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.871113 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.871197 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.871731 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.871858 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872092 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872217 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872407 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872505 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872723 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.872816 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873042 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873137 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873360 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873454 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873678 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873777 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.873997 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874084 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874305 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874389 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874638 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874724 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.874985 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875078 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875306 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875433 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875636 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875726 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.875954 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876041 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876277 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876370 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876587 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876699 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.876902 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877036 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877216 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877311 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877534 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877621 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877849 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.877936 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878169 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878264 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878483 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878573 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878802 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.878887 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879122 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879219 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879466 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879560 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879798 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.879897 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880129 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880224 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880445 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880533 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880774 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.880860 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.881092 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.881179 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.881403 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.881490 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.881649 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:49:06.881744 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.882083 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.882417 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.882736 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.883051 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.883387 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:49:06.883637 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:49:06.947205 ncdv-master-1 devstack@n-api.service[114942]: INFO dbcounter [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Registered counter for database nova_api Jul 30 20:49:06.949291 ncdv-master-1 devstack@n-api.service[114941]: INFO dbcounter [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Registered counter for database nova_api Jul 30 20:49:06.968766 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_db.sqlalchemy.engines [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:06.970427 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_db.sqlalchemy.engines [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:06.975532 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writer thread running {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:06.977688 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writer thread running {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.032503 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.context [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=114942) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 20:49:07.033686 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.context [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=114941) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 20:49:07.037945 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_concurrency.lockutils [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:49:07.038686 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:49:07.039531 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_concurrency.lockutils [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:49:07.040318 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_concurrency.lockutils [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:49:07.040451 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:49:07.041300 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:49:07.042306 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_concurrency.lockutils [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:49:07.044438 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:49:07.044870 ncdv-master-1 devstack@n-api.service[114942]: INFO dbcounter [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Registered counter for database nova_cell0 Jul 30 20:49:07.046018 ncdv-master-1 devstack@n-api.service[114941]: INFO dbcounter [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Registered counter for database nova_cell0 Jul 30 20:49:07.049100 ncdv-master-1 devstack@n-api.service[114942]: INFO dbcounter [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Registered counter for database nova_cell1 Jul 30 20:49:07.050059 ncdv-master-1 devstack@n-api.service[114941]: INFO dbcounter [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Registered counter for database nova_cell1 Jul 30 20:49:07.056704 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_db.sqlalchemy.engines [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.057917 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_db.sqlalchemy.engines [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.061561 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_db.sqlalchemy.engines [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.063959 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_db.sqlalchemy.engines [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.065567 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writer thread running {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.065917 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writer thread running {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.068514 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writer thread running {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.205665 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writer thread running {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.212335 ncdv-master-1 devstack@n-api.service[114942]: INFO dbcounter [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Registered counter for database nova_cell0 Jul 30 20:49:07.215451 ncdv-master-1 devstack@n-api.service[114941]: INFO dbcounter [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Registered counter for database nova_cell0 Jul 30 20:49:07.221792 ncdv-master-1 devstack@n-api.service[114942]: DEBUG oslo_db.sqlalchemy.engines [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.226924 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_db.sqlalchemy.engines [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:49:07.227473 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writer thread running {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.231813 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writer thread running {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:49:07.572840 ncdv-master-1 devstack@n-api.service[114941]: WARNING keystonemiddleware.auth_token [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:49:07.575795 ncdv-master-1 devstack@n-api.service[114942]: WARNING keystonemiddleware.auth_token [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:49:07.580205 ncdv-master-1 devstack@n-api.service[114941]: WARNING keystonemiddleware.auth_token [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:49:07.583039 ncdv-master-1 devstack@n-api.service[114942]: WARNING keystonemiddleware.auth_token [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:49:07.926623 ncdv-master-1 devstack@n-api.service[114941]: WARNING keystonemiddleware.auth_token [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:49:07.930375 ncdv-master-1 devstack@n-api.service[114942]: WARNING keystonemiddleware.auth_token [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:49:07.932647 ncdv-master-1 devstack@n-api.service[114941]: WARNING keystonemiddleware.auth_token [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:49:07.936984 ncdv-master-1 devstack@n-api.service[114942]: WARNING keystonemiddleware.auth_token [None req-7aec4901-e68c-48e5-8620-8c71bd5963c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:49:07.938480 ncdv-master-1 devstack@n-api.service[114941]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562efe5cf9c0 pid: 114941 (default app) Jul 30 20:49:07.940560 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:49:07.941745 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Jul 30 20:49:07.942158 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Jul 30 20:49:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:49:07.942248 ncdv-master-1 devstack@n-api.service[114942]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562efe5cf9c0 pid: 114942 (default app) Jul 30 20:50:28.500339 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:28.501876 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 30 20:50:28.502032 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:28.514855 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_api:SELECT=3 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:28.516090 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_cell0:SELECT=3 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:28.516920 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_cell1:SELECT=3 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:28.517711 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:29.394374 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ca9918e4-dac4-4bb2-9952-f7e7494a235a admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:29.426890 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-ca9918e4-dac4-4bb2-9952-f7e7494a235a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917478 Jul 30 20:50:29.427579 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 30 20:50:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:31.912313 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:31.913646 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-eb016328-7f9b-439f-964a-eb7e56e24fb4 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001917 Jul 30 20:50:31.914379 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:32.408655 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-b63daf3e-4bbb-4098-ac74-7e1953cb507e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:32.428757 ncdv-master-1 devstack@n-api.service[114942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:50:32.428757 ncdv-master-1 devstack@n-api.service[114942]: warnings.warn(msg) Jul 30 20:50:32.457662 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-b63daf3e-4bbb-4098-ac74-7e1953cb507e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.536232 Jul 30 20:50:32.458404 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:32.676544 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-5e02814b-d054-4de1-9448-ead9a5345fa1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:32.680862 ncdv-master-1 devstack@n-api.service[114941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:50:32.680862 ncdv-master-1 devstack@n-api.service[114941]: warnings.warn(msg) Jul 30 20:50:32.683674 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_api:SELECT=3 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:32.684562 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_cell1:SELECT=3 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:32.685540 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_cell0:SELECT=3 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:32.686384 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:32.745451 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-5e02814b-d054-4de1-9448-ead9a5345fa1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277691 Jul 30 20:50:32.746043 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 30 20:50:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 20:50:35.240864 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-b63daf3e-4bbb-4098-ac74-7e1953cb507e admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:35.241890 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-b63daf3e-4bbb-4098-ac74-7e1953cb507e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 30 20:50:35.242306 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:35.966580 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-f6f0c2e8-c889-468e-a7d3-84547cc480d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "disk": 5}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:36.000169 ncdv-master-1 devstack@n-api.service[114941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:50:36.000169 ncdv-master-1 devstack@n-api.service[114941]: warnings.warn(msg) Jul 30 20:50:36.037387 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-f6f0c2e8-c889-468e-a7d3-84547cc480d2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.788237 Jul 30 20:50:36.043336 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:36.050370 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-5101dac6-b67f-494e-b86c-3e46297f53b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:36.055893 ncdv-master-1 devstack@n-api.service[114942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:50:36.055893 ncdv-master-1 devstack@n-api.service[114942]: warnings.warn(msg) Jul 30 20:50:36.099593 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-5101dac6-b67f-494e-b86c-3e46297f53b2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051792 Jul 30 20:50:36.100723 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 30 20:50:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:38.914673 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-f6f0c2e8-c889-468e-a7d3-84547cc480d2 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:38.917887 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-f6f0c2e8-c889-468e-a7d3-84547cc480d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Jul 30 20:50:38.927584 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:39.380777 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-4445dd5a-a10b-4c47-9548-c23a810371cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d2", "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:39.409570 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-4445dd5a-a10b-4c47-9548-c23a810371cb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484730 Jul 30 20:50:39.416042 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:39.424562 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-201ad55d-5860-4fcf-a827-769e8e25fae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:39.454699 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-201ad55d-5860-4fcf-a827-769e8e25fae8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034193 Jul 30 20:50:39.464315 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 30 20:50:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:42.130688 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-4445dd5a-a10b-4c47-9548-c23a810371cb admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:42.131732 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-4445dd5a-a10b-4c47-9548-c23a810371cb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 30 20:50:42.132134 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:42.700838 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-c0b83267-9abb-484a-b89d-c03acab1c5bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "disk": 10}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:42.730409 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-c0b83267-9abb-484a-b89d-c03acab1c5bc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.591836 Jul 30 20:50:42.735362 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:42.742648 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a6289a0b-8232-4884-9e7f-9a27d479b6a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:42.773830 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a6289a0b-8232-4884-9e7f-9a27d479b6a9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034581 Jul 30 20:50:42.774782 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 30 20:50:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:45.352789 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-c0b83267-9abb-484a-b89d-c03acab1c5bc admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:45.354424 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-c0b83267-9abb-484a-b89d-c03acab1c5bc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 30 20:50:45.354829 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:45.835923 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:45.856070 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494848 Jul 30 20:50:45.856737 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:45.868589 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-ce4e8bd6-91f5-4d41-a9c1-c8631f080c38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:45.894988 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-ce4e8bd6-91f5-4d41-a9c1-c8631f080c38 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029734 Jul 30 20:50:45.896023 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 30 20:50:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:48.333846 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:48.334864 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 30 20:50:48.335271 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:48.804826 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-d1a03d48-8fd7-491f-8098-18f277b67db0 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:48.830886 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-d1a03d48-8fd7-491f-8098-18f277b67db0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.488737 Jul 30 20:50:48.831658 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 30 20:50:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:50:51.738929 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:51.740357 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a15bcdf6-2442-4dab-9a9d-51cd546e33d3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jul 30 20:50:51.740860 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:52.196914 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-14be60f4-65a5-417b-ad1d-c82ce58fd4c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:52.217625 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-14be60f4-65a5-417b-ad1d-c82ce58fd4c9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468300 Jul 30 20:50:52.218749 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:52.233027 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-57d3eed6-69f6-4f0f-9b4e-4257b379fc75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:52.259040 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-57d3eed6-69f6-4f0f-9b4e-4257b379fc75 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030411 Jul 30 20:50:52.259684 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 30 20:50:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 20:50:54.891505 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-14be60f4-65a5-417b-ad1d-c82ce58fd4c9 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:54.892844 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-14be60f4-65a5-417b-ad1d-c82ce58fd4c9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jul 30 20:50:54.893348 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:55.333037 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-e402d7b5-54d7-4ffa-a444-0b39ea9810dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:55.352374 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-e402d7b5-54d7-4ffa-a444-0b39ea9810dd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452230 Jul 30 20:50:55.353018 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:55.366700 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-82891fe7-921e-438b-bf2d-a16608a4d789 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:55.396240 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-82891fe7-921e-438b-bf2d-a16608a4d789 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034197 Jul 30 20:50:55.396958 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 30 20:50:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:50:57.933212 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-e402d7b5-54d7-4ffa-a444-0b39ea9810dd admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:50:57.934868 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-e402d7b5-54d7-4ffa-a444-0b39ea9810dd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jul 30 20:50:57.935044 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:50:58.316878 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-cc12d1cb-2c24-4050-aec5-71713315f25e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 4096, "disk": 40, "name": "m1.medium"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:58.342112 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-cc12d1cb-2c24-4050-aec5-71713315f25e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.400875 Jul 30 20:50:58.344247 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:50:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:50:58.355457 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-e51d3164-40f1-4b52-a165-46e6efc7d4b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:50:58.378496 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-e51d3164-40f1-4b52-a165-46e6efc7d4b2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026731 Jul 30 20:50:58.379411 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 30 20:50:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:51:00.894703 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-cc12d1cb-2c24-4050-aec5-71713315f25e admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:00.895724 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-cc12d1cb-2c24-4050-aec5-71713315f25e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 30 20:51:00.897194 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:01.348619 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a55b2735-c215-4d96-895e-0ce4f979756a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:01.355069 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:01.371171 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a55b2735-c215-4d96-895e-0ce4f979756a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468240 Jul 30 20:51:01.371852 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:51:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:51:01.385134 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-01257294-1b36-4595-9d72-680c50de48a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:01.411531 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-01257294-1b36-4595-9d72-680c50de48a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030259 Jul 30 20:51:01.426743 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 30 20:51:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:51:03.937245 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-a55b2735-c215-4d96-895e-0ce4f979756a admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:03.938975 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-a55b2735-c215-4d96-895e-0ce4f979756a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Jul 30 20:51:03.939584 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:04.408648 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "id": "5", "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:04.418244 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:04.431976 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.485836 Jul 30 20:51:04.439665 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 30 20:51:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 20:51:04.444849 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ab6ac84d-5921-4659-ac01-77ccb5ec58d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:04.473217 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-ab6ac84d-5921-4659-ac01-77ccb5ec58d1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032029 Jul 30 20:51:04.474196 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 30 20:51:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:51:26.453987 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:26.454985 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 30 20:51:26.455462 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:26.466123 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:26.856636 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-2ee5ba27-8d73-4ba8-a0fe-1b9a8d306e6d admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:26.874591 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-2ee5ba27-8d73-4ba8-a0fe-1b9a8d306e6d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413289 Jul 30 20:51:26.875060 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 30 20:51:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:51:28.005283 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:28.006285 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-787107a1-888d-4013-bf1b-e70ceb0364ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 30 20:51:28.006692 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:28.599975 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ab108eed-9ece-46f6-b958-13a509fabf7e admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:28.606115 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.wsgi [None req-ab108eed-9ece-46f6-b958-13a509fabf7e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ab108eed-9ece-46f6-b958-13a509fabf7e admin admin] Request method failure captured: Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Accept: application/json Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Accept-Encoding: gzip, deflate Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Connection: keep-alive Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Content-Length: 0 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Host: 10.222.0.17 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: Openstack-System-Scope: None Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: User-Agent: python-novaclient Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Auth-Token: gAAAAABi5ZnPPhlGrMMu-ip88PUhkmbpKQv1_iyl9ZOuRok45PkxMzAhbYWSW8jLBZMxHDIFn2YFH-nm6h7CiP2QfI0Yi8YdMK66BwRFDYIje0PTY-BdKbig_MUNg5t8yYH2ARjS5ixjMm99JAZbX_QaVTntpeSvZH7Kqqd8VCYYO_7EfkrDyxM Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Id: None Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Name: None Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Identity-Status: Confirmed Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Is-Admin-Project: True Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Id: default Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Name: Default Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Name: admin Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Role: reader,admin,member Jul 30 20:51:28.615645 ncdv-master-1 devstack@n-api.service[114942]: X-Roles: reader,admin,member Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant: admin Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Name: admin Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-User: admin Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Id: default Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Name: Default Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: X-User-Name: admin Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: method: > Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: exception: Flavor 42 could not be found. Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: action_args: {'id': '42'} Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:28.617331 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:28.618270 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.619492 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ab108eed-9ece-46f6-b958-13a509fabf7e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:28.620545 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-ab108eed-9ece-46f6-b958-13a509fabf7e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411100 Jul 30 20:51:28.620545 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 20:51:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:28.627565 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-0a59b05e-59d3-4083-ace7-1bf3f2cb492e admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:28.650161 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-0a59b05e-59d3-4083-ace7-1bf3f2cb492e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026488 Jul 30 20:51:28.650699 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 20:51:28.660298 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-e7043601-8398-4be6-81f0-1e4b3c01e21c admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:28.682924 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-e7043601-8398-4be6-81f0-1e4b3c01e21c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026104 Jul 30 20:51:28.683502 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:51:28.693391 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-da9e8560-aae6-43a0-8130-9af9142d20d8 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:28.699275 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.wsgi [None req-da9e8560-aae6-43a0-8130-9af9142d20d8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-da9e8560-aae6-43a0-8130-9af9142d20d8 admin admin] Request method failure captured: Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Accept: application/json Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Accept-Encoding: gzip, deflate Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Connection: keep-alive Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Content-Length: 0 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Host: 10.222.0.17 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: Openstack-System-Scope: None Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: User-Agent: python-novaclient Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Auth-Token: gAAAAABi5ZnPPhlGrMMu-ip88PUhkmbpKQv1_iyl9ZOuRok45PkxMzAhbYWSW8jLBZMxHDIFn2YFH-nm6h7CiP2QfI0Yi8YdMK66BwRFDYIje0PTY-BdKbig_MUNg5t8yYH2ARjS5ixjMm99JAZbX_QaVTntpeSvZH7Kqqd8VCYYO_7EfkrDyxM Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Id: None Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Name: None Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Identity-Status: Confirmed Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Is-Admin-Project: True Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Id: default Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Name: Default Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Name: admin Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Role: reader,admin,member Jul 30 20:51:28.702545 ncdv-master-1 devstack@n-api.service[114941]: X-Roles: reader,admin,member Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant: admin Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Name: admin Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-User: admin Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Id: default Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Name: Default Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: X-User-Name: admin Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: method: > Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: exception: Flavor 42 could not be found. Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: action_args: {'id': '42'} Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:28.704202 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:28.705061 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:28.706126 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-da9e8560-aae6-43a0-8130-9af9142d20d8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:28.707131 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-da9e8560-aae6-43a0-8130-9af9142d20d8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014632 Jul 30 20:51:28.707131 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 20:51:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:29.695565 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-e7043601-8398-4be6-81f0-1e4b3c01e21c admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:29.697145 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-e7043601-8398-4be6-81f0-1e4b3c01e21c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Jul 30 20:51:29.697546 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 20:51:30.229511 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-e8d98c8d-dbfc-4c7e-9b9a-4ce84dfab27b admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:30.235402 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.wsgi [None req-e8d98c8d-dbfc-4c7e-9b9a-4ce84dfab27b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-e8d98c8d-dbfc-4c7e-9b9a-4ce84dfab27b admin admin] Request method failure captured: Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Accept: application/json Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Accept-Encoding: gzip, deflate Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Connection: keep-alive Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Content-Length: 0 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Host: 10.222.0.17 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: Openstack-System-Scope: None Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: User-Agent: python-novaclient Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Auth-Token: gAAAAABi5ZnRVXuP0hEcX86H5Umq3DmyipEoDIT4Z8b5j4_88G3VakV47-4rO7IYQKsNj1IVR13oUGWiEWBUJW-tudPzivm0VKFYoyItFoH_a19xzTvX_Fx-GNI8lTfLlNyIiA0MH6kYjMSQWRsUee4tpq3PVfaQTGtJI505ZvZIed-j5tYDQbE Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Id: None Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Name: None Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Identity-Status: Confirmed Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Is-Admin-Project: True Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Id: default Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Name: Default Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Name: admin Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Role: reader,admin,member Jul 30 20:51:30.236903 ncdv-master-1 devstack@n-api.service[114941]: X-Roles: reader,admin,member Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant: admin Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Name: admin Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-User: admin Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Id: default Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Name: Default Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: X-User-Name: admin Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: method: > Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: exception: Flavor 84 could not be found. Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: action_args: {'id': '84'} Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:30.238414 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:30.239538 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.240923 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-e8d98c8d-dbfc-4c7e-9b9a-4ce84dfab27b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:30.242146 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-e8d98c8d-dbfc-4c7e-9b9a-4ce84dfab27b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397381 Jul 30 20:51:30.242146 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 20:51:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:30.248191 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-c4523100-86d7-4792-ad12-bce2c20cff13 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:30.262828 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-c4523100-86d7-4792-ad12-bce2c20cff13 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018493 Jul 30 20:51:30.263365 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 20:51:30.272439 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-54761a7c-9807-4a85-967a-ae265abd1069 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:30.287419 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-54761a7c-9807-4a85-967a-ae265abd1069 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018401 Jul 30 20:51:30.287930 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:51:30.297597 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-b70e1186-f295-4314-a87c-144277442077 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:30.302827 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.wsgi [None req-b70e1186-f295-4314-a87c-144277442077 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-b70e1186-f295-4314-a87c-144277442077 admin admin] Request method failure captured: Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Accept: application/json Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Accept-Encoding: gzip, deflate Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Connection: keep-alive Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Content-Length: 0 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Host: 10.222.0.17 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: Openstack-System-Scope: None Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: User-Agent: python-novaclient Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Auth-Token: gAAAAABi5ZnRVXuP0hEcX86H5Umq3DmyipEoDIT4Z8b5j4_88G3VakV47-4rO7IYQKsNj1IVR13oUGWiEWBUJW-tudPzivm0VKFYoyItFoH_a19xzTvX_Fx-GNI8lTfLlNyIiA0MH6kYjMSQWRsUee4tpq3PVfaQTGtJI505ZvZIed-j5tYDQbE Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Id: None Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Name: None Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Identity-Status: Confirmed Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Is-Admin-Project: True Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Id: default Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Name: Default Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Name: admin Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Role: reader,admin,member Jul 30 20:51:30.304353 ncdv-master-1 devstack@n-api.service[114942]: X-Roles: reader,admin,member Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant: admin Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Name: admin Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-User: admin Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Id: default Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Name: Default Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: X-User-Name: admin Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: method: > Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: exception: Flavor 84 could not be found. Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: action_args: {'id': '84'} Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:30.306043 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:30.307164 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:30.308504 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-b70e1186-f295-4314-a87c-144277442077 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:30.309724 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-b70e1186-f295-4314-a87c-144277442077 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011594 Jul 30 20:51:30.309724 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 20:51:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:31.301610 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-54761a7c-9807-4a85-967a-ae265abd1069 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:31.302618 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-54761a7c-9807-4a85-967a-ae265abd1069 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 30 20:51:31.303017 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:31.840204 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-30cacbbe-027c-4df5-9e04-a7660f4e8929 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:31.845855 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.wsgi [None req-30cacbbe-027c-4df5-9e04-a7660f4e8929 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-30cacbbe-027c-4df5-9e04-a7660f4e8929 admin admin] Request method failure captured: Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Accept: application/json Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Accept-Encoding: gzip, deflate Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Connection: keep-alive Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Content-Length: 0 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Host: 10.222.0.17 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: Openstack-System-Scope: None Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: User-Agent: python-novaclient Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Auth-Token: gAAAAABi5ZnTcNb7jm9hUytCcVrtI2xdIKbeMXQ4T2NwggK9Blyr2jLv-HOKRJCGzM3H6UyL-Bq9xgd5iBnzFIGifKy1Cen4_TkozNWYOi2dMLkdxjn2Q-KU-B48AtLuBp1nXjKYanpe02rq6NAqy1hJpK-1rdRHQhXRaAeRZkhvLCBlP7ZOuTM Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Id: None Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Domain-Name: None Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Identity-Status: Confirmed Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Is-Admin-Project: True Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Id: default Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Domain-Name: Default Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Project-Name: admin Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Role: reader,admin,member Jul 30 20:51:31.847361 ncdv-master-1 devstack@n-api.service[114942]: X-Roles: reader,admin,member Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant: admin Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-Tenant-Name: admin Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-User: admin Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Id: default Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-User-Domain-Name: Default Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: X-User-Name: admin Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: method: > Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: exception: Flavor 451 could not be found. Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: action_args: {'id': '451'} Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:31.848873 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:31.849843 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.851118 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-30cacbbe-027c-4df5-9e04-a7660f4e8929 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:31.852412 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-30cacbbe-027c-4df5-9e04-a7660f4e8929 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395959 Jul 30 20:51:31.852412 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 20:51:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 20:51:31.859069 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-9e70421d-75e3-49f9-a82e-23efde9630a9 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:31.873823 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-9e70421d-75e3-49f9-a82e-23efde9630a9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018316 Jul 30 20:51:31.874359 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:51:31.883442 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:31.898149 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018023 Jul 30 20:51:31.898700 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 30 20:51:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:51:31.909522 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-f3a46225-21a2-4146-abc0-a3bd0d260e1f admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:31.915818 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.wsgi [None req-f3a46225-21a2-4146-abc0-a3bd0d260e1f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-f3a46225-21a2-4146-abc0-a3bd0d260e1f admin admin] Request method failure captured: Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Accept: application/json Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Accept-Encoding: gzip, deflate Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Connection: keep-alive Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Content-Length: 0 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Host: 10.222.0.17 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Openstack-Api-Version: compute 2.90 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: Openstack-System-Scope: None Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: User-Agent: python-novaclient Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Auth-Token: gAAAAABi5ZnTcNb7jm9hUytCcVrtI2xdIKbeMXQ4T2NwggK9Blyr2jLv-HOKRJCGzM3H6UyL-Bq9xgd5iBnzFIGifKy1Cen4_TkozNWYOi2dMLkdxjn2Q-KU-B48AtLuBp1nXjKYanpe02rq6NAqy1hJpK-1rdRHQhXRaAeRZkhvLCBlP7ZOuTM Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Id: None Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Domain-Name: None Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Identity-Status: Confirmed Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Is-Admin-Project: True Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Id: default Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Domain-Name: Default Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Project-Name: admin Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Role: reader,admin,member Jul 30 20:51:31.917363 ncdv-master-1 devstack@n-api.service[114941]: X-Roles: reader,admin,member Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/375d034049af46779b4f307bede15a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_375d034049af46779b4f307bede15a89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/375d034049af46779b4f307bede15a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant: admin Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Id: 375d034049af46779b4f307bede15a89 Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-Tenant-Name: admin Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-User: admin Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Id: default Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-User-Domain-Name: Default Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-User-Id: 57e206ec85774a5086d011cb1726114a Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: X-User-Name: admin Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: method: > Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: exception: Flavor 451 could not be found. Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: action_args: {'id': '451'} Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 20:51:31.918997 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:31.920043 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: ERROR nova.api.openstack.wsgi Jul 30 20:51:31.921436 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-f3a46225-21a2-4146-abc0-a3bd0d260e1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 20:51:31.922665 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-f3a46225-21a2-4146-abc0-a3bd0d260e1f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012760 Jul 30 20:51:31.922665 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 20:51:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 30 20:51:32.883364 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:32.884542 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jul 30 20:51:32.884942 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:33.417001 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-27efc637-4176-419a-a36e-a99208c754a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:33.436342 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-27efc637-4176-419a-a36e-a99208c754a2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403866 Jul 30 20:51:33.436881 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 30 20:51:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:51:34.425494 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:34.427084 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Jul 30 20:51:34.427611 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:34.955177 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-6f2a2c2e-72f7-4440-bd44-1db5eaa7129e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:34.973537 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-6f2a2c2e-72f7-4440-bd44-1db5eaa7129e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400090 Jul 30 20:51:34.974073 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 30 20:51:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:51:35.945796 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:35.947311 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jul 30 20:51:35.947709 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:36.477473 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-36c30ac0-17bf-4b57-a949-8004c2879d8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:36.495695 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-36c30ac0-17bf-4b57-a949-8004c2879d8c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402190 Jul 30 20:51:36.496233 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 30 20:51:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:51:37.486633 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:37.487686 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 30 20:51:37.488079 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:38.039733 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-91e6aaa8-8699-4f1d-a40c-4cc71ad2a8e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 20:51:38.058316 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-91e6aaa8-8699-4f1d-a40c-4cc71ad2a8e5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.423386 Jul 30 20:51:38.058857 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 30 20:51:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 20:51:39.036043 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:39.037080 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 30 20:51:39.037473 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:51:39.569086 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-4cb87423-0ff4-4e66-862e-07607331d976 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:51:39.590168 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-4cb87423-0ff4-4e66-862e-07607331d976 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406091 Jul 30 20:51:39.590710 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Jul 30 20:51:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:52:38.153948 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.155017 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-76986037-9784-4bc0-b678-da97b1ddfc50 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 30 20:52:38.155457 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 20:52:38.166265 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:38.555894 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-b45e9f00-3d31-4174-88fe-e5bc43da00be admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.577994 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-b45e9f00-3d31-4174-88fe-e5bc43da00be admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416402 Jul 30 20:52:38.578522 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:52:38.599052 ncdv-master-1 devstack@n-api.service[114942]: DEBUG dbcounter [-] [114942] Writing DB stats nova_api:SELECT=14 {{(pid=114942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:38.603003 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-ea3cbc37-7f1e-45f6-b760-1a3ac2ff23c4 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.610586 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-ea3cbc37-7f1e-45f6-b760-1a3ac2ff23c4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012929 Jul 30 20:52:38.611105 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:52:38.622933 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-387e296a-27ec-4d9d-835c-d92a0c41387b admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.630974 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-387e296a-27ec-4d9d-835c-d92a0c41387b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011688 Jul 30 20:52:38.632716 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 20:52:38.643741 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.651152 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010936 Jul 30 20:52:38.651705 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 20:52:38.663256 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-b1722364-8ea1-4593-ba2f-a47c5f80d00f admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:52:38.670992 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-b1722364-8ea1-4593-ba2f-a47c5f80d00f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011634 Jul 30 20:52:38.671539 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Sat Jul 30 20:52:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 20:58:32.384887 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:58:32.385892 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 30 20:58:32.386285 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:58:32.534848 ncdv-master-1 devstack@n-api.service[114941]: DEBUG dbcounter [-] [114941] Writing DB stats nova_api:SELECT=6 {{(pid=114941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:32.675688 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:58:32.678045 ncdv-master-1 devstack@n-api.service[114941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:58:32.678045 ncdv-master-1 devstack@n-api.service[114941]: warnings.warn(msg) Jul 30 20:58:32.679244 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:58:32.679709 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:58:32.680491 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:58:32.680920 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:58:32.723326 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-b7e45318-3081-4f51-a0a5-329e200f9527 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.189664 Jul 30 20:58:32.724018 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 20:58:32 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:58:33.568106 ncdv-master-1 devstack@n-api.service[114942]: DEBUG nova.api.openstack.wsgi [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] Calling method '>' {{(pid=114942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:58:33.569114 ncdv-master-1 devstack@n-api.service[114942]: INFO nova.api.openstack.requestlog [None req-17269b61-b901-43b7-8ff1-a8c7e9d82e09 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Jul 30 20:58:33.569516 ncdv-master-1 devstack@n-api.service[114942]: [pid: 114942|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 30 20:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 20:58:33.780199 ncdv-master-1 devstack@n-api.service[114941]: DEBUG nova.api.openstack.wsgi [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] Calling method '>' {{(pid=114941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 20:58:33.782731 ncdv-master-1 devstack@n-api.service[114941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 20:58:33.782731 ncdv-master-1 devstack@n-api.service[114941]: warnings.warn(msg) Jul 30 20:58:33.783965 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:58:33.784430 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:58:33.785194 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:58:33.785616 ncdv-master-1 devstack@n-api.service[114941]: DEBUG oslo_concurrency.lockutils [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:58:33.809984 ncdv-master-1 devstack@n-api.service[114941]: INFO nova.api.openstack.requestlog [None req-be4c908a-feb9-417b-94b1-da6a64d7d976 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.082331 Jul 30 20:58:33.810549 ncdv-master-1 devstack@n-api.service[114941]: [pid: 114941|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 20:58:33 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 20:59:21.623940 ncdv-master-1 devstack@n-api.service[114940]: Sat Jul 30 20:59:21 2022 - graceful shutdown triggered... Jul 30 20:59:21.624487 ncdv-master-1 devstack@n-api.service[114942]: Gracefully killing worker 2 (pid: 114942)... Jul 30 20:59:21.624070 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 30 20:59:21.625373 ncdv-master-1 devstack@n-api.service[114941]: Gracefully killing worker 1 (pid: 114941)... Jul 30 20:59:22.624572 ncdv-master-1 devstack@n-api.service[114940]: worker 1 buried after 1 seconds Jul 30 20:59:22.624572 ncdv-master-1 devstack@n-api.service[114940]: worker 2 buried after 1 seconds Jul 30 20:59:22.625062 ncdv-master-1 devstack@n-api.service[114940]: goodbye to uWSGI. Jul 30 20:59:22.626158 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 30 20:59:22.626725 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 30 20:59:22.629563 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 20:59:22.674766 ncdv-master-1 devstack@n-api.service[130972]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 30 20:59:22 2022] *** Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: nodename: ncdv-master-1 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: machine: x86_64 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: clock source: unix Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: pcre jit disabled Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: detected number of CPU cores: 4 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: current working directory: / Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: detected binary path: /usr/bin/uwsgi-core Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: your processes number limit is 47680 Jul 30 20:59:22.677740 ncdv-master-1 devstack@n-api.service[130972]: your memory page size is 4096 bytes Jul 30 20:59:22.678665 ncdv-master-1 devstack@n-api.service[130972]: detected max file descriptor number: 2048 Jul 30 20:59:22.678665 ncdv-master-1 devstack@n-api.service[130972]: lock engine: pthread robust mutexes Jul 30 20:59:22.678665 ncdv-master-1 devstack@n-api.service[130972]: thunder lock: enabled Jul 30 20:59:22.678665 ncdv-master-1 devstack@n-api.service[130972]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 20:59:22.678665 ncdv-master-1 devstack@n-api.service[130972]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 30 20:59:22.723204 ncdv-master-1 devstack@n-api.service[130972]: Python main interpreter initialized at 0x563d0f6aa9c0 Jul 30 20:59:22.723204 ncdv-master-1 devstack@n-api.service[130972]: python threads support enabled Jul 30 20:59:22.723204 ncdv-master-1 devstack@n-api.service[130972]: your server socket listen backlog is limited to 100 connections Jul 30 20:59:22.723204 ncdv-master-1 devstack@n-api.service[130972]: your mercy for graceful operations on workers is 90 seconds Jul 30 20:59:22.723679 ncdv-master-1 devstack@n-api.service[130972]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 20:59:22.723679 ncdv-master-1 devstack@n-api.service[130972]: *** Operational MODE: preforking *** Jul 30 20:59:22.723899 ncdv-master-1 devstack@n-api.service[130972]: *** uWSGI is running in multiple interpreter mode *** Jul 30 20:59:22.723899 ncdv-master-1 devstack@n-api.service[130972]: spawned uWSGI master process (pid: 130972) Jul 30 20:59:22.724108 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 30 20:59:22.724733 ncdv-master-1 devstack@n-api.service[130972]: spawned uWSGI worker 1 (pid: 130983, cores: 1) Jul 30 20:59:22.725108 ncdv-master-1 devstack@n-api.service[130972]: spawned uWSGI worker 2 (pid: 130984, cores: 1) Jul 30 20:59:22.725284 ncdv-master-1 devstack@n-api.service[130972]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 20:59:24.029648 ncdv-master-1 devstack@n-api.service[130983]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 20:59:24.050509 ncdv-master-1 devstack@n-api.service[130984]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 20:59:24.808073 ncdv-master-1 devstack@n-api.service[130984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:59:24.808073 ncdv-master-1 devstack@n-api.service[130984]: from cryptography.utils import int_from_bytes Jul 30 20:59:24.808357 ncdv-master-1 devstack@n-api.service[130984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:59:24.808357 ncdv-master-1 devstack@n-api.service[130984]: from cryptography.utils import int_from_bytes Jul 30 20:59:24.814401 ncdv-master-1 devstack@n-api.service[130983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:59:24.814401 ncdv-master-1 devstack@n-api.service[130983]: from cryptography.utils import int_from_bytes Jul 30 20:59:24.814788 ncdv-master-1 devstack@n-api.service[130983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 20:59:24.814788 ncdv-master-1 devstack@n-api.service[130983]: from cryptography.utils import int_from_bytes Jul 30 20:59:27.231391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:59:27.231864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:59:27.232180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:59:27.232555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:59:27.232819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:59:27.233216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.233553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.233995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.234210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.234546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.234866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.235385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.235880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.236478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.236779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.237142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.237536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.237878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.238209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.238529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.238865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.239180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.239541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.239860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.240487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.241026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.241532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.242045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.242580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.243108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.243461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.243816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.244203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.244554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.244882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.245298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.245625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.245970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.246534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.247033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.247345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.247648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.247985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.248328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.248647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.248988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.249317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.249652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.249987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.250295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.250767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.251238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.251730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.252187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.252677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.253095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.253422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.253756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.254089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.254424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.254687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.254946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.255267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.255620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.255945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.256265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.256587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.256907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.257227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.257546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.257865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.258191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.258518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.258848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.259181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.259534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.259911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.260324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.260586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.260904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.261254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.261584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.261904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.262235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.262571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.262891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.263208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.263558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.263889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.264224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.264538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.264798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.265110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.265427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.265756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.266073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.266393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.266711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.266895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:59:27.267468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.267635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:59:27.267787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.267787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.268072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:59:27.268245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.268439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:59:27.268605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.268760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:59:27.268923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.269071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.269463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.269624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.269775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.269947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.270929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.271861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.272015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.272181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.272372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.273747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.273916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.274996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.275141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.275938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.276982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.277939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.278948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.279102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.279258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.279427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.280992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.281143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.281412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.281564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.281717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.281879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.282040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.282210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.282356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.282499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.283529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.283717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.283866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.283866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.284174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.284412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.284614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.284774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.284926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.285077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.285231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.285459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.285606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.285761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.285916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.286069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.286279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.286491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.286650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.286650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.286941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.287085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.287229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.287423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.287572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.287723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.287878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.288030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.288201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.288348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.288491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.288634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.288784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.288929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.289104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.289760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.289924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.290078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.290248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.290403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.290562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.290716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.290870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.291738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.291915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.292077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.292235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.292395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.292543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.292739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.293318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.293484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.293632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.293793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.294024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.294183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.294183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.294620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.294779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.294932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.295084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.295228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.295418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.295584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.295742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.296084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.296241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.296386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.296545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.296700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.296856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.299536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.299711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.299865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.300026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.300194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.300350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.300495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.300495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.300812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.300988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.301142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.301294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.301446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.301591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.301749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.301903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.302054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.302217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.302396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.302565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.302830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.303013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.303600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.303757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.303901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.304063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.304312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.304478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.304792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.304947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.305117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.305262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.306534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.306775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.306939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.307114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.307413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.307578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.307732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.307878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.308024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.308175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.308337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.308514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.308660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.308812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.308964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.309108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.309253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.309405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.309557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.309701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.309851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.310002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.310153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.310319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.310472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.310624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.310768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.310919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.311075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.311232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.311440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.311606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.311751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.311902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.312067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.312221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.312391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.312551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.312697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.312840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.312983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.313141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.313141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.313872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.314020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.314179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.314348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.314597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.314748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.314911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.315070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.315215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.315381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.315630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.315792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.315945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.316104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.316250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.316401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.316546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.316689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.316875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.317045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.317191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.317341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.317492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.317636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.317790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.317944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.318088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.318231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.318381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.318567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.318799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.319475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.319647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.319810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.319963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.320122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.320277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.320421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.320571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.320723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.320874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.321018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.321169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.321321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.321489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.321635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.321778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.321920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.322084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.322752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.322903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.323054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.323206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.323407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.323964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.324127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.324272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.324428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.324767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.324935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.325082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.325225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.325375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:59:27.325526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.325671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.325846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.326980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.327940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.328978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.329858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.330905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.331973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.332927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.333090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.333235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.333388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.333530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.334120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.334286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.334448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.334641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.334902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.335865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.336721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.337010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.338687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.338859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.339929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.340967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.341856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.342906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.343047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.343199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.343400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.343561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.343713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.344300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.344468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.344624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.344782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.344953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.345985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.346997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.347995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.348894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.349984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.350143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.350289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.350439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.350583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.350769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.351885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.352989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.353165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.353330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.353504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.353667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.353819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.354405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.354591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.354742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.354893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.355936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.356089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.356233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.356383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.356383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.356856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.357922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.358820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.359966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.360892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.361934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.362973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.363922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.364084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.364684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.364848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.365985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.366135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.366299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.366451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.366607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.366926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.367912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.368836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.369996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.370952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.371966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.372904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.373062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.373248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.373248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.373703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.373858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.374021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.374171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.374350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.374924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.375091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.375243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.375417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.375581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.375845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.376888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.377937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.378893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.379922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.380994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.381932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.382862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.383871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.384021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.384185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.384336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.384500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.385563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.385734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.386954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.387991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.388959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.389848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.390971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.391945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.392932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.393943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.394918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.395054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.395171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.395715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.395850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.396936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.397935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.398924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.399939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.400058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.400184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.400298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.400967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.401995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.402854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.403944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.404981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.405120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.405233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.405353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.405889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.406947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.407972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.408892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.409975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.410931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.411859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.412997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.413822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.414942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.415064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.415185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.415316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.415576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.416866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.417777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.418946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.419946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.420910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.421978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.422937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.423938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.424890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.425037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.425241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.425395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.425530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.425673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.426955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.427954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.428983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.429984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.430953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.431961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.432986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.433936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.434138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.434340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.434546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.434731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.434941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.435167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.435167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.435627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.435827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.436692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.437036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.437369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.437570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.437791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.438006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.438221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.438471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.438807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.439989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.440109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.440244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.440432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.440629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.440629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.441005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.441005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.441406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.441616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.441827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.442966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.443090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.443218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.443387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.444262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.444394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.444512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.444674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.444860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.445904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.446114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.446257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.446961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.447828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.447954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.448855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.449222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.449428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.449633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.449863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.450072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.450283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.450496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.450719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.450926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.451142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.452966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.453880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.454898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.455909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.456049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.456331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.456454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.456648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.456648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.458291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.458455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.458620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.458766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.458909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.459997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.460937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.461999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.462754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.463961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.464961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.465920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.466877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.467239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.467350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.467486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.467690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.467842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.468941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.469956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.470947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.471927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.472919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.473963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.500936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.501931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.502893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.503791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.504952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.505062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.505166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.505523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.505829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.506660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.508954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.510846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.511458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.511703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.511983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.512920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.513891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.514879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.515972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.516950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.517959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.518944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.519733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.520746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.520921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.520985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.521949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.522754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.523887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.524820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.524820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.524820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.524820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.524820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.525471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.526925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.527104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.527811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.527956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.528849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.529990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.530968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.531606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.532929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.533169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.533378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.533724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.534077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.534405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.534729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.535052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.535406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.535737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.536060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.536383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.536706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.537028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.537350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.537669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.537996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.538318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.538641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.538965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.539300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.539637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.539998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.540354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.540690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.541062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.541397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.541741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.542072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.542415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.542759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.543100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.543496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.543799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.544493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.544493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.544782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.545156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.545436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.545767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.546118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.546465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.546790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.547136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.547597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.547978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.548359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.548697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.549047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.549382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.549721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.550052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.550383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.550718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.551056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.551413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.551750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.552088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.552426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.552775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.553437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.553437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.553785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.554131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.554500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.554835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.555200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.555583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.555919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.556252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.556597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:59:27.556861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:59:27.588812 ncdv-master-1 devstack@n-api.service[130984]: INFO dbcounter [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Registered counter for database nova_api Jul 30 20:59:27.609072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.615833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writer thread running {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.626616 ncdv-master-1 devstack@n-api.service[130983]: INFO dbcounter [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Registered counter for database nova_api Jul 30 20:59:27.647215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_db.sqlalchemy.engines [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.654649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writer thread running {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.673346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.context [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130984) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 20:59:27.677484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:59:27.679079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:59:27.679922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:59:27.682624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:59:27.684686 ncdv-master-1 devstack@n-api.service[130984]: INFO dbcounter [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Registered counter for database nova_cell0 Jul 30 20:59:27.688788 ncdv-master-1 devstack@n-api.service[130984]: INFO dbcounter [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Registered counter for database nova_cell1 Jul 30 20:59:27.695448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.702962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writer thread running {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.705290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.714403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.context [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130983) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 20:59:27.718591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:59:27.720265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:59:27.721096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 20:59:27.723148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 20:59:27.725309 ncdv-master-1 devstack@n-api.service[130983]: INFO dbcounter [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Registered counter for database nova_cell0 Jul 30 20:59:27.729975 ncdv-master-1 devstack@n-api.service[130983]: INFO dbcounter [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Registered counter for database nova_cell1 Jul 30 20:59:27.739658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_db.sqlalchemy.engines [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.740462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_db.sqlalchemy.engines [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.749232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writer thread running {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.749591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writer thread running {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.864310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writer thread running {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.873904 ncdv-master-1 devstack@n-api.service[130984]: INFO dbcounter [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Registered counter for database nova_cell0 Jul 30 20:59:27.881134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.887331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writer thread running {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:27.903571 ncdv-master-1 devstack@n-api.service[130983]: INFO dbcounter [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Registered counter for database nova_cell0 Jul 30 20:59:27.910273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_db.sqlalchemy.engines [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:59:27.914664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writer thread running {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:59:28.216465 ncdv-master-1 devstack@n-api.service[130984]: WARNING keystonemiddleware.auth_token [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:59:28.224093 ncdv-master-1 devstack@n-api.service[130984]: WARNING keystonemiddleware.auth_token [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:59:28.241762 ncdv-master-1 devstack@n-api.service[130983]: WARNING keystonemiddleware.auth_token [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:59:28.250304 ncdv-master-1 devstack@n-api.service[130983]: WARNING keystonemiddleware.auth_token [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:59:28.591039 ncdv-master-1 devstack@n-api.service[130984]: WARNING keystonemiddleware.auth_token [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:59:28.597201 ncdv-master-1 devstack@n-api.service[130984]: WARNING keystonemiddleware.auth_token [None req-2a1024f4-5341-49ac-ac98-9c704564ebbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:59:28.602582 ncdv-master-1 devstack@n-api.service[130984]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d0f6aa9c0 pid: 130984 (default app) Jul 30 20:59:28.604673 ncdv-master-1 devstack@n-api.service[130983]: WARNING keystonemiddleware.auth_token [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 20:59:28.610773 ncdv-master-1 devstack@n-api.service[130983]: WARNING keystonemiddleware.auth_token [None req-e73b325c-ce92-4808-893e-9e1a538a5ffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 20:59:28.616204 ncdv-master-1 devstack@n-api.service[130983]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d0f6aa9c0 pid: 130983 (default app) Jul 30 21:00:13.206101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.207267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.208380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:13.209370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.262670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f89198f-5bf6-4f91-b90c-e6fe57985157 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1803201939", "ram": 512, "vcpus": 1, "disk": 10, "id": 1197060511, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:14.285202 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:14.285202 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:14.314526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f89198f-5bf6-4f91-b90c-e6fe57985157 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.118101 Jul 30 21:00:14.315195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:13 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:14.344096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.345704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.346436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:14.347659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.511983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1e740bd-ada9-47ec-a452-99a521d57da4 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:15.536974 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e1e740bd-ada9-47ec-a452-99a521d57da4 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] HTTP exception thrown: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1e740bd-ada9-47ec-a452-99a521d57da4 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Request method failure captured: Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zvb_aOt-8hlZjFOBb6W3xG3NSJRQI9RfpM7qxbVBKI5F_ONWTLd17uWf4R1jws4YgCWmw95DxSAOpBOu5UWGKa2tj3zI3AgpxzH8B0l9boXFjChLVRplCza4t7s3DfhUmx6xMXX_N6Pf1r-3U7Dl8sg-XmfgpYwIf0uLtdUJi7TeC8 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:00:15.539716 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/246567397fcd42e29113f1549d475ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_246567397fcd42e29113f1549d475ed0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b63995cd710642ab97651b02b16cd883 Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:15.541076 ncdv-master-1 devstack@n-api.service[130983]: exception: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'flavor_id': '1197060511', 'id': 'hw:cpu_thread_policy'} Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.541767 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1e740bd-ada9-47ec-a452-99a521d57da4 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Returning 404 to user: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1e740bd-ada9-47ec-a452-99a521d57da4 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] 10.222.0.17 "GET /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 1.203645 Jul 30 21:00:15.543094 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:00:14 2022] GET /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 1206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:15.551467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6786b18-7c69-4b17-ab04-25d862ceff35 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.555958 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.555958 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:15.557189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6786b18-7c69-4b17-ab04-25d862ceff35 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b63995cd710642ab97651b02b16cd883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246567397fcd42e29113f1549d475ed0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6786b18-7c69-4b17-ab04-25d862ceff35 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Request method failure captured: Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/flavors/1197060511/os-extra_specs HTTP/1.1 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 66 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvb_aOt-8hlZjFOBb6W3xG3NSJRQI9RfpM7qxbVBKI5F_ONWTLd17uWf4R1jws4YgCWmw95DxSAOpBOu5UWGKa2tj3zI3AgpxzH8B0l9boXFjChLVRplCza4t7s3DfhUmx6xMXX_N6Pf1r-3U7Dl8sg-XmfgpYwIf0uLtdUJi7TeC8 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:15.560563 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/246567397fcd42e29113f1549d475ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_246567397fcd42e29113f1549d475ed0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b63995cd710642ab97651b02b16cd883 Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 30 21:00:15.561781 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'flavor_id': '1197060511', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:15.562520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 30 21:00:15.563597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.564757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6786b18-7c69-4b17-ab04-25d862ceff35 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.564757 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6786b18-7c69-4b17-ab04-25d862ceff35 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] 10.222.0.17 "POST /compute/v2.1/flavors/1197060511/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014635 Jul 30 21:00:15.564757 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Jul 30 21:00:15 2022] POST /compute/v2.1/flavors/1197060511/os-extra_specs => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:15.574325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56e78d4c-f716-4385-92e3-738dce55d83b tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.581551 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.581551 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:15.632779 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56e78d4c-f716-4385-92e3-738dce55d83b tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1197060511/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063375 Jul 30 21:00:15.633673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2/4] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Jul 30 21:00:15 2022] POST /compute/v2.1/flavors/1197060511/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:00:15.643936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6079a452-1c9b-4fd0-bdb4-d7bd0d43212b tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:15.644690 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.644690 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:15.645536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6079a452-1c9b-4fd0-bdb4-d7bd0d43212b tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b63995cd710642ab97651b02b16cd883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246567397fcd42e29113f1549d475ed0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6079a452-1c9b-4fd0-bdb4-d7bd0d43212b tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Request method failure captured: Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvb_aOt-8hlZjFOBb6W3xG3NSJRQI9RfpM7qxbVBKI5F_ONWTLd17uWf4R1jws4YgCWmw95DxSAOpBOu5UWGKa2tj3zI3AgpxzH8B0l9boXFjChLVRplCza4t7s3DfhUmx6xMXX_N6Pf1r-3U7Dl8sg-XmfgpYwIf0uLtdUJi7TeC8 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:15.647152 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/246567397fcd42e29113f1549d475ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_246567397fcd42e29113f1549d475ed0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b63995cd710642ab97651b02b16cd883 Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:15.648510 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'flavor_id': '1197060511', 'id': 'hw:numa_nodes'} Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:15.649172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.650233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6079a452-1c9b-4fd0-bdb4-d7bd0d43212b tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.651028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6079a452-1c9b-4fd0-bdb4-d7bd0d43212b tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] 10.222.0.17 "DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008511 Jul 30 21:00:15.651028 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:00:15 2022] DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:00:15.657736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2d7a079a-0b40-4216-b178-ef5bd448196b tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.684224 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2d7a079a-0b40-4216-b178-ef5bd448196b tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1197060511/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028650 Jul 30 21:00:15.687802 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3/6] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Jul 30 21:00:15 2022] POST /compute/v2.1/flavors/1197060511/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:00:15.695401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b01e246-948b-4995-a5dc-c132d865e3ba tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.697919 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.697919 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:15.699038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b01e246-948b-4995-a5dc-c132d865e3ba tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b63995cd710642ab97651b02b16cd883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246567397fcd42e29113f1549d475ed0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b01e246-948b-4995-a5dc-c132d865e3ba tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Request method failure captured: Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 22 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvb_aOt-8hlZjFOBb6W3xG3NSJRQI9RfpM7qxbVBKI5F_ONWTLd17uWf4R1jws4YgCWmw95DxSAOpBOu5UWGKa2tj3zI3AgpxzH8B0l9boXFjChLVRplCza4t7s3DfhUmx6xMXX_N6Pf1r-3U7Dl8sg-XmfgpYwIf0uLtdUJi7TeC8 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:15.700664 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/246567397fcd42e29113f1549d475ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_246567397fcd42e29113f1549d475ed0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/246567397fcd42e29113f1549d475ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 246567397fcd42e29113f1549d475ed0 Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b63995cd710642ab97651b02b16cd883 Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: {"hw:numa_nodes": "1"} Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:15.701992 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'flavor_id': '1197060511', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:15.702613 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 30 21:00:15.703752 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.704866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b01e246-948b-4995-a5dc-c132d865e3ba tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.704866 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b01e246-948b-4995-a5dc-c132d865e3ba tempest-FlavorsExtraSpecsNegativeTestJSON-550555238 tempest-FlavorsExtraSpecsNegativeTestJSON-550555238-project] 10.222.0.17 "PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010517 Jul 30 21:00:15.704866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 4/7] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Jul 30 21:00:15 2022] PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:15.713307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3089b10c-9998-434b-b886-5fdc10c3071d tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:15.714450 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.714450 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:15.721941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3089b10c-9998-434b-b886-5fdc10c3071d tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] HTTP exception thrown: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3089b10c-9998-434b-b886-5fdc10c3071d tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Request method failure captured: Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvdQcEHwBH61T3-hcdQdsopWfCcL6O2nz3hppQoL6bvRE07sZNm4JN3nsLp5rL9mRjddMRPUbA54bpokg_2gocvSHkp60si3bMUb0KMBfQh1QOJ6iFX-ENO6C8SfM9tl6uJ351AGVttj38QU00Kk9cZY_AggkPnCDdFE_WyzW9wfhM Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:00:15.723387 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89f80036653349488d845a112edad062"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89f80036653349488d845a112edad062", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 70b634c119834495994f1374e54e9c83 Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:15.724694 ncdv-master-1 devstack@n-api.service[130983]: exception: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'flavor_id': '1197060511', 'id': 'hw:cpu_thread_policy'} Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.725432 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3089b10c-9998-434b-b886-5fdc10c3071d tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Returning 404 to user: Flavor 1197060511 has no extra specs with key hw:cpu_thread_policy. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3089b10c-9998-434b-b886-5fdc10c3071d tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016966 Jul 30 21:00:15.727128 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:00:15 2022] DELETE /compute/v2.1/flavors/1197060511/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:00:15.735714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c17b3644-c24b-472c-af79-671331a88eef tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.739432 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c17b3644-c24b-472c-af79-671331a88eef tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c17b3644-c24b-472c-af79-671331a88eef tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Request method failure captured: Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 27 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdQcEHwBH61T3-hcdQdsopWfCcL6O2nz3hppQoL6bvRE07sZNm4JN3nsLp5rL9mRjddMRPUbA54bpokg_2gocvSHkp60si3bMUb0KMBfQh1QOJ6iFX-ENO6C8SfM9tl6uJ351AGVttj38QU00Kk9cZY_AggkPnCDdFE_WyzW9wfhM Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:15.741047 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89f80036653349488d845a112edad062"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89f80036653349488d845a112edad062", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 70b634c119834495994f1374e54e9c83 Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: {"hw:cpu_policy": "shared"} Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:15.742339 ncdv-master-1 devstack@n-api.service[130984]: exception: Request body and URI mismatch Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'flavor_id': '1197060511', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.743104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c17b3644-c24b-472c-af79-671331a88eef tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.744327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c17b3644-c24b-472c-af79-671331a88eef tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011423 Jul 30 21:00:15.748230 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 5/9] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Jul 30 21:00:15 2022] PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:15.753654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2425e09-8850-43a9-953e-e40fbab31cc8 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2425e09-8850-43a9-953e-e40fbab31cc8 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Request method failure captured: Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 49 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvdQcEHwBH61T3-hcdQdsopWfCcL6O2nz3hppQoL6bvRE07sZNm4JN3nsLp5rL9mRjddMRPUbA54bpokg_2gocvSHkp60si3bMUb0KMBfQh1QOJ6iFX-ENO6C8SfM9tl6uJ351AGVttj38QU00Kk9cZY_AggkPnCDdFE_WyzW9wfhM Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:00:15.764085 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89f80036653349488d845a112edad062"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89f80036653349488d845a112edad062", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f80036653349488d845a112edad062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 89f80036653349488d845a112edad062 Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 70b634c119834495994f1374e54e9c83 Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 30 21:00:15.765120 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'flavor_id': '1197060511', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance: Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 30 21:00:15.765714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.767657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2425e09-8850-43a9-953e-e40fbab31cc8 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2425e09-8850-43a9-953e-e40fbab31cc8 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.015841 Jul 30 21:00:15.769372 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 5/10] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Jul 30 21:00:15 2022] PUT /compute/v2.1/flavors/1197060511/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:00:15.776050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2a72e69-4014-439c-9834-70e560fbfae7 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:15.776880 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:15.776880 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:15.811765 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2a72e69-4014-439c-9834-70e560fbfae7 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1197060511" status: 202 len: 0 microversion: 2.1 time: 0.039454 Jul 30 21:00:15.812442 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:15 2022] DELETE /compute/v2.1/flavors/1197060511 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:15.824679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6381da94-9356-4f58-9bbb-bc12f3fce06c tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:15.856017 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6381da94-9356-4f58-9bbb-bc12f3fce06c tempest-FlavorsExtraSpecsNegativeTestJSON-977987717 tempest-FlavorsExtraSpecsNegativeTestJSON-977987717-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038043 Jul 30 21:00:15.857070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:16.976430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Calling method '.version_select at 0x7fbb5f8c0430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:16.978802 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:16.978802 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:16.989987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:16.992684 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:16.992684 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:16.994515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:16.996471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130984) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 30 21:00:16.997128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:16.998509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:16.999428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:16.999669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.011931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.048688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.049727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.066976 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-36f4155b-e985-42a1-9674-3a6d1d74956f tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.552714 Jul 30 21:00:17.068004 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:00:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:17.072141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.073398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.083070 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2ad6abe-85b7-46b3-af10-92f3569c9d3b tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.574616 Jul 30 21:00:17.083789 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:17.250852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9d94bd1-bbe9-4cee-aaf0-58b94ee13dea tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1913376233", "id": 2108031441, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.270930 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.270930 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:17.292992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9d94bd1-bbe9-4cee-aaf0-58b94ee13dea tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.223841 Jul 30 21:00:17.293578 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 8/15] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/flavors => generated 471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:00:17.335332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ed36b93-6487-4ae4-a59c-e14372fc4bf4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1007020850", "id": 36262159, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.338499 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.338499 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.354339 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ed36b93-6487-4ae4-a59c-e14372fc4bf4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.269379 Jul 30 21:00:17.355154 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 8/16] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/flavors => generated 424 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:17.359652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b51e138d-9f58-4c7a-9563-9bf796a9f407 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1083914865"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.362479 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.362479 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.364839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-b51e138d-9f58-4c7a-9563-9bf796a9f407 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid eb021741-1e71-4672-ac42-efaa04e2468a for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:17.369883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Calling method '.version_select at 0x7fbb5f96faf0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:17.372577 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.372577 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:17.381953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130983) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 30 21:00:17.383950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.384647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.412484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.412949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.431365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.432058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.437204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b51e138d-9f58-4c7a-9563-9bf796a9f407 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079787 Jul 30 21:00:17.438672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 9/17] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:17.440811 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4a720816-4c45-420d-a567-db72d50000e3 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.135979 Jul 30 21:00:17.441848 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 9/18] 10.222.0.17 () {60 vars in 1208 bytes} [Sat Jul 30 21:00:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:00:17.451777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Calling method '.version_select at 0x7fbb5efd7f70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:17.452591 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.452591 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.453751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.454222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.480419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.480831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.500593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '.version_select at 0x7fbb5f7da430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:17.501410 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.501410 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:17.502580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.503040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.520152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.520590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.531984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.532686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.539683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.539892 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8c306ee-76a7-4906-b3da-4a2420b48267 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.096869 Jul 30 21:00:17.540167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:17.551403 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:00:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:17.551567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9ce3d2c9-b188-4f85-a0ba-cad2d27d7a7c tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.107731 Jul 30 21:00:17.551567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Jul 30 21:00:17 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 104 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:17.553174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06f7d09e-7a3a-431b-8874-ba169df9e1b7 tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.556242 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.556242 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.605684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-556141223", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.749125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06f7d09e-7a3a-431b-8874-ba169df9e1b7 tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/2108031441/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.199174 Jul 30 21:00:17.750177 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 11/21] 10.222.0.17 () {62 vars in 1265 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/flavors/2108031441/os-extra_specs => generated 62 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:17.759941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce23871b-9efa-493d-89b7-6ec73b12ff45 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:17.760753 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.760753 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.779452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce23871b-9efa-493d-89b7-6ec73b12ff45 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/36262159" status: 202 len: 0 microversion: 2.1 time: 0.027375 Jul 30 21:00:17.780049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 12/22] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:00:17 2022] DELETE /compute/v2.1/flavors/36262159 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:17.786097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6c708246-5ed3-4706-b253-cec923323652 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:17.791013 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:17.791013 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:17.799837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c708246-5ed3-4706-b253-cec923323652 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:17.800203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c708246-5ed3-4706-b253-cec923323652 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.093398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:00:18.230400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6c708246-5ed3-4706-b253-cec923323652 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.446157 Jul 30 21:00:18.238022 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 13/23] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.245004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Calling method '.version_select at 0x7fbb5df1adc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.246487 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.246487 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.248064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.248718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.262762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.263485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.274485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.275193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.281422 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-715ba757-a458-4116-8397-cb40db4c495e tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040384 Jul 30 21:00:18.282527 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 14/24] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.291812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e35352c-038f-4cf0-a281-8c7efd09675a tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.292685 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.292685 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.311711 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e35352c-038f-4cf0-a281-8c7efd09675a tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2108031441" status: 202 len: 0 microversion: 2.86 time: 0.027878 Jul 30 21:00:18.312309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 15/25] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Jul 30 21:00:18 2022] DELETE /compute/v2.1/flavors/2108031441 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:00:18.316608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cbe7729a-45fe-4b11-816f-1d6f282ee94b tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.347354 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cbe7729a-45fe-4b11-816f-1d6f282ee94b tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033977 Jul 30 21:00:18.355329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 16/26] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:18.355329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.355555 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.355555 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.364284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.364744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.393747 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 39 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:18.418034 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: {"add_host": {"host": "nch1-master-1"}} Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:18.419121 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate 1 already has host nch1-master-1. Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch1-master-1'}}} Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:00:18.420046 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi session.flush() Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:00:18.421470 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 21:00:18.422830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:00:18.424469 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 30, 21, 0, 18, 380138), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 1}] Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:18.425902 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch1-master-1. Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.427271 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch1-master-1. Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:18.431793 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch1-master-1. Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6da22636-6259-4051-a1e1-12fca1a68dc5 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.070399 Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 17/27] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Calling method '.version_select at 0x7fbb5dc26700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.433317 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.433843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.433843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.434415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:00:18.434864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:00:18.435388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:00:18.435869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:00:18.436307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:00:18.441671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.442370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.449190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3be58e89-de28-41a2-88ce-85768304aa94 tempest-HypervisorAdminUnderV252Test-1299615812 tempest-HypervisorAdminUnderV252Test-1299615812-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.027991 Jul 30 21:00:18.449771 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 18/28] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.451129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.451632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.452445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.452889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.459980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a826293-625b-4d58-acaa-4b80a2d1d707 tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.488943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Getting quotas for project 6e222c39108c4ab787d3576d5215aeea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:00:18.492329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a826293-625b-4d58-acaa-4b80a2d1d707 tempest-FlavorMetadataValidation-947769783 tempest-FlavorMetadataValidation-947769783-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.041052 Jul 30 21:00:18.493420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 19/29] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:00:18.499923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Getting quotas for user 93ee771e50474e268eae2fed07e43fe7 and project 6e222c39108c4ab787d3576d5215aeea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:00:18.511092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71beeae5-42b6-4199-82db-08ba84781255 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-245361719", "id": 1716584126, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.514928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:00:18.518016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:00:18.532119 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.532119 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.550971 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71beeae5-42b6-4199-82db-08ba84781255 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.056428 Jul 30 21:00:18.551598 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 20/30] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/flavors => generated 416 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.562640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c1d27ee-afa6-4522-ae6f-44b638013958 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.565174 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.565174 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.584747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1d27ee-afa6-4522-ae6f-44b638013958 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:18.585220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1d27ee-afa6-4522-ae6f-44b638013958 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:18.607009 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d749f2a3-bf14-4445-9c24-c7495ce22e7a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064881 Jul 30 21:00:18.608609 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 11/31] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:00:18.614372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5544f0ef-b01a-4717-a345-99d96d01f7ea tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.643467 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5544f0ef-b01a-4717-a345-99d96d01f7ea tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.033206 Jul 30 21:00:18.656098 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 12/32] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:18.662299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f00c0830-3ef9-4f84-9f3f-292471b513da tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.663279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f00c0830-3ef9-4f84-9f3f-292471b513da tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:18.783852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f00c0830-3ef9-4f84-9f3f-292471b513da tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:18.806845 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f00c0830-3ef9-4f84-9f3f-292471b513da tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1219 microversion: 2.1 time: 0.148955 Jul 30 21:00:18.807478 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 13/33] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:18.812241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2fca4ff6-d4f4-42a0-8ec4-5f066ea24674 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.813340 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.813340 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:18.846578 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c1d27ee-afa6-4522-ae6f-44b638013958 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.293424 Jul 30 21:00:18.848639 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 21/34] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.860133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2fca4ff6-d4f4-42a0-8ec4-5f066ea24674 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1716584126" status: 202 len: 0 microversion: 2.1 time: 0.051408 Jul 30 21:00:18.860908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 14/35] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:18 2022] DELETE /compute/v2.1/flavors/1716584126 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:18.862764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a8da1e59-6547-4ec5-b4ed-b98d9a670567 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.863574 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.863574 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.871972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aca5babd-563d-4d9b-acff-d00462ac4555 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:18.898718 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a8da1e59-6547-4ec5-b4ed-b98d9a670567 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.042048 Jul 30 21:00:18.899439 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 22/36] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:18 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 30 21:00:18.901786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aca5babd-563d-4d9b-acff-d00462ac4555 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036675 Jul 30 21:00:18.902370 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 15/37] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:18.913827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-84abdf80-df02-435d-8773-1541358f22fb tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-515171747"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.915139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62aaa2c7-765e-4a92-a689-93c65e7ac05f tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1937437044", "name": "tempest-test_aggregate-920436925"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.917528 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.917528 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:18.919407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-84abdf80-df02-435d-8773-1541358f22fb tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid da4de9e7-c6b7-4a78-a1e1-57e097ec451d for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:18.930639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:18.938526 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.938526 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:18.940034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.aggregate [None req-62aaa2c7-765e-4a92-a689-93c65e7ac05f tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid 4d1ff976-1b50-4335-895a-f97b9d8eca86 for aggregate {{(pid=130983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:18.954565 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-84abdf80-df02-435d-8773-1541358f22fb tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045087 Jul 30 21:00:18.962955 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 23/38] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:18.969065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-84ccb9b2-5f15-45d0-a8a2-ab6074ad7705 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1163381994", "id": 1897699304, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:18.975759 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:18.975759 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.000847 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-84ccb9b2-5f15-45d0-a8a2-ab6074ad7705 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.036482 Jul 30 21:00:19.001942 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 24/39] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/flavors => generated 429 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.036802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-62aaa2c7-765e-4a92-a689-93c65e7ac05f tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.124586 Jul 30 21:00:19.038902 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 16/40] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 30 21:00:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.051904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-487c14c9-c725-4297-9a47-511c8f2b6d88 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.053104 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.053104 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:19.078065 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-487c14c9-c725-4297-9a47-511c8f2b6d88 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1897699304" status: 202 len: 0 microversion: 2.1 time: 0.034947 Jul 30 21:00:19.079833 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 17/41] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:19 2022] DELETE /compute/v2.1/flavors/1897699304 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:19.091113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da7fb617-9a03-42c7-8bd9-85b401cc76aa tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.092015 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.092015 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:19.107963 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da7fb617-9a03-42c7-8bd9-85b401cc76aa tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.023417 Jul 30 21:00:19.116753 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 18/42] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:00:19 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.122778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d361e0a-3983-4215-84ab-be58ab93d980 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.144993 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d361e0a-3983-4215-84ab-be58ab93d980 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026003 Jul 30 21:00:19.145897 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 19/43] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:19.162475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8993f9a8-0aa6-4470-8574-de68848d2bfc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.166579 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.166579 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:19.176132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8993f9a8-0aa6-4470-8574-de68848d2bfc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:19.176596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8993f9a8-0aa6-4470-8574-de68848d2bfc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:19.191167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4,nova_api:DELETE=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:19.359839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ce0c28e-7605-40cc-9143-e485d06e74ff tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.362818 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.362818 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.365102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ce0c28e-7605-40cc-9143-e485d06e74ff tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ce0c28e-7605-40cc-9143-e485d06e74ff tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 39 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:19.374125 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: {"add_host": {"host": "nch1-master-1"}} Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:19.375313 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch1-master-1'}}} Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:19.375993 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 30 21:00:19.376942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.377859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ce0c28e-7605-40cc-9143-e485d06e74ff tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:19.377859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ce0c28e-7605-40cc-9143-e485d06e74ff tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.372687 Jul 30 21:00:19.377859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 25/44] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 375 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:19.395408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8dfad854-e8dc-41aa-9ab7-ce98365976d7 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2123010721", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.448507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8dfad854-e8dc-41aa-9ab7-ce98365976d7 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.060747 Jul 30 21:00:19.449404 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 26/45] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.454683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f18c4b7-0d3a-4c5e-a0ba-a1aca896a55a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.455995 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.455995 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.501241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f18c4b7-0d3a-4c5e-a0ba-a1aca896a55a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.050453 Jul 30 21:00:19.512554 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 27/46] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:19 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:00:19.522300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-673769fa-eb71-46d5-9fc5-678b6d23df7a tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.524748 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.524748 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.553130 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-673769fa-eb71-46d5-9fc5-678b6d23df7a tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/ff95455f-9984-44ad-b6a7-dd299d885982" status: 202 len: 0 microversion: 2.1 time: 0.038102 Jul 30 21:00:19.553982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 28/47] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:00:19 2022] DELETE /compute/v2.1/flavors/ff95455f-9984-44ad-b6a7-dd299d885982 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:19.561007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0da724c4-a675-4382-bab0-3ebf74327ac4 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1111683564"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.565150 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.565150 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.566494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-0da724c4-a675-4382-bab0-3ebf74327ac4 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid 3dda6d2d-19c6-487a-8c16-67fc31db9f9b for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:19.607529 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0da724c4-a675-4382-bab0-3ebf74327ac4 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050829 Jul 30 21:00:19.610490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 29/48] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.618636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49e5dece-a019-4a5d-a479-e04c56f588b7 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.663361 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49e5dece-a019-4a5d-a479-e04c56f588b7 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050798 Jul 30 21:00:19.664911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 30/49] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:19.671964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-195100384"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.675501 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.675501 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.691796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:19.692437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:19.706259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:19.707093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:19.717813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-195100384 could not be found. Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 57 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:19.720847 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: {"add_host": {"host": "tempest-nonexist_host-195100384"}} Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:19.721927 ncdv-master-1 devstack@n-api.service[130984]: exception: Compute host tempest-nonexist_host-195100384 could not be found. Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-195100384'}}} Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-195100384' is not mapped to any cell Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.722574 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Jul 30 21:00:19.724713 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-195100384 could not be found. Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-195100384 could not be found. Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.725687 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-195100384 could not be found. Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-195100384 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce5f52a9-68ac-4834-a073-31b45616aa3d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.056061 Jul 30 21:00:19.727811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 31/50] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:19.728492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-65c85b0f-efff-4efa-9ad4-3e4bc1a65c7e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1932318369", "id": "356962d1-7636-459a-b6d2-61a48a66b488", "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.733156 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.733156 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.776602 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-65c85b0f-efff-4efa-9ad4-3e4bc1a65c7e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.052253 Jul 30 21:00:19.785467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 32/51] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.795228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bcd39748-621b-4d4a-a5b3-402b2905b500 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.796023 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.796023 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.852802 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bcd39748-621b-4d4a-a5b3-402b2905b500 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.064924 Jul 30 21:00:19.853398 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 33/52] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:19 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:00:19.869047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa420630-17ce-4435-80ab-448ea0e28f89 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.869867 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:19.869867 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:19.907694 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa420630-17ce-4435-80ab-448ea0e28f89 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/356962d1-7636-459a-b6d2-61a48a66b488" status: 202 len: 0 microversion: 2.1 time: 0.050816 Jul 30 21:00:19.912881 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 34/53] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:00:19 2022] DELETE /compute/v2.1/flavors/356962d1-7636-459a-b6d2-61a48a66b488 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:19.925009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-010fa6b0-d891-4f73-b6af-64b75c01eff0 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:19.926193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-010fa6b0-d891-4f73-b6af-64b75c01eff0 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:19.940274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8993f9a8-0aa6-4470-8574-de68848d2bfc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.793010 Jul 30 21:00:19.956833 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 20/54] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:19.964735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c833ab3-64e7-435c-baa8-dcc843afbde9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c833ab3-64e7-435c-baa8-dcc843afbde9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 283 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:00:19.971934 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:00:19.973406 ncdv-master-1 devstack@n-api.service[130983]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:00:19.974090 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:00:19.974883 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:00:19.977522 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:00:19.978409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:00:19.978409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:19.980694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c833ab3-64e7-435c-baa8-dcc843afbde9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:19.982178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c833ab3-64e7-435c-baa8-dcc843afbde9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.023358 Jul 30 21:00:19.983440 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 21/55] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 30 21:00:19 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:00:19.992391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6019a900-526f-47df-b529-c473d3a28b05 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:20.027102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6019a900-526f-47df-b529-c473d3a28b05 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041143 Jul 30 21:00:20.039321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 22/56] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:20.043021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f26a4829-3e43-4227-92c6-348ff3612976 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f26a4829-3e43-4227-92c6-348ff3612976 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 27 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:00:20.048136 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: {"aggregate": {"name": ""}} Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:20.049746 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '' Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:20.050682 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:00:20.052257 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.056274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f26a4829-3e43-4227-92c6-348ff3612976 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:20.058739 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f26a4829-3e43-4227-92c6-348ff3612976 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.026057 Jul 30 21:00:20.059341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 23/57] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:00:20.070476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca450601-5e96-483b-bdf1-ef731dec2f1f tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1795442208", "id": 1047587, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:20.080595 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:20.080595 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:20.118291 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca450601-5e96-483b-bdf1-ef731dec2f1f tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.1 time: 0.057007 Jul 30 21:00:20.120538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 24/58] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:20.128554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9b27d3a-809a-4270-8c75-d68dbec2cd34 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1437083401"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:20.134929 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:20.134929 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:20.138287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b9b27d3a-809a-4270-8c75-d68dbec2cd34 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9b27d3a-809a-4270-8c75-d68dbec2cd34 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 60 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:00:20.143093 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: {"aggregate": {"name": "tempest-test_aggregate-1437083401"}} Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:20.144235 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1437083401'}}} Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:20.144882 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:20.145818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 30 21:00:20.146888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:20.153077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9b27d3a-809a-4270-8c75-d68dbec2cd34 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:20.155168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b9b27d3a-809a-4270-8c75-d68dbec2cd34 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032087 Jul 30 21:00:20.156432 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 25/59] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:20.161302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27f63257-80a6-487a-b8d9-4694afb9a725 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:20.171889 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27f63257-80a6-487a-b8d9-4694afb9a725 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1047587" status: 200 len: 405 microversion: 2.1 time: 0.014041 Jul 30 21:00:20.173165 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 26/60] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:00:20 2022] GET /compute/v2.1/flavors/1047587 => generated 405 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:20.177853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf132a45-c10d-460e-b580-ebe67c81ac18 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1811153030"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:20.181982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.aggregate [None req-bf132a45-c10d-460e-b580-ebe67c81ac18 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid 5d453396-762c-45fb-b811-8de6fdf452db for aggregate {{(pid=130983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:20.233988 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf132a45-c10d-460e-b580-ebe67c81ac18 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059314 Jul 30 21:00:20.235454 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 27/61] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:20.722911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2064db3-9e79-4dc9-a423-472dfae35d73 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:20.764674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2064db3-9e79-4dc9-a423-472dfae35d73 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5386 microversion: 2.1 time: 0.527774 Jul 30 21:00:20.765566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 28/62] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:20 2022] GET /compute/v2.1/flavors/detail => generated 5386 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:20.954688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-010fa6b0-d891-4f73-b6af-64b75c01eff0 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:20.979776 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-010fa6b0-d891-4f73-b6af-64b75c01eff0 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1219 microversion: 2.1 time: 1.064485 Jul 30 21:00:20.980616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 35/63] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:19 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1219 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:20.988939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1811153030"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.000750 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.000750 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.003411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid dd9bb9a1-84da-45b2-8b91-a3c76e30ad95 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:21.014569 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1811153030 already exists. Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 60 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:21.017125 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: {"aggregate": {"name": "tempest-test_aggregate-1811153030"}} Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.018240 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate tempest-test_aggregate-1811153030 already exists. Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1811153030'}}} Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 30 21:00:21.018907 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1811153030 already exists. Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:21.019852 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1811153030 already exists. Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1811153030 already exists. Jul 30 21:00:21.020830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.026100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1811153030 already exists. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.027316 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0a6895a-c35d-4e93-be81-8ae24722d582 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.045192 Jul 30 21:00:21.027852 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 36/64] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:00:21.033312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35ea947c-1c8e-4e8e-a5bd-c1641e56af77 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.034296 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.034296 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.054989 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35ea947c-1c8e-4e8e-a5bd-c1641e56af77 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1047587" status: 202 len: 0 microversion: 2.1 time: 0.025107 Jul 30 21:00:21.056567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 37/65] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/flavors/1047587 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:21.064082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d807c9e-0936-48a1-bf65-a38c91b87de9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.065297 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.065297 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.096849 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d807c9e-0936-48a1-bf65-a38c91b87de9 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.038271 Jul 30 21:00:21.098885 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 38/66] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:00:21.110170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-588ef92b-d187-444e-a3bb-5d5730e2730e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.139689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-588ef92b-d187-444e-a3bb-5d5730e2730e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035787 Jul 30 21:00:21.141087 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 39/67] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:21.146436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba67cbf6-f6fe-4ae2-8aba-81f2f7da6771 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1782145427"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.149361 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.149361 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.150427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-ba67cbf6-f6fe-4ae2-8aba-81f2f7da6771 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid 8e34bcf1-0969-4e47-8255-9145cc9640f1 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:21.201538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-348435568", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "availability_zone": "tempest-test_az-1937437044"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.208991 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba67cbf6-f6fe-4ae2-8aba-81f2f7da6771 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064323 Jul 30 21:00:21.209710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 40/68] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.223162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:21.224206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:21.230218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f93938d-3fa3-4548-b554-91e1e74b71bd tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1951529018", "id": 1587146211, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.231637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:21.234057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:21.239076 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.239076 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.267750 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f93938d-3fa3-4548-b554-91e1e74b71bd tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.047324 Jul 30 21:00:21.275517 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 41/69] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.280928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25786ee2-4bfa-4cf7-8e96-e40cb8d86a8e tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.282187 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.282187 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.283915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-25786ee2-4bfa-4cf7-8e96-e40cb8d86a8e tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25786ee2-4bfa-4cf7-8e96-e40cb8d86a8e tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:21.286208 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 30 21:00:21.287360 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6'} Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:21.288004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 30 21:00:21.289016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.291177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25786ee2-4bfa-4cf7-8e96-e40cb8d86a8e tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.292434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25786ee2-4bfa-4cf7-8e96-e40cb8d86a8e tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.015794 Jul 30 21:00:21.297171 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 42/70] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:21.303497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e4e5160-9799-4cd8-a472-e48cb34410b6 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "1587146211"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.324269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:00:21.329378 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3e4e5160-9799-4cd8-a472-e48cb34410b6 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] HTTP exception thrown: Flavor 1587146211 could not be found. Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e4e5160-9799-4cd8-a472-e48cb34410b6 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Request method failure captured: Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 107 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvenn7Za9gBQ2UsDDtmsYOdXwFNwP8TQRWL4SlzoFCGksOTfEIEWCXEgqvueCVYSrhd31QfJ5fYRZegxXKpmYKSK-teRvn6gIDIhjdi2a-1hO6VNNj79Itk5kWtxg5TBC2-N5puxY_ck0iR8nQy_2GBqRJq3cGEghS0P2r63Ebqr2M Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 90b1500a858541a9b3ff58c218737af4 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsAdminTestJSON-1268806434 Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:21.333841 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90b1500a858541a9b3ff58c218737af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90b1500a858541a9b3ff58c218737af4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90b1500a858541a9b3ff58c218737af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90b1500a858541a9b3ff58c218737af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsAdminTestJSON-1268806434 Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 90b1500a858541a9b3ff58c218737af4 Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1268806434 Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsAdminTestJSON-1268806434-project Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 00ba1ceba6654cbd8cd4b48615f20759 Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsAdminTestJSON-1268806434-project Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "test", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "1587146211"}} Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.334955 ncdv-master-1 devstack@n-api.service[130984]: exception: Flavor 1587146211 could not be found. Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '1587146211'}}} Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1587146211 could not be found. Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.335732 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1587146211 could not be found. Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.336827 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1587146211 could not be found. Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e4e5160-9799-4cd8-a472-e48cb34410b6 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Returning 400 to user: Flavor 1587146211 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.339567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e4e5160-9799-4cd8-a472-e48cb34410b6 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.037000 Jul 30 21:00:21.340448 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 43/71] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/servers => generated 81 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:21.345223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be8d815a-61e1-4090-8d58-9d3c7afbe0af tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.373907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be8d815a-61e1-4090-8d58-9d3c7afbe0af tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.032863 Jul 30 21:00:21.374797 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 44/72] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:00:21.382180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a11385a0-7bfe-40e6-9c38-46ec7698b53a tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.383923 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.383923 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.407655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a11385a0-7bfe-40e6-9c38-46ec7698b53a tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1587146211" status: 202 len: 0 microversion: 2.1 time: 0.031171 Jul 30 21:00:21.415061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 45/73] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/flavors/1587146211 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:21.426905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ecf69d6-5e20-43e8-918f-63df7652f647 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.430002 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.430002 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.465245 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-7ecf69d6-5e20-43e8-918f-63df7652f647 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ecf69d6-5e20-43e8-918f-63df7652f647 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:21.467620 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate -1 could not be found. Jul 30 21:00:21.468938 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '-1'} Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:00:21.469597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.470669 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 30 21:00:21.471912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.474531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ecf69d6-5e20-43e8-918f-63df7652f647 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.475821 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ecf69d6-5e20-43e8-918f-63df7652f647 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.059160 Jul 30 21:00:21.477437 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 46/74] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:00:21.486020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7980fd08-530c-4903-870e-a26bc8b7c1ce tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.513833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7980fd08-530c-4903-870e-a26bc8b7c1ce tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034741 Jul 30 21:00:21.514674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 47/75] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:21.536805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-54460365-7bba-4a64-948a-8a816bf4c93a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1219141293"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.540719 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.540719 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.541708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-54460365-7bba-4a64-948a-8a816bf4c93a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid eeafe8f0-008b-43b5-8890-48bad39f5273 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:00:21.575329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-54460365-7bba-4a64-948a-8a816bf4c93a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057203 Jul 30 21:00:21.583415 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 48/76] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.589389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4732ed03-aa0e-45de-b79b-f927945da053 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1268339307", "id": 81307987, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.592727 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.592727 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.598305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=8,nova_api:DELETE=20 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:21.616307 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4732ed03-aa0e-45de-b79b-f927945da053 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.035705 Jul 30 21:00:21.619090 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 49/77] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.630760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a552b2b0-fe68-48bd-9edf-0ffb4854fa13 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.631597 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.631597 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a552b2b0-fe68-48bd-9edf-0ffb4854fa13 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a552b2b0-fe68-48bd-9edf-0ffb4854fa13 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:21.635709 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 30 21:00:21.640296 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7'} Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:21.641307 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.642458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a552b2b0-fe68-48bd-9edf-0ffb4854fa13 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.643915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a552b2b0-fe68-48bd-9edf-0ffb4854fa13 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.015489 Jul 30 21:00:21.643915 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 50/78] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:21.643915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40c1e17f-0690-49bc-aa86-5043df26a38d tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-944069066", "id": 1877815802, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:21.664879 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40c1e17f-0690-49bc-aa86-5043df26a38d tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.026664 Jul 30 21:00:21.665480 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 51/79] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:21 2022] POST /compute/v2.1/flavors => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.670186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89b698f5-07be-42aa-a633-6655a2045f7d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.670950 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.670950 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.706059 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89b698f5-07be-42aa-a633-6655a2045f7d tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.039437 Jul 30 21:00:21.707125 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 52/80] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:00:21.713259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a142db37-510f-4bd8-9510-b0391cd2be25 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.736238 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a142db37-510f-4bd8-9510-b0391cd2be25 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 412 microversion: 2.1 time: 0.027672 Jul 30 21:00:21.737110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 53/81] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 412 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.741991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5197b902-599d-4296-bd78-1e5fc5c5031a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.742786 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.742786 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.749624 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5197b902-599d-4296-bd78-1e5fc5c5031a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5197b902-599d-4296-bd78-1e5fc5c5031a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:00:21.751189 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate -1 could not be found. Jul 30 21:00:21.752563 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '-1'} Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.753297 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 30 21:00:21.754428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.755335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5197b902-599d-4296-bd78-1e5fc5c5031a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.755335 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5197b902-599d-4296-bd78-1e5fc5c5031a tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.014477 Jul 30 21:00:21.755335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 54/82] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:00:21.758067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61b0d048-6306-4c74-8c69-62717422fbbc tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.769906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61b0d048-6306-4c74-8c69-62717422fbbc tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 412 microversion: 2.1 time: 0.015701 Jul 30 21:00:21.770792 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 55/83] 10.222.0.17 () {58 vars in 1177 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 412 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.775878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ba79cb0-73ca-43f4-8614-625f36456cd8 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.776647 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:21.776647 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:21.777506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ba79cb0-73ca-43f4-8614-625f36456cd8 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ba79cb0-73ca-43f4-8614-625f36456cd8 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:21.779251 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 30 21:00:21.780449 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:21.781052 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:21.782080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ba79cb0-73ca-43f4-8614-625f36456cd8 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:21.784298 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ba79cb0-73ca-43f4-8614-625f36456cd8 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009103 Jul 30 21:00:21.784606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 56/84] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:21.789610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7709b7f-c35b-4192-ba70-e392310c8757 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.800700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7709b7f-c35b-4192-ba70-e392310c8757 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 412 microversion: 2.1 time: 0.014873 Jul 30 21:00:21.801280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 57/85] 10.222.0.17 () {58 vars in 1171 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 412 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:21.812932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95fc6a53-d1bf-433e-889e-f42b92bf878d tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.819768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:00:21.820218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:00:21.820715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:00:21.821611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:00:21.822089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:00:21.828317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95fc6a53-d1bf-433e-889e-f42b92bf878d tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 412 microversion: 2.1 time: 0.018855 Jul 30 21:00:21.828898 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 58/86] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 412 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:00:21.835217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:21.837173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:21.839096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:21.841928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45d8ae29-864d-4240-8fc3-efbb4dd7e825 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.843955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:21.863386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45d8ae29-864d-4240-8fc3-efbb4dd7e825 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.025084 Jul 30 21:00:21.864632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 59/87] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:21.872439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Getting quotas for project e80c1509c60d46bda7b1c4793260ab40. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:00:21.876555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Getting quotas for user f724ca9bef02478da3b1696b379dc027 and project e80c1509c60d46bda7b1c4793260ab40. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:00:21.881899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bca8dec1-2f52-4247-abae-6a06132197be tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.908495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bca8dec1-2f52-4247-abae-6a06132197be tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.030257 Jul 30 21:00:21.908789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:00:21.909790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 60/88] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:21.911603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:00:21.928380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab653712-57ab-49ea-b75d-5217d9a2dec9 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.954869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ab653712-57ab-49ea-b75d-5217d9a2dec9 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.031135 Jul 30 21:00:21.968290 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 61/89] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:21.973349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb1feb12-673b-4d57-90b1-4c10210d3274 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.979251 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51dbc4e8-6a32-491c-8752-ff8d0622fd11 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212148 Jul 30 21:00:21.987507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 29/90] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:00:21.992673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-477197c3-26b5-48b1-86de-70b5906b1ece tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:21.993318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-477197c3-26b5-48b1-86de-70b5906b1ece tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:22.016825 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb1feb12-673b-4d57-90b1-4c10210d3274 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.046949 Jul 30 21:00:22.027955 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 62/91] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.035028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.035881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:22.046133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:22.046133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:22.046133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:22.046133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:22.253839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-477197c3-26b5-48b1-86de-70b5906b1ece tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:22.264814 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-477197c3-26b5-48b1-86de-70b5906b1ece tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1242 microversion: 2.1 time: 0.275940 Jul 30 21:00:22.279314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 30/92] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:21 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1242 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:22.283561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-579dfc48-f3d7-40bb-8b24-1caf8555d2b4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.284566 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:22.284566 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:22.331106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-579dfc48-f3d7-40bb-8b24-1caf8555d2b4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1877815802" status: 202 len: 0 microversion: 2.1 time: 0.060863 Jul 30 21:00:22.336610 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 31/93] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:22 2022] DELETE /compute/v2.1/flavors/1877815802 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:22.343712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-357f14d1-1269-49af-ab66-2c15345d90c4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.357542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:22.380705 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-357f14d1-1269-49af-ab66-2c15345d90c4 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042777 Jul 30 21:00:22.381780 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 32/94] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.381911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9494ca00-cd10-432a-b1f9-d6e3eb2e599a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1277 microversion: 2.1 time: 0.349936 Jul 30 21:00:22.382534 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 63/95] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1277 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.400953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-450eec0d-995d-4d7a-870a-780292a0debb tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.429268 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-450eec0d-995d-4d7a-870a-780292a0debb tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/81307987" status: 202 len: 0 microversion: 2.1 time: 0.032673 Jul 30 21:00:22.430868 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 33/96] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:00:22 2022] DELETE /compute/v2.1/flavors/81307987 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:22.438938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8c436af-666f-4de2-b43e-7bfcbb31d921 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.470671 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8c436af-666f-4de2-b43e-7bfcbb31d921 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035418 Jul 30 21:00:22.471653 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 64/97] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.497532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90941575-9919-43c6-84d1-2741ff897966 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-254781818", "id": 1469600659, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:22.500714 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:22.500714 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:22.525362 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90941575-9919-43c6-84d1-2741ff897966 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032452 Jul 30 21:00:22.530427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 65/98] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:22 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:22.544580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81b4e90f-62e6-41ad-aa97-cdc2a5c59b25 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.575486 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81b4e90f-62e6-41ad-aa97-cdc2a5c59b25 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034344 Jul 30 21:00:22.576717 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 66/99] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.599823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6dd235df-8411-4ed4-9470-1cdb05678d51 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.646751 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6dd235df-8411-4ed4-9470-1cdb05678d51 tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054715 Jul 30 21:00:22.647722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 67/100] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.668459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33726c3c-5812-4f4d-a583-527b767a753c tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.669456 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:22.669456 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:22.698993 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33726c3c-5812-4f4d-a583-527b767a753c tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1469600659" status: 202 len: 0 microversion: 2.1 time: 0.035036 Jul 30 21:00:22.700595 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 68/101] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:22 2022] DELETE /compute/v2.1/flavors/1469600659 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:00:22.733263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-afc5d198-e5e2-4ebe-a6cd-a04e1fdd7330 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.806945 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-afc5d198-e5e2-4ebe-a6cd-a04e1fdd7330 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098976 Jul 30 21:00:22.820185 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 69/102] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:22.838230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-309ae1cf-1fbd-4954-9b97-1c9f0090a116 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1609575497", "id": 1722398099, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:22.896320 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-309ae1cf-1fbd-4954-9b97-1c9f0090a116 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.058982 Jul 30 21:00:22.904925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 70/103] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:22 2022] POST /compute/v2.1/flavors => generated 414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:00:22.910943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52a12d04-2628-447b-9674-c6f042fb13fa tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:22.995031 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52a12d04-2628-447b-9674-c6f042fb13fa tempest-FlavorsAdminTestJSON-1268806434 tempest-FlavorsAdminTestJSON-1268806434-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.088159 Jul 30 21:00:23.004761 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 71/104] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:23.028739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81c32ce7-6e8e-4c50-82ec-8da82e522a8e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.086923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81c32ce7-6e8e-4c50-82ec-8da82e522a8e tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1722398099" status: 202 len: 0 microversion: 2.1 time: 0.063348 Jul 30 21:00:23.087578 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 72/105] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:00:23 2022] DELETE /compute/v2.1/flavors/1722398099 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:00:23.111847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4307e364-c8a9-4490-a7df-dc29b3e313a3 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.177194 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4307e364-c8a9-4490-a7df-dc29b3e313a3 tempest-FlavorsAdminTestJSON-1828727593 tempest-FlavorsAdminTestJSON-1828727593-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081533 Jul 30 21:00:23.177804 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 73/106] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:00:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:23.226788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49863581-6b7c-46fa-9dc4-8a465ee63b10 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.227637 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:23.227637 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:00:23.230679 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-49863581-6b7c-46fa-9dc4-8a465ee63b10 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49863581-6b7c-46fa-9dc4-8a465ee63b10 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin] Request method failure captured: Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvmnDtL0Ef6F11Gbx1K60uZZu172GykEsp3TizTpge4oigw2Pzv6aYChu4zlzAtVQool5aiAhkgoi-lBGkf2k6-WGsYjCVwhK2N5B5FbIt96kJ02QUWQUBcZGE8BgTPxRQ6NWp5ofBSdHK2HLGNKb4OE518zWjYRCvgAsNaM8W5BFI Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 263cdea67dc24a41800ec4bd32d32719 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:00:23.243193 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/263cdea67dc24a41800ec4bd32d32719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_263cdea67dc24a41800ec4bd32d32719", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/263cdea67dc24a41800ec4bd32d32719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/263cdea67dc24a41800ec4bd32d32719"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 263cdea67dc24a41800ec4bd32d32719 Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d8d6aa44f2bc4ca6aefcb83b1f41096f Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid timestamp for date invalid_time Jul 30 21:00:23.244766 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'invalid_time'} Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:23.245461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 30 21:00:23.246789 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.250004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49863581-6b7c-46fa-9dc4-8a465ee63b10 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:23.251407 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49863581-6b7c-46fa-9dc4-8a465ee63b10 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379 tempest-InstanceUsageAuditLogNegativeTestJSON-240240379-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.808432 Jul 30 21:00:23.252294 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 34/107] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Jul 30 21:00:22 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 810 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:00:23.289985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eabafc7d-d991-420a-8e2c-97e0573bcc41 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.291736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eabafc7d-d991-420a-8e2c-97e0573bcc41 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:23.701541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eabafc7d-d991-420a-8e2c-97e0573bcc41 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:23.709453 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eabafc7d-d991-420a-8e2c-97e0573bcc41 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1242 microversion: 2.1 time: 0.423596 Jul 30 21:00:23.723004 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 35/108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:23 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1242 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:23.730739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.731737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:23.778040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:23.780656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:23.781813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:23.782594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:23.797811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-898d9bb1-21bf-4041-9f00-5fdd5839522d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.805320 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:23.805320 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:23.816138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-898d9bb1-21bf-4041-9f00-5fdd5839522d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a60da9ceedcb484c80c56ad3b6bb7366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d32a6472ff40aa8e83b8fbb931fcd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-898d9bb1-21bf-4041-9f00-5fdd5839522d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Request method failure captured: Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvj-ZQ7W5xQsO2WZo9jQhTBNv8niyH4BLyhIgjq5KLVqulXU32i_ND7LJ2yq6QN_ecUZB-f9CJQrBOA3aH4hD8pgYrtSEWod9F5KE6KtR53pDU80ihs1IMXE2_WFVkVpFfmoknPx6vQoSDzpHMdIdEbrt22FLu8qggsHTauN4dt9m4 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 67d32a6472ff40aa8e83b8fbb931fcd8 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:23.826520 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_67d32a6472ff40aa8e83b8fbb931fcd8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 67d32a6472ff40aa8e83b8fbb931fcd8 Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a60da9ceedcb484c80c56ad3b6bb7366 Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:23.827854 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:23.828515 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.829635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-898d9bb1-21bf-4041-9f00-5fdd5839522d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:23.830580 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-898d9bb1-21bf-4041-9f00-5fdd5839522d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.568724 Jul 30 21:00:23.832159 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 74/109] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:00:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 575 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:00:23.855469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39c7eeb0-da8a-41b3-9bfd-7ae7ade3988d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:23.858509 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:23.858509 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:23.865844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39c7eeb0-da8a-41b3-9bfd-7ae7ade3988d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a60da9ceedcb484c80c56ad3b6bb7366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d32a6472ff40aa8e83b8fbb931fcd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39c7eeb0-da8a-41b3-9bfd-7ae7ade3988d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Request method failure captured: Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-30%2021:00:23 HTTP/1.1 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvj-ZQ7W5xQsO2WZo9jQhTBNv8niyH4BLyhIgjq5KLVqulXU32i_ND7LJ2yq6QN_ecUZB-f9CJQrBOA3aH4hD8pgYrtSEWod9F5KE6KtR53pDU80ihs1IMXE2_WFVkVpFfmoknPx6vQoSDzpHMdIdEbrt22FLu8qggsHTauN4dt9m4 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 67d32a6472ff40aa8e83b8fbb931fcd8 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:00:23.889066 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_67d32a6472ff40aa8e83b8fbb931fcd8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67d32a6472ff40aa8e83b8fbb931fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 67d32a6472ff40aa8e83b8fbb931fcd8 Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a60da9ceedcb484c80c56ad3b6bb7366 Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:00:23.890513 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2022-07-30 21:00:23'} Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:00:23.891226 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 30 21:00:23.892931 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:00:23.898790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39c7eeb0-da8a-41b3-9bfd-7ae7ade3988d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:00:23.902035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39c7eeb0-da8a-41b3-9bfd-7ae7ade3988d tempest-InstanceUsageAuditLogNegativeTestJSON-612281704 tempest-InstanceUsageAuditLogNegativeTestJSON-612281704-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-30 21:00:23" status: 403 len: 128 microversion: 2.1 time: 0.063549 Jul 30 21:00:23.903571 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 75/110] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:00:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-30%2021%3A00%3A23 => generated 128 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:00:24.184844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:24.203625 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2190c367-7f1a-4bd3-b44b-00375d8e7b75 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.479064 Jul 30 21:00:24.204409 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 36/111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:23 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:24.748851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:24.750794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:24.775683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:24.782009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:24.783355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:24.791819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:25.225012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:25.225794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:25.232394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:25.232858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:25.233663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:25.234116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:25.316742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:25.328219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1298 microversion: 2.1 time: 0.587535 Jul 30 21:00:25.329009 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 76/112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:24 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1298 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:25.653120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:25.654072 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfde2932-1c09-4bec-890a-2b1bf505ee5f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001346 Jul 30 21:00:25.662388 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 77/113] 10.222.0.17 () {56 vars in 886 bytes} [Sat Jul 30 21:00:25 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 30 21:00:26.305281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:26.316164 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1abb2f1f-488d-4ff0-8640-dd5fd601ba14 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.094225 Jul 30 21:00:26.316712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 37/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:25 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:26.351911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:26.352708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:26.368014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:26.368606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:26.369604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:26.370951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:26.505801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:26.524328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70c7459b-e773-4a01-b5dc-16f7de23f130 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1296 microversion: 2.1 time: 0.177364 Jul 30 21:00:26.525891 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 78/115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:26 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:27.339949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:27.340841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:27.352589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:27.353067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:27.370286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:27.377556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:27.548566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:27.550127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:27.561570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:27.563862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:27.565125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:27.575017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:27.880682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:27.890642 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a47b076d-8b99-4eb9-b4fa-04645bcacf4c tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1296 microversion: 2.1 time: 0.346678 Jul 30 21:00:27.894184 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 79/116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:27 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1296 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:28.507620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e6961983-0095-44e5-b465-aa1b6243492e req-189ced89-3fab-491c-bf5c-badffd61c7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aedf1cc-3ee3-43d6-b8d4-987236379ab2", "tag": "ed15f413-3884-4bbc-bac4-7d629e4d5e82"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:28.541802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6961983-0095-44e5-b465-aa1b6243492e req-189ced89-3fab-491c-bf5c-badffd61c7ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:28.542535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6961983-0095-44e5-b465-aa1b6243492e req-189ced89-3fab-491c-bf5c-badffd61c7ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:28.585842 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e6961983-0095-44e5-b465-aa1b6243492e req-189ced89-3fab-491c-bf5c-badffd61c7ad service nova] Creating event network-changed:ed15f413-3884-4bbc-bac4-7d629e4d5e82 for instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 on nch2-master-1 Jul 30 21:00:28.587485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6961983-0095-44e5-b465-aa1b6243492e req-189ced89-3fab-491c-bf5c-badffd61c7ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:00:28.588862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:28.589485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:28.590457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:28.591057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:28.604203 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.rpcapi [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 30 21:00:28.605482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] Releasing lock "compute-rpcapi-router" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:00:28.639813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de968b94-abeb-4c6c-ae8c-f3b3c4c39104 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272395 Jul 30 21:00:28.641405 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 80/117] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:28.931934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:28.932723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:28.964873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:28.964873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:28.964873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:28.964873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:29.140928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:29.155918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0096d26d-8da9-4ec2-90b6-b6a1d187c896 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.821423 Jul 30 21:00:29.156659 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 38/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:27 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:29.927151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:29.944937 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8458ed9-fe41-46d7-8055-83194d7c88dd tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 1.032893 Jul 30 21:00:29.946568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 81/119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:28 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:30.177828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:30.180246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:30.204057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:30.206557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:30.209485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:30.215966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:30.979256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:30.979907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:30.992364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:31.003110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:31.004045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:31.008837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:31.012141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:31.272913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:31.298482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e79a5d32-47db-4c19-9d84-e52da46eeafc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.119919 Jul 30 21:00:31.308011 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 39/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:30 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:31.609203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:31.626572 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc9a1644-befc-460c-8a7b-e141cdb8b012 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.653643 Jul 30 21:00:31.629633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 82/121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:30 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:32.319666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:32.327712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:32.328902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:32.355611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:32.365317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:32.370077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:32.372581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:32.653927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:32.654559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:32.670631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:32.671104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:32.677948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:32.678421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:33.493800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:33.508712 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a4a8909b-34ed-45f9-aa97-be8d036b8070 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.858947 Jul 30 21:00:33.523383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 83/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:32 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:33.708968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=18 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:33.882474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:33.896699 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05856003-ca45-45ce-a38a-34c4bf09b5c8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.578009 Jul 30 21:00:33.902377 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 40/123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:32 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:34.528909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:34.529547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:34.559793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:34.560733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:34.561945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:34.562555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:34.793453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-22409489", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:35.292550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:35.317075 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b9d638c4-c446-4b9a-87d9-d4a51eb58ccc tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.791602 Jul 30 21:00:35.318775 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 84/124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:34 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:35.645897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9842f73e-c55f-456e-afe6-01cd72d282bc req-24dc70e8-fc80-483b-9c55-a5fa25feecec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019dba51-a1c1-414b-a0b3-a4d7437bcef9", "tag": "6cc0a3ec-182b-4a6c-aae3-96188fa13704"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:35.688940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9842f73e-c55f-456e-afe6-01cd72d282bc req-24dc70e8-fc80-483b-9c55-a5fa25feecec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:35.697144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9842f73e-c55f-456e-afe6-01cd72d282bc req-24dc70e8-fc80-483b-9c55-a5fa25feecec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:35.749541 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9842f73e-c55f-456e-afe6-01cd72d282bc req-24dc70e8-fc80-483b-9c55-a5fa25feecec service nova] Creating event network-changed:6cc0a3ec-182b-4a6c-aae3-96188fa13704 for instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 on nch1-master-1 Jul 30 21:00:35.769781 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9842f73e-c55f-456e-afe6-01cd72d282bc req-24dc70e8-fc80-483b-9c55-a5fa25feecec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.447130 Jul 30 21:00:35.783896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 85/125] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:35.793908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:35.811252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:35.826787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:35.831159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:35.832209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:35.832818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:36.859939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:36.887869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6c643ef4-6679-43d2-93ab-097c855f6d92 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.098180 Jul 30 21:00:36.890175 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 86/126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:35 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:36.915205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:36.919394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:36.941345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:36.943004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:36.947923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:36.951000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:37.579051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:37.584592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:37.606160 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9c440ba-87b2-4612-bee0-a3dd7478a962 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.709100 Jul 30 21:00:37.612437 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 87/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:36 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:38.024665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c74c2da1-25b2-4d96-abbc-95f9d17956e8 tempest-InstanceUsageAuditLogTestJSON-2102819191 tempest-InstanceUsageAuditLogTestJSON-2102819191-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:38.026613 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:38.026613 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:38.094442 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c74c2da1-25b2-4d96-abbc-95f9d17956e8 tempest-InstanceUsageAuditLogTestJSON-2102819191 tempest-InstanceUsageAuditLogTestJSON-2102819191-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-30 21:00:36" status: 200 len: 318 microversion: 2.1 time: 0.480721 Jul 30 21:00:38.105400 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 88/128] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:00:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-30%2021%3A00%3A36 => generated 318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:38.132100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:38.132986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:38.157171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:38.160368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:38.161454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:38.162217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:38.602376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:39.158049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:39.170117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92be3330-2053-4b6e-89ab-d33955493ad2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 1.062626 Jul 30 21:00:39.172952 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 89/129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:38 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:39.191564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1fd5e3b-705c-4e24-85d8-258d29fec3e7 tempest-InstanceUsageAuditLogTestJSON-2102819191 tempest-InstanceUsageAuditLogTestJSON-2102819191-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:39.192888 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:00:39.192888 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:00:39.249360 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1fd5e3b-705c-4e24-85d8-258d29fec3e7 tempest-InstanceUsageAuditLogTestJSON-2102819191 tempest-InstanceUsageAuditLogTestJSON-2102819191-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.074861 Jul 30 21:00:39.250116 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 90/130] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:00:39 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:39.265429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:39.279470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:39.298705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:39.305016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:39.306283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:39.306975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:40.184896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:40.197152 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7178a086-91f0-49a2-83d7-dc186bbad970 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.945112 Jul 30 21:00:40.230322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 91/131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:39 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:40.236827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:40.240494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:40.258934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:40.259923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:40.261573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:40.262349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:40.856636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:40.895180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed159979-4832-448b-9f14-b56d9bb19fd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.663131 Jul 30 21:00:40.895809 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 92/132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:40 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:41.074592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:00:41.237068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:41.238205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:41.253629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.257552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.264631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.267713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.574909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:41.587047 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9ccb0eb6-95e7-4a6c-af2d-ee98f91c096b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.353855 Jul 30 21:00:41.603640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 93/133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:41 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:41.868561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:00:41.868997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:00:41.869482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:00:41.869909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:00:41.870497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:00:41.880393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.881156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.882227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.882919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.909877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Getting quotas for project 0e047bc76bc845649a0b0704a4931f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:00:41.922219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:41.923049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:41.933019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Getting quotas for user 950f96b926474852acb90a959e369999 and project 0e047bc76bc845649a0b0704a4931f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:00:41.938456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.938922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.941391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:41.945463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:41.969133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:00:41.973810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:00:42.074234 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a57ea864-7b8b-4d42-aacb-48dc6dca829f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.425498 Jul 30 21:00:42.092355 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 41/134] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 7443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:00:42.100232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4405e9d8-648a-4600-b8f9-53f58ba8f9e9 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:42.107622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4405e9d8-648a-4600-b8f9-53f58ba8f9e9 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:42.253059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4405e9d8-648a-4600-b8f9-53f58ba8f9e9 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:42.262430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4405e9d8-648a-4600-b8f9-53f58ba8f9e9 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1217 microversion: 2.1 time: 0.168029 Jul 30 21:00:42.281010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 42/135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:42 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:42.417679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:42.427731 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46361b04-cb43-4b11-92dd-13b7c31b617b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.509932 Jul 30 21:00:42.429827 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 94/136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:41 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:42.609492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:42.610397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:42.628346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:42.628813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:42.629617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:42.639039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:43.135185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:43.144130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94e973c3-961e-4326-8da1-327415600969 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.539002 Jul 30 21:00:43.146533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 43/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:42 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:43.298626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:43.301718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:43.323152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:43.327983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:43.329643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:43.331338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:43.449997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:43.450896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:43.454063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:43.458805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:43.460080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:43.461259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:43.462406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:43.530734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:43.544040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51dbe3c4-4afd-4d8d-b72b-e9d62a1172b8 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1213 microversion: 2.1 time: 0.258156 Jul 30 21:00:43.545235 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 95/138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:43 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1213 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:43.722818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:43.736274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6edfa2f4-8371-4a62-a407-b553b9b0d060 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.290477 Jul 30 21:00:43.738151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 44/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:43 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:44.171690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:44.174183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:44.195989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:44.200483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.208590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:44.214314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.216184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:44.566077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:44.566818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:44.582964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.583839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:44.584907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.585601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:44.600476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=69 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:44.699762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:44.712833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6ac02076-36de-4104-90fa-2571483a1f3f tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.548749 Jul 30 21:00:44.739940 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 96/140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:44 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:44.760979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:44.761841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:44.765549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:44.775498 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43e139c3-4c7a-4fb0-879d-1cbc41b2edea tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1275 microversion: 2.1 time: 0.213504 Jul 30 21:00:44.776693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 45/141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:44 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:44.787205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.789208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:44.793649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:44.799775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:45.589709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:45.608661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e597bdde-5d1c-4e32-8e39-37287a50c400 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.854137 Jul 30 21:00:45.633025 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 97/142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:44 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:45.744641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:45.745396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:45.761407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:45.761875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:45.762843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:45.763525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:45.798013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:45.798645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:45.811225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:45.812082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:45.813267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:45.813873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:46.080971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:46.093308 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c79c8968-2a71-4b48-a607-3e5925a20177 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1275 microversion: 2.1 time: 0.296551 Jul 30 21:00:46.096310 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 98/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:45 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:46.478601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:46.491961 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b02123fd-8741-40b4-bf0c-924626d8798a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.751806 Jul 30 21:00:46.505651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 46/144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:45 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:46.637718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:46.641469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:46.663406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:46.664335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:46.666285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:46.669179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:47.120993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:47.123775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:47.130832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:47.132457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:47.137661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:47.138829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:47.514783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:47.533482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-968cb11a-ddc5-4cdd-aae6-2494809fe275 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.903089 Jul 30 21:00:47.534396 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 99/145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:46 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:47.548460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:47.548460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:47.570991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:47.571534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:47.572321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:47.576595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:47.889991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:47.901101 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42bc74c0-7b02-41a2-be40-624c23a9be0b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.361836 Jul 30 21:00:47.914178 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 100/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:47 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:47.931344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:47.946582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b2f354b-e603-43f4-8b7d-013a6e856727 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.836226 Jul 30 21:00:47.950148 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 47/147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:47 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:48.556622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:48.557360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:48.568600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:48.571908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:48.572824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:48.575442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:48.924685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:48.925321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:48.938714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:48.940573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:48.942700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:48.945171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.224345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:49.385319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:49.401329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30fe0691-01b6-4d34-8bf6-66bad08466af tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.851001 Jul 30 21:00:49.402125 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 101/148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:48 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:49.414782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:49.417925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:49.433578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:49.448781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:49.452261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.453014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1902658e-851d-4cdc-b5e9-617b5eb66208 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.527481 Jul 30 21:00:49.456381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:49.458143 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 48/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:48 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:49.463739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.484061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-35cbbf71-e7fb-43fc-9c33-0f9cc3a1aa2a req-3cbeea32-81fc-4688-b9e7-35a26ece0331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa59e938-eca3-4f85-9979-6916e3ab04ff", "tag": "d4349851-888d-4550-8fe2-7aa292b790dd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:49.564802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-35cbbf71-e7fb-43fc-9c33-0f9cc3a1aa2a req-3cbeea32-81fc-4688-b9e7-35a26ece0331 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:49.566391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-35cbbf71-e7fb-43fc-9c33-0f9cc3a1aa2a req-3cbeea32-81fc-4688-b9e7-35a26ece0331 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.615112 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-35cbbf71-e7fb-43fc-9c33-0f9cc3a1aa2a req-3cbeea32-81fc-4688-b9e7-35a26ece0331 service nova] Creating event network-changed:d4349851-888d-4550-8fe2-7aa292b790dd for instance fa59e938-eca3-4f85-9979-6916e3ab04ff on nch2-master-1 Jul 30 21:00:49.616160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-35cbbf71-e7fb-43fc-9c33-0f9cc3a1aa2a req-3cbeea32-81fc-4688-b9e7-35a26ece0331 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:00:49.617895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:49.618502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.620761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:49.621424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:49.638032 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.rpcapi [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 30 21:00:49.639184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] Releasing lock "compute-rpcapi-router" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:00:49.675050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c1d4087c-278a-43cc-87da-b47487228365 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199877 Jul 30 21:00:49.676276 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 49/150] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:00:49.974913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:49.985077 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-658e67da-7294-40ca-adbe-345811bf7e48 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.579497 Jul 30 21:00:49.985685 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 102/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:49 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:50.430455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:50.431819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:50.453050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:50.453860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:50.454323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:50.454948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:50.483964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:50.484985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:50.499056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:50.500359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:50.504169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:50.510895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:50.803866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:50.819263 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98f30259-958a-4f5c-8af5-78e720829541 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.397651 Jul 30 21:00:50.841297 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 50/152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:50 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:51.019457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:51.020460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:51.049818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:51.050594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:51.051637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:51.052490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:51.265200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:51.277589 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c04b0256-bb70-411c-9852-847c0415fec7 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.798583 Jul 30 21:00:51.298246 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 103/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:50 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:51.516412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:51.530632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b78dd4c-6c32-4ce1-a7a8-3e952b517b2b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.525131 Jul 30 21:00:51.531272 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 51/154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:51 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:51.845618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:51.846266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:51.861178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:51.866616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:51.870004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:51.870962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.262241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:52.369122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b2d08b78-c325-4f20-91ff-985c5f143bbd req-d8f8acd4-b80a-489a-bf99-a70f30c5a730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019dba51-a1c1-414b-a0b3-a4d7437bcef9", "name": "network-vif-plugged", "status": "completed", "tag": "6cc0a3ec-182b-4a6c-aae3-96188fa13704"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:52.387370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b2d08b78-c325-4f20-91ff-985c5f143bbd req-d8f8acd4-b80a-489a-bf99-a70f30c5a730 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:52.387880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b2d08b78-c325-4f20-91ff-985c5f143bbd req-d8f8acd4-b80a-489a-bf99-a70f30c5a730 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.415476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b2d08b78-c325-4f20-91ff-985c5f143bbd req-d8f8acd4-b80a-489a-bf99-a70f30c5a730 service nova] Creating event network-vif-plugged:6cc0a3ec-182b-4a6c-aae3-96188fa13704 for instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 on nch1-master-1 Jul 30 21:00:52.425444 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b2d08b78-c325-4f20-91ff-985c5f143bbd req-d8f8acd4-b80a-489a-bf99-a70f30c5a730 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216836 Jul 30 21:00:52.431651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 52/155] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:52.437216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:52.437938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:52.456664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:52.457126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.457931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:52.458378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.471176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:52.483656 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf5b3451-a5fb-4b67-93d7-768f9c05f9b7 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.642767 Jul 30 21:00:52.484244 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 104/156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:51 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:52.553739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:52.554631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:52.565642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:52.567154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.568220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:52.570926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:52.702285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:52.715150 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9bb95e2b-f9a7-4e01-981d-3b6783523672 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.282149 Jul 30 21:00:52.717902 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 53/157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:52 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:52.804206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1781976618", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "68a236a2-c168-48e8-bff4-a731709fe73b"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:52.876604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] validate_networks() for [('68a236a2-c168-48e8-bff4-a731709fe73b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:00:53.166178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:53.187228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91aaef4c-ee35-4bb4-99b7-3b3d84af2e17 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.638924 Jul 30 21:00:53.189640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 105/158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:52 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:53.505090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:53.505860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:53.515069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:53.523786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:53.524804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:53.525284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:53.563941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:53.774011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:00:53.775601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:00:53.778394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:00:53.779699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:00:53.781994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:00:53.810533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:53.811516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:53.812713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:53.813382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:53.851962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:00:53.856639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for user 96815c6776f1464a8b6350b4a52d4548 and project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:00:53.877431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:00:53.890158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:00:53.997234 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c65ba526-91fe-4bb3-a59a-2aa0675aab73 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259199 Jul 30 21:00:54.001633 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 54/159] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:00:54.013363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:54.014359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:54.028577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:54.029236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:54.030284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:54.035542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:54.231408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:54.242475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-399e5b1f-f3b2-422e-89a8-e66a1bed2266 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.741331 Jul 30 21:00:54.257329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 106/160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:53 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:54.264197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:54.265004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b0ad48c-a123-41ef-a63b-64e30f061b36 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:54.269996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b0ad48c-a123-41ef-a63b-64e30f061b36 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:54.279713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fdc9cd23-8ee7-4f4e-a560-2135936087b8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.276537 Jul 30 21:00:54.280944 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 55/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:54 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:54.308942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:54.309753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:54.322356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:54.322912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:54.323958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:54.327639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:54.556166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:54.572237 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f60bd96-e914-4b16-a033-7f1dd6207409 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.289751 Jul 30 21:00:54.575125 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 56/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:54 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:54.597173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5df5d6a9-bb1d-4e56-beb1-918eeebaba2d req-e43892bb-f5dd-4ed2-ad9e-85c3275ef488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aedf1cc-3ee3-43d6-b8d4-987236379ab2", "name": "network-vif-plugged", "status": "completed", "tag": "ed15f413-3884-4bbc-bac4-7d629e4d5e82"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:54.625945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5df5d6a9-bb1d-4e56-beb1-918eeebaba2d req-e43892bb-f5dd-4ed2-ad9e-85c3275ef488 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:54.626708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5df5d6a9-bb1d-4e56-beb1-918eeebaba2d req-e43892bb-f5dd-4ed2-ad9e-85c3275ef488 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:54.642342 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5df5d6a9-bb1d-4e56-beb1-918eeebaba2d req-e43892bb-f5dd-4ed2-ad9e-85c3275ef488 service nova] Creating event network-vif-plugged:ed15f413-3884-4bbc-bac4-7d629e4d5e82 for instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 on nch2-master-1 Jul 30 21:00:54.649328 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5df5d6a9-bb1d-4e56-beb1-918eeebaba2d req-e43892bb-f5dd-4ed2-ad9e-85c3275ef488 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058107 Jul 30 21:00:54.674157 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 57/163] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:54.692496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b0ad48c-a123-41ef-a63b-64e30f061b36 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:54.701793 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b0ad48c-a123-41ef-a63b-64e30f061b36 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1211 microversion: 2.1 time: 0.443200 Jul 30 21:00:54.703066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 107/164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:54 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1211 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:55.266037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:55.266797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:55.285445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.285958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.286777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.287658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.302078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:55.302783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:55.313883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.326707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.327769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.330635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.613797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:55.623650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-706f3872-a287-4c93-bab7-6a3049b2a1d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.362776 Jul 30 21:00:55.625274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 58/165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:55 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:55.630910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:55.631843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:55.645887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.653027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.654084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:55.654815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:55.933979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:55.946504 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc80dcb3-9f6a-4dbc-a87d-b696e7252f9a tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1338 microversion: 2.1 time: 0.648639 Jul 30 21:00:55.949925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 108/166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:55 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1338 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:55.978214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:55.979189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:56.005210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:56.007114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:56.008148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:56.010832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:56.039713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:56.060727 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c115e69-b767-4a0d-be21-861fb77c5abc tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.432532 Jul 30 21:00:56.061649 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 59/167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:55 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:56.265177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:56.274245 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef327baa-c889-4076-a194-9d70639b6ba8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1293 microversion: 2.1 time: 0.321032 Jul 30 21:00:56.274776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 109/168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:55 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1293 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:56.645705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:56.648635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:56.666032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:56.667397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:56.670014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:56.671677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:56.967302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:56.968661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:56.977161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:56.984068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.000371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.001448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.344947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:57.359952 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-debf0e51-1782-4a75-af6e-e976f64aaac6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1319 microversion: 2.1 time: 0.718508 Jul 30 21:00:57.368974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 60/169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:56 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1319 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:57.380096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:57.384772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:57.408074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.408548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.417671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.419857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.493820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:57.516317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ed0a118-36ed-461e-a055-f7a9057478f4 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1488 microversion: 2.1 time: 0.552802 Jul 30 21:00:57.516925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 110/170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:56 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1488 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:57.522450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:57.523098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:57.541359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.541922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.542727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.543176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.696167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:57.711233 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8469634-7c64-4508-8d33-bd508b6e0543 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1291 microversion: 2.1 time: 0.193165 Jul 30 21:00:57.712205 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 111/171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:57 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1291 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:57.716874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:57.717530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:57.733270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.733740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.734544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:57.735010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:57.994751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:58.005167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-db6ef540-63da-4974-b946-c11f7692e7bf tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.634723 Jul 30 21:00:58.012825 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 61/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:57 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:58.393415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:58.397407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:58.414189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:58.415628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:58.416969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:58.418279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:58.809164 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ecced2cf-fb13-4529-8088-7e27c111f730 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1639 microversion: 2.1 time: 1.095784 Jul 30 21:00:58.809969 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 112/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:57 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1639 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:00:58.839369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1c9bdab7-ee6d-422b-b9af-934113e94933 req-9e5b6ea1-471a-4dd6-8d01-b160bc3983f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa59e938-eca3-4f85-9979-6916e3ab04ff", "name": "network-vif-plugged", "status": "completed", "tag": "d4349851-888d-4550-8fe2-7aa292b790dd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:00:58.867554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1c9bdab7-ee6d-422b-b9af-934113e94933 req-9e5b6ea1-471a-4dd6-8d01-b160bc3983f7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:58.868022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1c9bdab7-ee6d-422b-b9af-934113e94933 req-9e5b6ea1-471a-4dd6-8d01-b160bc3983f7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:58.915143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1c9bdab7-ee6d-422b-b9af-934113e94933 req-9e5b6ea1-471a-4dd6-8d01-b160bc3983f7 service nova] Creating event network-vif-plugged:d4349851-888d-4550-8fe2-7aa292b790dd for instance fa59e938-eca3-4f85-9979-6916e3ab04ff on nch2-master-1 Jul 30 21:00:58.928528 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1c9bdab7-ee6d-422b-b9af-934113e94933 req-9e5b6ea1-471a-4dd6-8d01-b160bc3983f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112882 Jul 30 21:00:58.930944 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 113/174] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:00:58.956538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:58.957716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:59.000734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.010081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:59.011429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.018068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:59.109834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:00:59.134885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05a1d381-1315-4f0a-93c4-2d9b982ebdcb tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1468 microversion: 2.1 time: 0.748187 Jul 30 21:00:59.142041 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 62/175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:58 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1468 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:00:59.147632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:59.148159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:59.158815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.159278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:59.160101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.160552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:59.233749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:00:59.339064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:59.586881 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30bee071-1448-4416-bb9f-4333e3b128f9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "DELETE /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 204 len: 0 microversion: 2.1 time: 0.443396 Jul 30 21:00:59.587470 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 63/176] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:00:59 2022] DELETE /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:00:59.606804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:00:59.608017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:00:59.618509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.619133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:00:59.620067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:00:59.623353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.088783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:00.097813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f020272-26de-401a-8772-fb2f5a5ae3c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1333 microversion: 2.1 time: 1.163882 Jul 30 21:01:00.101284 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 114/177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:58 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1333 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:00.152536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:00.169310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7375cbc1-97d3-44d3-8467-8e364bbbfe30 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1317 microversion: 2.1 time: 0.579614 Jul 30 21:01:00.175779 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 64/178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:00:59 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:00.191525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:00.192891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:00.214675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:00.216349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.217407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:00.221650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.682604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:00.683567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:00.698791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:00.700871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.701888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:00.702819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.792819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:01:00.846633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:00.856876 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b852daea-c759-4f5f-9dd4-6762d14d35c8 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1494 microversion: 2.1 time: 0.679530 Jul 30 21:01:00.857513 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 65/179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:00 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1494 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:00.865804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8d7f73f9-c639-4501-a6a2-02651f28a5c1 req-41352e98-3f58-4016-8a95-a794a652d6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad15fe6-2fb7-4526-8ed1-f013530548e1", "tag": "1460c4e5-0f29-40f5-91cf-ff3fa5ad435c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:00.899618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8d7f73f9-c639-4501-a6a2-02651f28a5c1 req-41352e98-3f58-4016-8a95-a794a652d6ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:00.900355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8d7f73f9-c639-4501-a6a2-02651f28a5c1 req-41352e98-3f58-4016-8a95-a794a652d6ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:00.930256 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8d7f73f9-c639-4501-a6a2-02651f28a5c1 req-41352e98-3f58-4016-8a95-a794a652d6ec service nova] Creating event network-changed:1460c4e5-0f29-40f5-91cf-ff3fa5ad435c for instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 on nch1-master-1 Jul 30 21:01:00.941128 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8d7f73f9-c639-4501-a6a2-02651f28a5c1 req-41352e98-3f58-4016-8a95-a794a652d6ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081116 Jul 30 21:01:00.943682 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 66/180] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:01.004862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a771bda-5d4b-40c2-8bf8-864ac6d70f11 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 204 len: 0 microversion: 2.1 time: 0.901988 Jul 30 21:01:01.005689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 115/181] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:00 2022] DELETE /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:01.018960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:01.019944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:01.032042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.032777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.034261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.034731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.124006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:01.125549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:01.133685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.134617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.135837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.136539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.316823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:01.325632 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79690d86-2f47-4469-ae19-1c6740940431 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1333 microversion: 2.1 time: 0.207024 Jul 30 21:01:01.326419 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 116/182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:01 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:01.331323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:01.332188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:01.339772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.340238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.341033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.341480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.530162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:01.556669 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ea8d3cb-1271-46fa-b055-97cdb411a7a2 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1466 microversion: 2.1 time: 0.228936 Jul 30 21:01:01.567618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 117/183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:01 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:01.777113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-57719816", "block_migration": true, "disk_over_commit": false}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:01.779930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:01.803072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.803601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:01.805897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:01.806367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:02.026458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:02.038380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60ef9d63-98de-4071-9038-6c86b6087d72 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1474 microversion: 2.1 time: 1.021105 Jul 30 21:01:02.052165 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 67/184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:01 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1474 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:02.060959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:02.061589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:02.097833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:02.098360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:02.099232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:02.102325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:02.398084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lazy-loading 'flavor' on Instance uuid fa59e938-eca3-4f85-9979-6916e3ab04ff {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:02.452606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Going to try to live migrate instance to tempest-host-57719816 {{(pid=130984) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:01:02.496591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] HTTP exception thrown: Compute host tempest-host-57719816 could not be found. Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Request method failure captured: Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff/action HTTP/1.1 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 105 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvyBG1NbbUB2p5HiYFa7a_0bXv6u6R_h-kyU82o6I71HF4E-N7cfM1vkjZ8xLNdEDQVLWCmweo_8caDCXqmTLFVNxPxAMboC_knrXEQxvTIfq4maNu67cGtiAt00nZbNOkqDqKf9wXeWfMOr3TMDKAbQOyuDczEswwA2ZR_cE0YEVU Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b93ad6350bfb456dbee1e76756e6b178 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:02.507775 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b93ad6350bfb456dbee1e76756e6b178", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b93ad6350bfb456dbee1e76756e6b178 Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveMigrationNegativeTest-471814438-project-admin Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d75b01a28d5c40cb8f6570015c7cb807 Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveMigrationNegativeTest-471814438-project-admin Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: {"os-migrateLive": {"host": "tempest-host-57719816", "block_migration": true, "disk_over_commit": false}} Jul 30 21:01:02.509185 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: exception: Compute host tempest-host-57719816 could not be found. Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'fa59e938-eca3-4f85-9979-6916e3ab04ff', 'body': {'os-migrateLive': {'host': 'tempest-host-57719816', 'block_migration': True, 'disk_over_commit': False}}} Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:02.509912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-57719816 could not be found. Jul 30 21:01:02.510972 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-57719816 could not be found. Jul 30 21:01:02.512306 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-57719816 could not be found. Jul 30 21:01:02.513528 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:02.517776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Returning 400 to user: Compute host tempest-host-57719816 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:02.535151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e71c5349-1108-43f0-808b-745bb91f094d tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff/action" status: 400 len: 98 microversion: 2.1 time: 0.930954 Jul 30 21:01:02.536078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 118/185] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 30 21:01:01 2022] POST /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff/action => generated 98 bytes in 948 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:01:02.542393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:02.543423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:02.551631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:02.552846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:02.553884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:02.554577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:02.986262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:03.013173 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-238b22c3-303e-47d5-b93d-e94e66b1f4d3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1333 microversion: 2.1 time: 0.475173 Jul 30 21:01:03.014165 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 119/186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:02 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1333 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:03.024488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:03.029604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:03.070100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:03.070964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:03.073749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:03.074506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:03.092878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f724ca9bef02478da3b1696b379dc027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80c1509c60d46bda7b1c4793260ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:03.107040 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd452112-562b-4aba-85ea-882d5164bf1b tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 200 len: 1494 microversion: 2.1 time: 1.057422 Jul 30 21:01:03.121783 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 68/187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:02 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 1494 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:03.135755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7b45b622-b4de-4636-988e-4029efa90121 req-f6a11649-57a3-4d3b-8377-e3af52c96558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019dba51-a1c1-414b-a0b3-a4d7437bcef9", "name": "network-vif-deleted", "tag": "6cc0a3ec-182b-4a6c-aae3-96188fa13704"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:03.165885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b45b622-b4de-4636-988e-4029efa90121 req-f6a11649-57a3-4d3b-8377-e3af52c96558 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:03.166344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b45b622-b4de-4636-988e-4029efa90121 req-f6a11649-57a3-4d3b-8377-e3af52c96558 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:03.199574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7b45b622-b4de-4636-988e-4029efa90121 req-f6a11649-57a3-4d3b-8377-e3af52c96558 service nova] Creating event network-vif-deleted:6cc0a3ec-182b-4a6c-aae3-96188fa13704 for instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 on nch1-master-1 Jul 30 21:01:03.207452 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7b45b622-b4de-4636-988e-4029efa90121 req-f6a11649-57a3-4d3b-8377-e3af52c96558 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083594 Jul 30 21:01:03.208807 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 69/188] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:03.217767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:03.220014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:03.236262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:03.240898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:03.242237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:03.242950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:03.610033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:03.623226 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0e1bfb88-21b1-4396-b584-0373c9d460c3 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1474 microversion: 2.1 time: 0.412685 Jul 30 21:01:03.627476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 70/189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:03 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1474 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:03.753919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:03.772963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c11323de-8cf4-4427-833e-46fd2f0dcb36 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1466 microversion: 2.1 time: 0.756153 Jul 30 21:01:03.773942 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 120/190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:03 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1466 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:04.034565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:04.035399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:04.037800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:04.038737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:04.052921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.057259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1874328131", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:04.073654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:04.075888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.078324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:04.175261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:04.698819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:04.752911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:04.770438 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e297ab5d-d888-46f9-b2f9-55160a0fd0e6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1333 microversion: 2.1 time: 0.739848 Jul 30 21:01:04.771499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 71/191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:04 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1333 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:04.785224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:04.786268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:04.795830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.796706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:04.797783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.799034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:04.840562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] HTTP exception thrown: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Request method failure captured: Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 HTTP/1.1 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvemERGfmb-u7RBPhIRP8Y-gRfBJPajspLIdwOcKvM7pG27B52_kMaT914rR2ZNOrz1w9bzQL5Cq4YrB9acVWogatSmKvnKz-QclfkEXgAshLJUAzUB5QDYg4K7iE7SmlRfa6uzke0E4MqiHE82AHZ9FmkCyFj1Z_0xHu1bSAsxsQA Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:04.851012 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e80c1509c60d46bda7b1c4793260ab40", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f724ca9bef02478da3b1696b379dc027 Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:04.852335 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '019dba51-a1c1-414b-a0b3-a4d7437bcef9'} Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:04.853029 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:04.854111 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:04.855079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Returning 404 to user: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:04.855079 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-36bb7a79-0d69-48de-ab77-ccf36820aca9 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 404 len: 111 microversion: 2.1 time: 0.079895 Jul 30 21:01:04.863903 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 72/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:04 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:04.882594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:04.883896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:04.908021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.908021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:04.908021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:04.908021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.145592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:05.161406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ead6eb20-d5e7-490d-a6e1-938087826c2e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1432 microversion: 2.1 time: 0.294147 Jul 30 21:01:05.164328 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 73/193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:04 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1432 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:05.179669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05f28730-403e-4e90-815d-1a2899a5e3c0 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:05.187181 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:05.187181 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:05.206884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:05.212662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:05.213622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:05.214342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:05.215013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:05.221880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f28730-403e-4e90-815d-1a2899a5e3c0 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.222429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f28730-403e-4e90-815d-1a2899a5e3c0 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.255603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.257220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.259995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.263867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.349873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Getting quotas for project 0e047bc76bc845649a0b0704a4931f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:05.379555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Getting quotas for user 950f96b926474852acb90a959e369999 and project 0e047bc76bc845649a0b0704a4931f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:05.417934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:01:05.421870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:01:05.488871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05f28730-403e-4e90-815d-1a2899a5e3c0 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.321450 Jul 30 21:01:05.491636 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 74/194] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:01:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:05.530254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd8804f3-9dc5-4c9b-a756-0c8bd9a6b0d5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:05.533177 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:05.533177 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:05.550291 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff2779e1-76d5-434f-8d63-2e1c54dc3351 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498906 Jul 30 21:01:05.554166 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 121/195] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:01:05.563053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c331b37b-187e-410e-beee-c173ba233341 req-8d161c3d-4a20-4fd9-bc2e-0d7993fc829a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aedf1cc-3ee3-43d6-b8d4-987236379ab2", "name": "network-vif-deleted", "tag": "ed15f413-3884-4bbc-bac4-7d629e4d5e82"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:05.600528 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd8804f3-9dc5-4c9b-a756-0c8bd9a6b0d5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.100270 Jul 30 21:01:05.608200 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 75/196] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:05.624768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0924eca1-f65d-48c6-9143-c6b4a1952517 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:05.626311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0924eca1-f65d-48c6-9143-c6b4a1952517 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:05.627976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c331b37b-187e-410e-beee-c173ba233341 req-8d161c3d-4a20-4fd9-bc2e-0d7993fc829a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.628505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c331b37b-187e-410e-beee-c173ba233341 req-8d161c3d-4a20-4fd9-bc2e-0d7993fc829a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.650069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c331b37b-187e-410e-beee-c173ba233341 req-8d161c3d-4a20-4fd9-bc2e-0d7993fc829a service nova] Creating event network-vif-deleted:ed15f413-3884-4bbc-bac4-7d629e4d5e82 for instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 on nch2-master-1 Jul 30 21:01:05.674381 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c331b37b-187e-410e-beee-c173ba233341 req-8d161c3d-4a20-4fd9-bc2e-0d7993fc829a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118429 Jul 30 21:01:05.675689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 122/197] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:05.681961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2097fa82-67f5-4305-9399-b22c0a6605d1 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-819699121"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:05.685255 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:05.685255 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:05.687337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-2097fa82-67f5-4305-9399-b22c0a6605d1 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid b3e41747-b181-4be4-8b95-482b4af9433a for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:05.736133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2097fa82-67f5-4305-9399-b22c0a6605d1 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058899 Jul 30 21:01:05.760228 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 123/198] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:05.768465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9351e3e-1e0f-4145-a565-7e89fc13d929 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:05.777631 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:05.777631 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:05.796337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9351e3e-1e0f-4145-a565-7e89fc13d929 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.800698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9351e3e-1e0f-4145-a565-7e89fc13d929 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.830506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0924eca1-f65d-48c6-9143-c6b4a1952517 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:05.851742 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0924eca1-f65d-48c6-9143-c6b4a1952517 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1219 microversion: 2.1 time: 0.239194 Jul 30 21:01:05.867405 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 76/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:05 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:05.890615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:05.938367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:05.970762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.974076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:05.976668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:05.978343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:06.071741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:06.145288 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9351e3e-1e0f-4145-a565-7e89fc13d929 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.383376 Jul 30 21:01:06.146153 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 124/200] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:01:05 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:06.157803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ca93576b-6bde-4007-9c98-3ff1e34ee574 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:06.158878 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:06.158878 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:06.190492 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ca93576b-6bde-4007-9c98-3ff1e34ee574 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.028473 Jul 30 21:01:06.191144 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 125/201] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:01:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:01:06.206547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:06.207673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:06.236738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:06.237480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:06.238612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:06.239422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:06.284092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:06.325491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:06.326356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:06.327019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lazy-loading 'fault' on Instance uuid 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:06.510010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:06.525488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8c276db-70a4-474d-ae93-699f35ddf829 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 200 len: 1309 microversion: 2.1 time: 0.327433 Jul 30 21:01:06.526688 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 126/202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:06 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:06.547370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14a4e1e9-2c49-4591-94f0-432fc2d98e78 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:06.556327 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:06.556327 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:06.588462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14a4e1e9-2c49-4591-94f0-432fc2d98e78 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:06.593206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14a4e1e9-2c49-4591-94f0-432fc2d98e78 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:06.807438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:06.826775 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14a4e1e9-2c49-4591-94f0-432fc2d98e78 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.295361 Jul 30 21:01:06.827728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 127/203] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Jul 30 21:01:06 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:06.840041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6362a8e7-8a7a-4964-8ef8-a9be0ae332ad tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:06.841583 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:06.841583 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:06.858273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:06.870889 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebdf50d3-6fb9-4b55-aaee-265ee68a9e59 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1311 microversion: 2.1 time: 1.011104 Jul 30 21:01:06.871572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 77/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:05 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1311 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:06.884903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-370cfc4b-17e0-4899-9fd9-e8ad334a0d69 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:06.885710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-370cfc4b-17e0-4899-9fd9-e8ad334a0d69 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:06.908483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6362a8e7-8a7a-4964-8ef8-a9be0ae332ad tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.072768 Jul 30 21:01:06.923861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 128/205] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:06 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:06.929358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d113d67-e845-4675-8056-9f71eea18ea8 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1126774118"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:06.952561 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:06.952561 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:06.953613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-4d113d67-e845-4675-8056-9f71eea18ea8 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Generated uuid 8c6c63e9-5264-47c5-8b97-1a928b23c55f for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:07.013535 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d113d67-e845-4675-8056-9f71eea18ea8 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.085591 Jul 30 21:01:07.014573 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 129/206] 10.222.0.17 () {62 vars in 1205 bytes} [Sat Jul 30 21:01:06 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:07.044818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76162296-e9da-4f7d-9aaa-8c903eb1ce1f tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-412739862"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:07.134564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-370cfc4b-17e0-4899-9fd9-e8ad334a0d69 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:07.145729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-370cfc4b-17e0-4899-9fd9-e8ad334a0d69 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1219 microversion: 2.1 time: 0.264688 Jul 30 21:01:07.153549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 78/207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:06 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1219 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:07.169436 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:07.169436 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:07.214494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76162296-e9da-4f7d-9aaa-8c903eb1ce1f tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.190325 Jul 30 21:01:07.238281 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 130/208] 10.222.0.17 () {62 vars in 1210 bytes} [Sat Jul 30 21:01:07 2022] PUT /compute/v2.1/os-aggregates/9 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:07.243180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d66997c-f6a6-4abf-8d35-3eaae793aa85 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:07.243972 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:07.243972 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:07.252330 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d66997c-f6a6-4abf-8d35-3eaae793aa85 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.012692 Jul 30 21:01:07.259932 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 79/209] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 21:01:07 2022] GET /compute/v2.1/os-aggregates/9 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:07.277073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2f7b6b2-9bc5-4ed3-a93c-686e40b56c8c tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:07.283701 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:07.283701 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:07.296375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f7b6b2-9bc5-4ed3-a93c-686e40b56c8c tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.298507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f7b6b2-9bc5-4ed3-a93c-686e40b56c8c tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:07.548596 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2f7b6b2-9bc5-4ed3-a93c-686e40b56c8c tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 313 microversion: 2.41 time: 0.277135 Jul 30 21:01:07.556922 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 131/210] 10.222.0.17 () {62 vars in 1232 bytes} [Sat Jul 30 21:01:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:07.560429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:07.570630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:07.574741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2dc1fc92-c271-456f-ad6c-1e646bfac6d6 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:07.590083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.590739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:07.594227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.594943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:07.597966 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:07.597966 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:07.632005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2dc1fc92-c271-456f-ad6c-1e646bfac6d6 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.632694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2dc1fc92-c271-456f-ad6c-1e646bfac6d6 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:07.639244 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 HTTP/1.1 Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:07.647438 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:07.649039 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2aedf1cc-3ee3-43d6-b8d4-987236379ab2'} Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:07.649884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:07.651113 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:07.652277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:07.652277 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f1e51122-15f8-49a2-8037-3befe2e62b46 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 404 len: 111 microversion: 2.1 time: 0.099607 Jul 30 21:01:07.659973 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 80/211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:07 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:07.873582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1234570652", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:07.883939 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2dc1fc92-c271-456f-ad6c-1e646bfac6d6 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 298 microversion: 2.41 time: 0.325845 Jul 30 21:01:07.891458 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 132/212] 10.222.0.17 () {62 vars in 1232 bytes} [Sat Jul 30 21:01:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:07.898439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:07.899079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:07.913732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.914253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:07.915120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:07.916207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:08.018600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:08.563864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:08.586239 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-164c0784-8282-4b2e-a757-c36d97f52282 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1311 microversion: 2.1 time: 0.693078 Jul 30 21:01:08.588027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 133/213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:07 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1311 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:08.594748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f467271-b0e1-4cc1-801a-b9f2ff623680 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:08.599319 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:08.599319 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:08.655044 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f467271-b0e1-4cc1-801a-b9f2ff623680 tempest-AggregatesAdminTestV241-728968775 tempest-AggregatesAdminTestV241-728968775-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.065775 Jul 30 21:01:08.655931 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 134/214] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 21:01:08 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:08.667041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:08.667980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:08.682221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:08.687388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:08.688606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:08.689422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:08.715486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:08.716359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:08.716995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:08.717566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:08.718130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:08.734426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:08.738900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:08.742686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:08.744100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:08.798871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Getting quotas for project 6e222c39108c4ab787d3576d5215aeea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:08.810113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Getting quotas for user 93ee771e50474e268eae2fed07e43fe7 and project 6e222c39108c4ab787d3576d5215aeea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:08.856665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:01:08.862625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:01:08.901975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:08.918523 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82d7fb1f-2b68-4fab-bb2f-6794fffc9101 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1277 microversion: 2.1 time: 0.259698 Jul 30 21:01:08.921311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 135/215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:08 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:08.931077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b28333c8-804b-4b49-9026-b8a32096e7d9 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675538614"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:08.950396 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:08.950396 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:08.955376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-b28333c8-804b-4b49-9026-b8a32096e7d9 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid 5af04774-6eff-452e-b15d-c90cf8c06b60 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:09.022309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4d098d3-9591-47d8-af01-a56de29816a8 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153664 Jul 30 21:01:09.024348 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 81/216] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:01:09.045855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b28333c8-804b-4b49-9026-b8a32096e7d9 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.106917 Jul 30 21:01:09.057787 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 136/217] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:09.067177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5003ba8f-28de-4b18-ad83-602a45dd9f81 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:09.086591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b03ae5e6-0444-4d57-a47e-eae75ed04f61 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:09.087534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5003ba8f-28de-4b18-ad83-602a45dd9f81 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:09.106359 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:09.106359 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:09.135407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b03ae5e6-0444-4d57-a47e-eae75ed04f61 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.146162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b03ae5e6-0444-4d57-a47e-eae75ed04f61 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:09.382282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5003ba8f-28de-4b18-ad83-602a45dd9f81 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:09.395446 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5003ba8f-28de-4b18-ad83-602a45dd9f81 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1220 microversion: 2.1 time: 0.356366 Jul 30 21:01:09.411688 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 82/218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:09 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1220 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:09.451773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b03ae5e6-0444-4d57-a47e-eae75ed04f61 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.392568 Jul 30 21:01:09.452776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 137/219] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:09.467608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49d8ed69-64cf-48c4-ac2c-41508614f97e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:09.468390 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:09.468390 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:09.493740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49d8ed69-64cf-48c4-ac2c-41508614f97e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.032308 Jul 30 21:01:09.497814 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 83/220] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:01:09 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:09.510434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e89afbeb-68da-4245-90d7-5fa72699c668 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:09.519950 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:09.519950 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:09.543781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89afbeb-68da-4245-90d7-5fa72699c668 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.545210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89afbeb-68da-4245-90d7-5fa72699c668 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:09.609693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:09.610435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:09.639220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.641866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:09.645539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.646625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:09.831953 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e89afbeb-68da-4245-90d7-5fa72699c668 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.328831 Jul 30 21:01:09.833859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 138/221] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:09.846085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e2cd4fa-02e2-42d4-9d48-f92f95e6c212 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:09.851542 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:09.851542 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:09.907862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e2cd4fa-02e2-42d4-9d48-f92f95e6c212 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.061020 Jul 30 21:01:09.915679 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 139/222] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:09 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 30 21:01:09.921015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cbfcafe8-1af4-4862-b09f-8a362a8961a4 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1272050347"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:09.924005 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:09.924005 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:09.925067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-cbfcafe8-1af4-4862-b09f-8a362a8961a4 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid ffb52ca0-18a0-4c8f-b407-a296ddb97a7b for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:09.973119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cbfcafe8-1af4-4862-b09f-8a362a8961a4 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053056 Jul 30 21:01:09.974197 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 140/223] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:01:09.981758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:09.982268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:09.994417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.995976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:09.997714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:09.998692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.266321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:10.285372 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f871f6ff-4bff-48c0-bb10-c25cd1ea3c5c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1277 microversion: 2.1 time: 0.309990 Jul 30 21:01:10.288933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 141/224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:09 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:10.309822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dee11dd7-2de9-4605-b9e0-8dd598a2c3c8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:10.318730 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:10.318730 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:10.342919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee11dd7-2de9-4605-b9e0-8dd598a2c3c8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:10.350791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee11dd7-2de9-4605-b9e0-8dd598a2c3c8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.574828 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dee11dd7-2de9-4605-b9e0-8dd598a2c3c8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.284531 Jul 30 21:01:10.575917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 142/225] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:10 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:10.581307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7f6dfb64-cb7e-46d2-8b2d-ba7b99ef0bdb req-e930a7cb-b02f-476e-84e7-ebdf040c968e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad15fe6-2fb7-4526-8ed1-f013530548e1", "name": "network-vif-plugged", "status": "completed", "tag": "1460c4e5-0f29-40f5-91cf-ff3fa5ad435c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:10.593560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7f6dfb64-cb7e-46d2-8b2d-ba7b99ef0bdb req-e930a7cb-b02f-476e-84e7-ebdf040c968e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:10.594231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7f6dfb64-cb7e-46d2-8b2d-ba7b99ef0bdb req-e930a7cb-b02f-476e-84e7-ebdf040c968e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.597243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:10.608127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f4325da-de15-4586-9714-c8022d29898d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1311 microversion: 2.1 time: 1.004190 Jul 30 21:01:10.609332 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 84/226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:09 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1311 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:10.615539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:10.616542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:10.622918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7f6dfb64-cb7e-46d2-8b2d-ba7b99ef0bdb req-e930a7cb-b02f-476e-84e7-ebdf040c968e service nova] Creating event network-vif-plugged:1460c4e5-0f29-40f5-91cf-ff3fa5ad435c for instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 on nch1-master-1 Jul 30 21:01:10.625324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:10.626125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.627550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:10.628254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.628855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7f6dfb64-cb7e-46d2-8b2d-ba7b99ef0bdb req-e930a7cb-b02f-476e-84e7-ebdf040c968e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051440 Jul 30 21:01:10.629666 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 143/227] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:10.635903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ff66586-4d2e-4012-8c57-75e7ad04ceea tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:10.640775 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:10.640775 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:10.653346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ff66586-4d2e-4012-8c57-75e7ad04ceea tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:10.654103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ff66586-4d2e-4012-8c57-75e7ad04ceea tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:10.822101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:10.834823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-44555063-d402-4a46-98e2-68136d91bfd5 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1272 microversion: 2.1 time: 0.223876 Jul 30 21:01:10.836188 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 85/228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:10 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:10.912299 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ff66586-4d2e-4012-8c57-75e7ad04ceea tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.280677 Jul 30 21:01:10.918079 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 144/229] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:10 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:10.940636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53e041ac-51be-4db3-a06d-4329f848c64c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:10.942263 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:10.942263 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:10.990014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53e041ac-51be-4db3-a06d-4329f848c64c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.063647 Jul 30 21:01:10.997482 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 86/230] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:10 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:11.003639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46b72d21-9477-4753-ad8d-d2e4e7c61387 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1364906543"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.007025 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.007025 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.007521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-46b72d21-9477-4753-ad8d-d2e4e7c61387 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid 0fb0aaeb-529b-4ccd-9efb-f1e5aff9129e for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:11.056424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62b6eecf-e04d-4dc6-b10b-853506631f25 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-342122334"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.060702 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46b72d21-9477-4753-ad8d-d2e4e7c61387 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061336 Jul 30 21:01:11.061708 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 145/231] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:11.068243 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.068243 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:11.068243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.aggregate [None req-62b6eecf-e04d-4dc6-b10b-853506631f25 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid 0fa57309-8656-47d7-9246-50cca0528028 for aggregate {{(pid=130983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:11.081196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-350dad0a-aef1-4a68-9045-b78e8c61b6dc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.088311 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.088311 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.128732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-350dad0a-aef1-4a68-9045-b78e8c61b6dc tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057883 Jul 30 21:01:11.132618 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-62b6eecf-e04d-4dc6-b10b-853506631f25 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074263 Jul 30 21:01:11.132618 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 87/232] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:11.133617 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 146/233] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:11 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:11.146281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a944830-475e-4892-9f97-4043b786c08b tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.148027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ff79ec1-7633-4a4b-8223-ccd1a0b79c2c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.149383 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.149383 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.151829 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.151829 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:11.168836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:11.176374 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3ff79ec1-7633-4a4b-8223-ccd1a0b79c2c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ff79ec1-7633-4a4b-8223-ccd1a0b79c2c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Request method failure captured: Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zvhi7hecd3X-VTRqL6qqHZJVjNr_IY2GJpjOMZIXCAs8gYkwcwhEltAzufhmTPysb5-_7bSKHfrJvdLhX9ZC5Yt28Ip067yeauVptyUVWhZ1DY7nVHJ1Q7eJ2R0sU3QLOtqbTt3HO2oRhnom3q75HkFVaCEv6mJF0jruRivaFVmosI Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:11.179839 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07cebc379e1a4bd49e6538c94890489b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8334ca58e05b43a088428a5b34497444 Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: exception: Aggregate 12 could not be found. Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '12'} Jul 30 21:01:11.181049 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.181826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 30 21:01:11.182961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.183948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ff79ec1-7633-4a4b-8223-ccd1a0b79c2c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:11.183948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ff79ec1-7633-4a4b-8223-ccd1a0b79c2c tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.046460 Jul 30 21:01:11.184803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a944830-475e-4892-9f97-4043b786c08b tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.191598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a944830-475e-4892-9f97-4043b786c08b tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:11.202383 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 88/234] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:11 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:11.221018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1f6377a-9767-4500-8d8a-dfa954950ee3 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.221923 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.221923 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:11.261190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e1f6377a-9767-4500-8d8a-dfa954950ee3 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1f6377a-9767-4500-8d8a-dfa954950ee3 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Request method failure captured: Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zvhi7hecd3X-VTRqL6qqHZJVjNr_IY2GJpjOMZIXCAs8gYkwcwhEltAzufhmTPysb5-_7bSKHfrJvdLhX9ZC5Yt28Ip067yeauVptyUVWhZ1DY7nVHJ1Q7eJ2R0sU3QLOtqbTt3HO2oRhnom3q75HkFVaCEv6mJF0jruRivaFVmosI Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:11.264465 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07cebc379e1a4bd49e6538c94890489b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8334ca58e05b43a088428a5b34497444 Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: exception: Aggregate 12 could not be found. Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '12'} Jul 30 21:01:11.265731 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:11.266462 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.267594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.271995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.271995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:11.271995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:11.271995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 30 21:01:11.271995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.275197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1f6377a-9767-4500-8d8a-dfa954950ee3 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:11.277260 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1f6377a-9767-4500-8d8a-dfa954950ee3 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.073057 Jul 30 21:01:11.278631 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 89/235] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:11 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:11.322631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6eb12f85-bc0b-4d86-9df7-94e81c91bbc7 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-660104255", "name": "tempest-test_aggregate-1369575087"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.337232 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.337232 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:11.340591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.aggregate [None req-6eb12f85-bc0b-4d86-9df7-94e81c91bbc7 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid 22fb543d-687d-4029-86cf-3d4328fb9b13 for aggregate {{(pid=130983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:11.403483 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6eb12f85-bc0b-4d86-9df7-94e81c91bbc7 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.116990 Jul 30 21:01:11.408644 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 90/236] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 30 21:01:11 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:01:11.418409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.420429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:11.432976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.434240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:11.435416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.436272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:11.490205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a944830-475e-4892-9f97-4043b786c08b tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.348085 Jul 30 21:01:11.497861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 147/237] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:01:11.497861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28cabe73-e96e-467a-8097-93c9fcc9aaaf tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.497861 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.497861 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.525868 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28cabe73-e96e-467a-8097-93c9fcc9aaaf tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.033543 Jul 30 21:01:11.531210 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 148/238] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:11 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:11.541753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3975a9a4-bbee-4c77-ac33-319c9dbe8890 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.544685 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.544685 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.545682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3975a9a4-bbee-4c77-ac33-319c9dbe8890 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0e4da74f5cab4cb3b8f0cbd3a57ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603b48785619497baa6cf515d2154c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3975a9a4-bbee-4c77-ac33-319c9dbe8890 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Request method failure captured: Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 42 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvdtfLIo5sI95YSmWLnKADiA2AtmVJ2XjbXUyukjjSU-MBPYdwHHJTs6qvmCFQrog7zuudUoqndWmgtPBcxeKv5sM3a4GQknV4MM28IYtu-obE7P9nDe_zUKYOfoUccMgwI-RiW6_fBtjzUzoT0DMmG22rA4Az5da7P32JEj78rOts Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:11.547829 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/603b48785619497baa6cf515d2154c72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_603b48785619497baa6cf515d2154c72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/603b48785619497baa6cf515d2154c72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 603b48785619497baa6cf515d2154c72 Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-244405512 Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0e4da74f5cab4cb3b8f0cbd3a57ba858 Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-244405512-project Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: {"remove_host": {"host": "nch1-master-1"}} Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:11.549028 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:11.549803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 30 21:01:11.550831 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.551956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3975a9a4-bbee-4c77-ac33-319c9dbe8890 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:11.551956 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3975a9a4-bbee-4c77-ac33-319c9dbe8890 tempest-AggregatesAdminNegativeTestJSON-244405512 tempest-AggregatesAdminNegativeTestJSON-244405512-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.016957 Jul 30 21:01:11.551956 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 149/239] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:11.557742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d84a0b7c-6b54-44b0-86b0-bce22036e4ee tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.558676 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.558676 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.565617 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d84a0b7c-6b54-44b0-86b0-bce22036e4ee tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d84a0b7c-6b54-44b0-86b0-bce22036e4ee tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Request method failure captured: Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvhi7hecd3X-VTRqL6qqHZJVjNr_IY2GJpjOMZIXCAs8gYkwcwhEltAzufhmTPysb5-_7bSKHfrJvdLhX9ZC5Yt28Ip067yeauVptyUVWhZ1DY7nVHJ1Q7eJ2R0sU3QLOtqbTt3HO2oRhnom3q75HkFVaCEv6mJF0jruRivaFVmosI Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:11.568192 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07cebc379e1a4bd49e6538c94890489b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8334ca58e05b43a088428a5b34497444 Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate 14 could not be found. Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '14'} Jul 30 21:01:11.569391 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.570114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 30 21:01:11.571134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.572175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d84a0b7c-6b54-44b0-86b0-bce22036e4ee tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:11.572175 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d84a0b7c-6b54-44b0-86b0-bce22036e4ee tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.018850 Jul 30 21:01:11.572175 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 150/240] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:11 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:11.579909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b764d106-22b0-477c-9b28-3ff04aaabc50 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:11.597078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b764d106-22b0-477c-9b28-3ff04aaabc50 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.597699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b764d106-22b0-477c-9b28-3ff04aaabc50 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:11.775823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b764d106-22b0-477c-9b28-3ff04aaabc50 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.200716 Jul 30 21:01:11.777304 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 151/241] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:11.789424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0978bef7-c5ce-4eab-90dd-64f70c526037 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.790828 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:11.790828 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:11.808764 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0978bef7-c5ce-4eab-90dd-64f70c526037 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0978bef7-c5ce-4eab-90dd-64f70c526037 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Request method failure captured: Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zvhi7hecd3X-VTRqL6qqHZJVjNr_IY2GJpjOMZIXCAs8gYkwcwhEltAzufhmTPysb5-_7bSKHfrJvdLhX9ZC5Yt28Ip067yeauVptyUVWhZ1DY7nVHJ1Q7eJ2R0sU3QLOtqbTt3HO2oRhnom3q75HkFVaCEv6mJF0jruRivaFVmosI Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:11.811096 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07cebc379e1a4bd49e6538c94890489b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07cebc379e1a4bd49e6538c94890489b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 07cebc379e1a4bd49e6538c94890489b Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-850131438 Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8334ca58e05b43a088428a5b34497444 Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminTestJSON-850131438-project-admin Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: exception: Aggregate 14 could not be found. Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '14'} Jul 30 21:01:11.812391 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:11.813243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:11.814261 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:11.815414 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:11.815414 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:11.815414 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:11.815414 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 30 21:01:11.815414 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:11.817295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0978bef7-c5ce-4eab-90dd-64f70c526037 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:11.819174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0978bef7-c5ce-4eab-90dd-64f70c526037 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.039076 Jul 30 21:01:11.827386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 152/242] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:11 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:11.834244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:11.835006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:11.845502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.846057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:11.847796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:11.848353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:12.211909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:12.223222 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3c4234d-9768-4d5b-a386-b10a9f00a403 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.812790 Jul 30 21:01:12.266975 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 91/243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:11 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:12.313726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e16d09b6-7678-40b4-81fa-16940b9d3cff tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.315414 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.315414 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:12.392879 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e16d09b6-7678-40b4-81fa-16940b9d3cff tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.117120 Jul 30 21:01:12.394314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 92/244] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:12.407547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce5ade8d-9fc3-4188-ae91-a1d58b432f3a tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-20978295"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:12.417712 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.417712 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:12.421654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.aggregate [None req-ce5ade8d-9fc3-4188-ae91-a1d58b432f3a tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid d452cc99-c385-4030-9d63-ae56c0c30b24 for aggregate {{(pid=130983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:12.470877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce5ade8d-9fc3-4188-ae91-a1d58b432f3a tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071823 Jul 30 21:01:12.473555 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 93/245] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:12.484586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.490612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:12.505880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:12.506654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:12.508407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:12.511747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:12.583275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:12.597488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06ea905e-ec7f-4907-829d-aab2d1d27bee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1311 microversion: 2.1 time: 0.767914 Jul 30 21:01:12.598112 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 153/246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:11 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1311 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:12.611558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aac2cd8c-e1df-49f2-a444-31048737ca51 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1361376403"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:12.623865 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.623865 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.625145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-aac2cd8c-e1df-49f2-a444-31048737ca51 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Generated uuid d23f3fbb-c71e-46c5-be9f-05839175b446 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:12.681941 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aac2cd8c-e1df-49f2-a444-31048737ca51 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082115 Jul 30 21:01:12.686521 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 154/247] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:12.697603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd03e671-c5be-4283-bdd2-1b5eb4f645ad tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.698712 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.698712 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.711149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd03e671-c5be-4283-bdd2-1b5eb4f645ad tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 226 microversion: 2.1 time: 0.023117 Jul 30 21:01:12.720081 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 155/248] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:12 2022] GET /compute/v2.1/os-aggregates/15 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:12.733493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:12.737860 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.737860 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.763913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:12.764398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:12.782245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:12.782750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:12.813019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.compute.aggregates [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 30 21:01:12.818762 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Request method failure captured: Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 42 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvgV_S8zw2VCFfMc-szXrDpy7i8AAQsTFkf2S0rIjGLXSPp9rVEPpATlo3tb5OTwJ5TXdbkUYm7uIypkgzXJM1e5r_dJjxbL2kiBFcF62xhPSANWtx2NM6MnzY7Njfz2dNEwMt_c4n3aGrEEuFu0LtaUl-In5FFReqYI4e8Tg3B7n8 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:12.821628 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3881e3e74f1440439e1a547ca96653ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3881e3e74f1440439e1a547ca96653ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3881e3e74f1440439e1a547ca96653ca Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-20591050 Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7f4831e593d4e1591f84887c02d7d54 Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: {"remove_host": {"host": "nonexist_host"}} Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:12.824007 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot remove host nonexist_host in aggregate 16 Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Jul 30 21:01:12.825597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 30 21:01:12.827198 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.829636 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfc49e90-2068-4773-bf30-235671eb4211 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.101739 Jul 30 21:01:12.832950 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 156/249] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:12 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:12.834481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb953cf0-fa7f-4664-a032-64cde651d78e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:12.834481 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.834481 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.885699 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb953cf0-fa7f-4664-a032-64cde651d78e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 264 microversion: 2.1 time: 0.060816 Jul 30 21:01:12.886850 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 157/250] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:01:12 2022] POST /compute/v2.1/os-aggregates/15/action => generated 264 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:12.894725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c7e9662-7022-42ae-b4d8-7997878a63e4 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.896337 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.896337 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.944509 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c7e9662-7022-42ae-b4d8-7997878a63e4 tempest-AggregatesAdminNegativeTestJSON-20591050 tempest-AggregatesAdminNegativeTestJSON-20591050-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056242 Jul 30 21:01:12.948627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 158/251] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:12 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:12.953308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d5bce63-ea4c-4836-a9a0-ad5c0af73ab5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.956876 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.956876 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:12.977613 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d5bce63-ea4c-4836-a9a0-ad5c0af73ab5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 240 microversion: 2.1 time: 0.029047 Jul 30 21:01:12.980084 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 159/252] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:01:12 2022] GET /compute/v2.1/os-aggregates/15 => generated 240 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:12.991076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26726d5f-7301-4180-b4c6-d3241a722837 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:12.992118 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:12.992118 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.042430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26726d5f-7301-4180-b4c6-d3241a722837 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.053959 Jul 30 21:01:13.045994 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 160/253] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:12 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:13.058298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b93fcd2d-9d37-4bea-b81e-90c1bf007652 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-895530060", "availability_zone": "tempest-test_az-1103322805"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:13.120195 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:13.120195 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.122029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-b93fcd2d-9d37-4bea-b81e-90c1bf007652 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid d7bdf6cf-bdc1-42cc-911b-d616bd48536b for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:13.201234 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b93fcd2d-9d37-4bea-b81e-90c1bf007652 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.150482 Jul 30 21:01:13.202460 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 161/254] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 30 21:01:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:13.223487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8313432-7172-4798-a587-8e63701de8e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-895530060_new", "availability_zone": "tempest-test_az-1103322805_new"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:13.227168 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:13.227168 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.252029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:13.267888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e771616a-7448-4625-a596-f3b77f76e801 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1278 microversion: 2.1 time: 0.792438 Jul 30 21:01:13.284348 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 94/255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:12 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1278 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:13.291666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:13.292449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:13.299515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:13.300196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:13.301177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:13.301815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:13.310174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8313432-7172-4798-a587-8e63701de8e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:13.316162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8313432-7172-4798-a587-8e63701de8e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:13.403612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8313432-7172-4798-a587-8e63701de8e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.183927 Jul 30 21:01:13.407342 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 162/256] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:01:13 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:13.419221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29236e3c-577f-4002-8c91-598852ce96e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:13.420733 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:13.420733 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.455030 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29236e3c-577f-4002-8c91-598852ce96e8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.041455 Jul 30 21:01:13.456709 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 163/257] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:01:13 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:13.467211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3548344a-2b0e-4bbd-bcb2-c5d7aa79ed30 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:13.468009 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:13.468009 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.547629 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3548344a-2b0e-4bbd-bcb2-c5d7aa79ed30 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.083932 Jul 30 21:01:13.554661 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 164/258] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:13 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:13.574797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eda01fd3-9c50-4fe7-bf4a-3a2cb47432f8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1789543726"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:13.585269 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:13.585269 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:13.589505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-eda01fd3-9c50-4fe7-bf4a-3a2cb47432f8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Generated uuid 4cfaa2aa-6eb7-4038-9eaf-aa197f9d5ec4 for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:01:13.641060 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eda01fd3-9c50-4fe7-bf4a-3a2cb47432f8 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.083481 Jul 30 21:01:13.650801 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 165/259] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:01:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:13.658698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:13.660398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:13.677955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:13.678529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:13.681143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:13.682300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.148903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:14.159832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a01259cd-1951-4952-8bb2-45a5b401d95b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1493 microversion: 2.1 time: 0.513069 Jul 30 21:01:14.171918 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 166/260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:13 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1493 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:14.179881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5dc03281-c0c3-49d1-8730-193098edcd1e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.179881 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:14.179881 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:14.195038 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5dc03281-c0c3-49d1-8730-193098edcd1e tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.026925 Jul 30 21:01:14.195994 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 167/261] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:01:14 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:14.247091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:14.249605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:14.259255 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b5f740c-9b26-4dc9-a452-ab967669073f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.971582 Jul 30 21:01:14.265587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 95/262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:13 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:14.277492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f8476393-d2f7-4b59-972f-9ee9d108a4b5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.279087 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:14.279087 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:14.339763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f8476393-d2f7-4b59-972f-9ee9d108a4b5 tempest-AggregatesAdminTestJSON-850131438 tempest-AggregatesAdminTestJSON-850131438-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.072551 Jul 30 21:01:14.340601 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 96/263] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:01:14 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:14.348284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.348968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:14.363748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.367649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.368717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.369359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.473858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.475113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:14.486973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.487660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.488646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.489028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.516753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:14.546306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3c83274f-0c9a-4d64-8cb8-b691717784f4 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1278 microversion: 2.1 time: 0.204157 Jul 30 21:01:14.547530 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 97/264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:14 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:14.557717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.558826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:14.585838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.585838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.591050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.592406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.639202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] HTTP exception thrown: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Request method failure captured: Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 HTTP/1.1 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvemERGfmb-u7RBPhIRP8Y-gRfBJPajspLIdwOcKvM7pG27B52_kMaT914rR2ZNOrz1w9bzQL5Cq4YrB9acVWogatSmKvnKz-QclfkEXgAshLJUAzUB5QDYg4K7iE7SmlRfa6uzke0E4MqiHE82AHZ9FmkCyFj1Z_0xHu1bSAsxsQA Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:14.640986 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e80c1509c60d46bda7b1c4793260ab40", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f724ca9bef02478da3b1696b379dc027 Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.642489 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '019dba51-a1c1-414b-a0b3-a4d7437bcef9'} Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:14.643306 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.644611 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.649669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Returning 404 to user: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:14.649669 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7efe2fad-c35a-42e3-9ac1-dbee1ec47684 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "DELETE /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 404 len: 111 microversion: 2.1 time: 0.093648 Jul 30 21:01:14.649669 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 98/265] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:14 2022] DELETE /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:14.654258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:14.654894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] [instance: 019dba51-a1c1-414b-a0b3-a4d7437bcef9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:14.664623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.669489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.670800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.671467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.697508 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] HTTP exception thrown: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Request method failure captured: Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 HTTP/1.1 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvemERGfmb-u7RBPhIRP8Y-gRfBJPajspLIdwOcKvM7pG27B52_kMaT914rR2ZNOrz1w9bzQL5Cq4YrB9acVWogatSmKvnKz-QclfkEXgAshLJUAzUB5QDYg4K7iE7SmlRfa6uzke0E4MqiHE82AHZ9FmkCyFj1Z_0xHu1bSAsxsQA Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:14.699696 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e80c1509c60d46bda7b1c4793260ab40", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e80c1509c60d46bda7b1c4793260ab40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e80c1509c60d46bda7b1c4793260ab40 Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1408518342 Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f724ca9bef02478da3b1696b379dc027 Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AggregatesAdminTestJSON-1408518342-project Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.700901 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '019dba51-a1c1-414b-a0b3-a4d7437bcef9'} Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:14.701535 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. Jul 30 21:01:14.702555 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:14.704536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] Returning 404 to user: Instance 019dba51-a1c1-414b-a0b3-a4d7437bcef9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:14.704536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6425930-243c-4f77-a08d-ece79cc94fc5 tempest-AggregatesAdminTestJSON-1408518342 tempest-AggregatesAdminTestJSON-1408518342-project] 10.222.0.17 "GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9" status: 404 len: 111 microversion: 2.1 time: 0.051526 Jul 30 21:01:14.704536 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 99/266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:14 2022] GET /compute/v2.1/servers/019dba51-a1c1-414b-a0b3-a4d7437bcef9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:01:14.730453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-148c1b08-1f56-4f7f-be39-1a4c02d6b2ed req-3ec1b889-0db5-4859-b762-f93fa89fb970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46", "tag": "919322c4-fc9d-41b5-81f9-b7a0ccfb3031"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:14.747703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-148c1b08-1f56-4f7f-be39-1a4c02d6b2ed req-3ec1b889-0db5-4859-b762-f93fa89fb970 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:14.748165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-148c1b08-1f56-4f7f-be39-1a4c02d6b2ed req-3ec1b889-0db5-4859-b762-f93fa89fb970 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:14.787651 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-148c1b08-1f56-4f7f-be39-1a4c02d6b2ed req-3ec1b889-0db5-4859-b762-f93fa89fb970 service nova] Creating event network-changed:919322c4-fc9d-41b5-81f9-b7a0ccfb3031 for instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 on nch1-master-1 Jul 30 21:01:14.798462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-148c1b08-1f56-4f7f-be39-1a4c02d6b2ed req-3ec1b889-0db5-4859-b762-f93fa89fb970 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076797 Jul 30 21:01:14.806780 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 100/267] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:15.265851 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5679c912-033c-4a6b-956e-c8d04a4569c2 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1644 microversion: 2.1 time: 1.063036 Jul 30 21:01:15.265851 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 168/268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:14 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1644 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:15.288204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:15.288926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:15.291709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:15.292522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:15.298872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.300298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:15.302850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.303254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:15.303418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.303888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:15.304086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.304533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:15.406420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:15.649383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:15.661383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ac75518-3526-4c8a-85d2-78fac6708467 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.378587 Jul 30 21:01:15.662826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 101/269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:15 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:15.675875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:15.678256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:15.695894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.696366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:15.699507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:15.700036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:16.286586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:16.298469 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d467da7-6ee9-4c5d-9159-6ffeceeb54c1 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.632478 Jul 30 21:01:16.299899 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 102/270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:15 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:16.596662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1048931316", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:16.706350 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-263d2749-836b-4afe-a88c-e84de2737bef tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1644 microversion: 2.1 time: 1.418267 Jul 30 21:01:16.706913 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 169/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:15 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1644 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:16.728607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] validate_networks() for [('f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:16.746358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:16.750080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:16.766764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:16.767312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:16.773692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:16.774305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:17.617046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:17.628706 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-490d85b2-4e75-461d-ac79-bbbcb084ee76 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.890636 Jul 30 21:01:17.630052 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 170/272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:16 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:17.643173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:17.648721 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:17.648721 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:17.650083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:17.650551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:17.651385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:17.651845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:17.707900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:17.769640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-56210f56-3bd6-4a98-b7ae-62d23462187c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138483 Jul 30 21:01:17.774986 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 171/273] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:01:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:17.794668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:17.795314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:17.812339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:17.812941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:17.813736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:17.814180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:17.855728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:18.211338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:18.220823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e88d386a-c71f-4dd4-b0a1-ba62a87319dd tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.433231 Jul 30 21:01:18.221405 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 172/274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:17 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:18.233074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:18.237989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:18.252145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.252772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.254173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.254922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.282958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lazy-loading 'flavor' on Instance uuid 5ad15fe6-2fb7-4526-8ed1-f013530548e1 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:18.296794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Going to try to live migrate instance to nch2-master-1 {{(pid=130984) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:01:18.596489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:18.596998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:18.597550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:18.598027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:18.598528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:18.616989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.619410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.622882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.623405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.674518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:18.687720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for user 46d7264a2f63436bb8519cd8cec6d9f5 and project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:18.699173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:18.725400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:01:18.729986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:01:18.835581 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e93aca1c-5d06-4e3a-9c10-e18a956b29f0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.531562 Jul 30 21:01:18.839567 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 103/275] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:01:18.875777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-226d1195-70d6-45f4-be1c-29e42754004c req-6cdee0c5-8335-4cdd-8120-26d494d2e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e517c83e-05d9-4d90-a208-56a25c3f2fb7", "tag": "2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:18.899675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-226d1195-70d6-45f4-be1c-29e42754004c req-6cdee0c5-8335-4cdd-8120-26d494d2e4ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.908042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-226d1195-70d6-45f4-be1c-29e42754004c req-6cdee0c5-8335-4cdd-8120-26d494d2e4ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.932616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-226d1195-70d6-45f4-be1c-29e42754004c req-6cdee0c5-8335-4cdd-8120-26d494d2e4ba service nova] Creating event network-changed:2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce for instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 on nch2-master-1 Jul 30 21:01:18.945016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-226d1195-70d6-45f4-be1c-29e42754004c req-6cdee0c5-8335-4cdd-8120-26d494d2e4ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104198 Jul 30 21:01:18.948655 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 104/276] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:18.954364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:18.960615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:18.975533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.977236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:18.980780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:18.983934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:19.303011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:19.311891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95488827-cd1d-4e2e-9f7e-8390f5544b9f tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.361730 Jul 30 21:01:19.314908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 105/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:18 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:19.892792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:19.894865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:19.895452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:19.897323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:19.898056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:19.971609 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4086946-75e3-4d46-ac42-f84aa691b63f tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.654392 Jul 30 21:01:19.980385 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 106/278] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 30 21:01:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:19.985721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:19.986581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:20.010225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.012229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.013226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.013820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.146491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:20.162656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:20.172434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:20.180136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-66a5b381-8668-4140-a1fb-e4d0cf826cac tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1266 microversion: 2.25 time: 0.193800 Jul 30 21:01:20.181806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 107/279] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:19 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:20.197446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:20.201723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:20.234630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.246463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.247851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.248490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.558786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:20.572250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15d17bbf-0f90-45dc-862a-5a031574e2cc tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.388602 Jul 30 21:01:20.578758 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 108/280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:20 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:20.598164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:20.601868 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:20.601868 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:20.605281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.609671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.610903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.611683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.692016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-377497f6-3ac2-4e65-82ab-cb99dc6b146c tempest-AZAdminV2TestJSON-1918355479 tempest-AZAdminV2TestJSON-1918355479-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.098603 Jul 30 21:01:20.700716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 109/281] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:01:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:20.715836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:20.717106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:20.727273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.730980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:20.743540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:20.744329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:21.094403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:21.109051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd925a92-d120-4836-a57c-28a28b332668 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.406933 Jul 30 21:01:21.111445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 110/282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:20 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:21.203922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:21.204545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:21.215794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:21.217732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:21.222975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:21.224048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:21.482713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:21.495624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:21.497528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:21.512739 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e50d09c9-ea6e-4848-a090-8568be01b10c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1314 microversion: 2.25 time: 0.312538 Jul 30 21:01:21.520832 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 111/283] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:21 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:01:21.598177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:21.599029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:21.618065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:21.622687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:21.624060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:21.624514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:21.952373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:21.964998 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ffb19cbf-0c70-4662-b704-7b719e7e4716 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.370874 Jul 30 21:01:21.979375 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 112/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:21 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:22.137406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:22.138702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:22.152959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:22.154274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:22.156150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:22.157612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:22.990811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:23.003082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d672d927-1487-4544-a99f-60e8523a5af1 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.874239 Jul 30 21:01:23.005084 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 113/285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:22 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:23.021145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:23.023384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:23.036561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:23.037252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:23.041417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:23.042062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:23.586564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:23.602248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:23.604510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:23.608415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-812d0293-69c8-4135-8e71-fbbc25543ca4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.598810 Jul 30 21:01:23.612372 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 114/286] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:23 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:24.045603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad504571-b851-451d-940c-6cc499884853 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-935567338", "id": 546031420, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:24.049766 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:24.049766 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:24.086482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad504571-b851-451d-940c-6cc499884853 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.472615 Jul 30 21:01:24.090908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 115/287] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:01:23 2022] POST /compute/v2.1/flavors => generated 464 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:24.102235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:24.103202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:24.118470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.119241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:24.120438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.120966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:24.184524 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-32ae5a11-c413-4fdc-a003-06984ff1fed8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1/action" status: 202 len: 0 microversion: 2.1 time: 5.959117 Jul 30 21:01:24.192483 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 173/288] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:01:18 2022] POST /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1/action => generated 0 bytes in 5968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:01:24.203720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:24.204727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:24.229097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.229857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:24.230995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.231698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:24.588372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:24.601106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56c365ae-3152-4b4c-8264-d15c15f67614 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.506027 Jul 30 21:01:24.604097 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 116/289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:24 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:24.627276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:24.646202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28cc5048-a202-41db-9ab7-07844fea207c tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.451610 Jul 30 21:01:24.650018 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 174/290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:24 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:24.666424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:24.667490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:24.680173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.682522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:24.685053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:24.685682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.065328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad29ec7e-c7d5-41b1-98b9-894148f1aa07 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.084804 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad29ec7e-c7d5-41b1-98b9-894148f1aa07 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] 10.222.0.17 "GET /compute/v2.1/flavors/546031420" status: 200 len: 464 microversion: 2.61 time: 0.478076 Jul 30 21:01:25.092826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 117/291] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 30 21:01:24 2022] GET /compute/v2.1/flavors/546031420 => generated 464 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:25.108565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.109501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:25.119015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.119907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.121243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.121894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.316595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:25.336917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1aecd09-e89c-4878-af01-a88298f834dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.684565 Jul 30 21:01:25.340330 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 175/292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:24 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:25.367205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b8e41825-ae59-4e51-8c41-7d046f948038 req-7b5daeea-a157-4b2b-8f8f-599c02db9ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16030f4a-b40f-49fd-827f-c09a808c0e3e", "tag": "02cde323-6cb5-4de7-99ed-54209e847243"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:25.389541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b8e41825-ae59-4e51-8c41-7d046f948038 req-7b5daeea-a157-4b2b-8f8f-599c02db9ce8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.389758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b8e41825-ae59-4e51-8c41-7d046f948038 req-7b5daeea-a157-4b2b-8f8f-599c02db9ce8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.437243 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b8e41825-ae59-4e51-8c41-7d046f948038 req-7b5daeea-a157-4b2b-8f8f-599c02db9ce8 service nova] Creating event network-changed:02cde323-6cb5-4de7-99ed-54209e847243 for instance 16030f4a-b40f-49fd-827f-c09a808c0e3e on nch2-master-1 Jul 30 21:01:25.453022 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b8e41825-ae59-4e51-8c41-7d046f948038 req-7b5daeea-a157-4b2b-8f8f-599c02db9ce8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106224 Jul 30 21:01:25.453788 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 176/293] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:25.468788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a2830166-48d2-460e-90da-a3c605776eef req-8209f9dc-ae3b-430c-b2b8-ad7af6d020fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46", "name": "network-vif-plugged", "status": "completed", "tag": "919322c4-fc9d-41b5-81f9-b7a0ccfb3031"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:25.468929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:25.477550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:25.479075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:25.480217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c766988d-951c-4a42-99e5-268edd99949d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.384328 Jul 30 21:01:25.504078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a2830166-48d2-460e-90da-a3c605776eef req-8209f9dc-ae3b-430c-b2b8-ad7af6d020fd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.505032 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 118/294] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:25 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:25.507070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a2830166-48d2-460e-90da-a3c605776eef req-8209f9dc-ae3b-430c-b2b8-ad7af6d020fd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.512927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13ebe631-0a9a-49b9-b756-be23616d2b5a tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5fdd5e50>, body: {"flavor": {"description": "new"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:25.524869 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:25.524869 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:25.537441 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a2830166-48d2-460e-90da-a3c605776eef req-8209f9dc-ae3b-430c-b2b8-ad7af6d020fd service nova] Creating event network-vif-plugged:919322c4-fc9d-41b5-81f9-b7a0ccfb3031 for instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 on nch1-master-1 Jul 30 21:01:25.547192 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a2830166-48d2-460e-90da-a3c605776eef req-8209f9dc-ae3b-430c-b2b8-ad7af6d020fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088458 Jul 30 21:01:25.548044 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 177/295] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:25.562630 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13ebe631-0a9a-49b9-b756-be23616d2b5a tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/546031420" status: 200 len: 465 microversion: 2.61 time: 0.056340 Jul 30 21:01:25.571860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 119/296] 10.222.0.17 () {62 vars in 1216 bytes} [Sat Jul 30 21:01:25 2022] PUT /compute/v2.1/flavors/546031420 => generated 465 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:25.585967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53fee7b5-183b-46ab-b1fd-748a9089b931 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.623058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.623930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:25.645242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.651027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53fee7b5-183b-46ab-b1fd-748a9089b931 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.077387 Jul 30 21:01:25.651751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.652036 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 178/297] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:01:25 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:25.668336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.672022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.672691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.673158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:25.688509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.690483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.695408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:25.696221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:25.928680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:25.941637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55b92969-2840-4295-8902-54db01a4b561 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.323165 Jul 30 21:01:25.956246 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 120/298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:25 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:25.963390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63114d29-9959-4f89-86cd-e5d5f2d7ca89 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:25.987888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63114d29-9959-4f89-86cd-e5d5f2d7ca89 tempest-FlavorsV261TestJSON-288074579 tempest-FlavorsV261TestJSON-288074579-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.030095 Jul 30 21:01:25.989632 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 121/299] 10.222.0.17 () {60 vars in 1166 bytes} [Sat Jul 30 21:01:25 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:26.005445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-978bf149-eaeb-444e-b206-d4f2b9410072 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:26.012012 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:26.012012 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:26.030755 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-978bf149-eaeb-444e-b206-d4f2b9410072 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/546031420" status: 202 len: 0 microversion: 2.61 time: 0.029191 Jul 30 21:01:26.031784 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 122/300] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 30 21:01:26 2022] DELETE /compute/v2.1/flavors/546031420 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:26.044541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-613dc7b3-f6c4-4b15-92ac-9162566bbbc1 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:26.074800 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-613dc7b3-f6c4-4b15-92ac-9162566bbbc1 tempest-FlavorsV261TestJSON-1940921945 tempest-FlavorsV261TestJSON-1940921945-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.038640 Jul 30 21:01:26.075819 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 123/301] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:01:26 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:01:26.361309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:26.362331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:26.371140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.376434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:26.377575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.378185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:26.395986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:26.432226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:26.440506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d02e29af-3519-4934-ae41-ed634a611d90 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.774290 Jul 30 21:01:26.447001 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 179/302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:25 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:26.519564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:26.520600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:26.532278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.533339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:26.534814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.535661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:26.835545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:26.852475 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf877f96-24d7-4a7d-9ae2-bf6c45fb5c8f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.495157 Jul 30 21:01:26.853351 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 124/303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:26 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:26.967928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:26.968544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:26.984253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.984723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:26.985526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:26.985984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:27.039176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:27.050334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:27.053838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:27.056772 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42667d74-0a09-41b4-b883-321e95d8f4fa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.543594 Jul 30 21:01:27.060169 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 180/304] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:26 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:01:27.473899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:27.474776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:27.500082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:27.501240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:27.502198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:27.502986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:27.604099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:27.613406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c55f4f1-c1bd-4212-b1f4-541d5b4d503f tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.649885 Jul 30 21:01:27.614898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 125/305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:26 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:27.696937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:27.894610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:27.908169 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-420a20fe-650e-4511-956c-a87fca5fcf78 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1319 microversion: 2.1 time: 0.441676 Jul 30 21:01:27.912579 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 181/306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:27 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:27.924988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-df2502fe-67a7-4e9f-9162-71ccf650e3c4 req-65976815-725c-453e-9faa-c1fd6269a024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e517c83e-05d9-4d90-a208-56a25c3f2fb7", "name": "network-vif-plugged", "status": "completed", "tag": "2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:27.946525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df2502fe-67a7-4e9f-9162-71ccf650e3c4 req-65976815-725c-453e-9faa-c1fd6269a024 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:27.949907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df2502fe-67a7-4e9f-9162-71ccf650e3c4 req-65976815-725c-453e-9faa-c1fd6269a024 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:27.976064 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-df2502fe-67a7-4e9f-9162-71ccf650e3c4 req-65976815-725c-453e-9faa-c1fd6269a024 service nova] Creating event network-vif-plugged:2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce for instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 on nch2-master-1 Jul 30 21:01:27.983834 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-df2502fe-67a7-4e9f-9162-71ccf650e3c4 req-65976815-725c-453e-9faa-c1fd6269a024 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069555 Jul 30 21:01:27.985151 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 182/307] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:27.998070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2535b3f2-bda1-4bf1-81ea-bac840b5b143 tempest-AZAdminNegativeTestJSON-629241006 tempest-AZAdminNegativeTestJSON-629241006-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:28.000354 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:28.000354 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:28.001576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2535b3f2-bda1-4bf1-81ea-bac840b5b143 tempest-AZAdminNegativeTestJSON-629241006 tempest-AZAdminNegativeTestJSON-629241006-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '966cb451debd4586864e543000824981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32746695eeb9487a94bf759ac613da59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2535b3f2-bda1-4bf1-81ea-bac840b5b143 tempest-AZAdminNegativeTestJSON-629241006 tempest-AZAdminNegativeTestJSON-629241006-project] Request method failure captured: Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zwm2llHpd87JBnCa37cwjzEldRuLIrV_FHyzZS5jQOVu6Od8zUkhr8M48zJf4X0ozZsHV10D6ysBC0qkqta1WdU0P7Que2PQnxFCXzwsMEt8XImfoVsgcCS5I9rN1ceI1UpDUKcGzKfh4VhTcBcLMg_lTu6ARqCuL2C44rDiMxKwhw Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 32746695eeb9487a94bf759ac613da59 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AZAdminNegativeTestJSON-629241006 Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:28.005851 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/32746695eeb9487a94bf759ac613da59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_32746695eeb9487a94bf759ac613da59", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/32746695eeb9487a94bf759ac613da59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/32746695eeb9487a94bf759ac613da59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AZAdminNegativeTestJSON-629241006 Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 32746695eeb9487a94bf759ac613da59 Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-629241006 Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AZAdminNegativeTestJSON-629241006-project Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 966cb451debd4586864e543000824981 Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AZAdminNegativeTestJSON-629241006-project Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 30 21:01:28.007111 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:28.007818 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 30 21:01:28.008914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:28.011758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2535b3f2-bda1-4bf1-81ea-bac840b5b143 tempest-AZAdminNegativeTestJSON-629241006 tempest-AZAdminNegativeTestJSON-629241006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:28.014855 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2535b3f2-bda1-4bf1-81ea-bac840b5b143 tempest-AZAdminNegativeTestJSON-629241006 tempest-AZAdminNegativeTestJSON-629241006-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.398651 Jul 30 21:01:28.024084 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 126/308] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:01:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 407 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:28.026452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8a61f315-9594-40e3-9181-1ab221d48668 req-9e7f7ab0-94a2-41b4-80ae-c0c1dfcfacc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad15fe6-2fb7-4526-8ed1-f013530548e1", "name": "network-vif-unplugged", "status": "completed", "tag": "1460c4e5-0f29-40f5-91cf-ff3fa5ad435c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:28.030438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:28.043724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:28.063869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a61f315-9594-40e3-9181-1ab221d48668 req-9e7f7ab0-94a2-41b4-80ae-c0c1dfcfacc6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.068170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a61f315-9594-40e3-9181-1ab221d48668 req-9e7f7ab0-94a2-41b4-80ae-c0c1dfcfacc6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.070342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.071112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.072197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.075008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.124194 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8a61f315-9594-40e3-9181-1ab221d48668 req-9e7f7ab0-94a2-41b4-80ae-c0c1dfcfacc6 service nova] Creating event network-vif-unplugged:1460c4e5-0f29-40f5-91cf-ff3fa5ad435c for instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 on nch1-master-1 Jul 30 21:01:28.146076 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8a61f315-9594-40e3-9181-1ab221d48668 req-9e7f7ab0-94a2-41b4-80ae-c0c1dfcfacc6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154306 Jul 30 21:01:28.146814 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 183/309] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:28.173671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:28.177685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:28.196095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.205836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.209946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.210792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.511957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:28.531275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:28.533532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:28.534672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35cb38a5-6d16-4d6e-9c45-b11a8dede231 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.384183 Jul 30 21:01:28.535560 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 184/310] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:28 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:28.616536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:28.628044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe270da2-7889-4d24-8a68-3d7a8749fa09 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.602092 Jul 30 21:01:28.637006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:28.637687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:28.641431 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 127/311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:28 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:28.652077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.652548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.653512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.654215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.930365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:28.931309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:28.936201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=18 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:28.940459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.941003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:28.942394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:28.943100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.010766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:29.026929 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45d0ed4c-6e6c-42bf-ae24-422d4ab3020a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1320 microversion: 2.1 time: 0.394282 Jul 30 21:01:29.028433 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 185/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:28 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:29.409767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:29.426080 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6bdbcd6f-69b7-4046-86d7-3f5c1d97b49a tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1469 microversion: 2.1 time: 0.499787 Jul 30 21:01:29.446383 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 128/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:28 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1469 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:29.463710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:29.464978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:29.476344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.479667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.481894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.486431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.545701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lazy-loading 'flavor' on Instance uuid bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:29.559249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:29.560933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:29.574469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.576937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.578043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.578665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.798847 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f3a1421-90eb-4e2e-9d1a-fc527255f33e tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46/action" status: 202 len: 0 microversion: 2.1 time: 0.338832 Jul 30 21:01:29.799860 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 186/314] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:01:29 2022] POST /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:01:29.833961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:29.835482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:29.855905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.856683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:29.857703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:29.858332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.055259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.073354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.074889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.090234 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a59839dd-53e8-4207-b5e9-4afe8a1442a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.536323 Jul 30 21:01:30.090826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 129/315] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:29 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:30.130606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:30.131102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:30.141151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.150510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.151624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.157090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.194146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.203603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44c65271-0134-41e3-91e6-95616e5f39de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.401271 Jul 30 21:01:30.228976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 187/316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:29 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:30.233912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:30.234672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:30.247386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.247991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.248674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.249122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.573094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.587789 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a85ad79f-4b08-427e-ad84-ff22596db142 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1470 microversion: 2.1 time: 0.357500 Jul 30 21:01:30.588926 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 188/317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:30 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:30.607750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a6126e1b-13b4-4bd1-bc6f-ddb0a7e2d00c req-5548ecce-8de4-46c0-b517-2f8a7eec13ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad15fe6-2fb7-4526-8ed1-f013530548e1", "tag": "1460c4e5-0f29-40f5-91cf-ff3fa5ad435c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:30.630760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.631385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a6126e1b-13b4-4bd1-bc6f-ddb0a7e2d00c req-5548ecce-8de4-46c0-b517-2f8a7eec13ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.631385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a6126e1b-13b4-4bd1-bc6f-ddb0a7e2d00c req-5548ecce-8de4-46c0-b517-2f8a7eec13ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.636588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:30.644885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:30.651840 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a6126e1b-13b4-4bd1-bc6f-ddb0a7e2d00c req-5548ecce-8de4-46c0-b517-2f8a7eec13ec service nova] Creating event network-changed:1460c4e5-0f29-40f5-91cf-ff3fa5ad435c for instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 on nch1-master-1 Jul 30 21:01:30.653445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81cddb71-9e0f-422e-88c8-563ccdf7b700 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1477 microversion: 2.1 time: 0.541712 Jul 30 21:01:30.657097 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 130/318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:30 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1477 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:30.658799 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a6126e1b-13b4-4bd1-bc6f-ddb0a7e2d00c req-5548ecce-8de4-46c0-b517-2f8a7eec13ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Jul 30 21:01:30.659570 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 189/319] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:30.679809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:30.687973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:30.698832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.702999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.708568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.709098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.921459 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e6acc00-0795-4835-bbcf-543ded4a7fc2 tempest-DeleteServersAdminTestJSON-1457764734 tempest-DeleteServersAdminTestJSON-1457764734-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.262110 Jul 30 21:01:30.923452 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 131/320] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:01:30 2022] POST /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:01:30.935578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:30.939730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:30.961800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.963466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:30.964737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:30.965884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.046588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.048597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.051926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lazy-loading 'fault' on Instance uuid e517c83e-05d9-4d90-a208-56a25c3f2fb7 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:31.118497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:31.119236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:31.133047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.138808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.143455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.145976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.750751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:31.772690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:31.782610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:31.786806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-91933c8a-dc69-476d-b141-9bb4f5791d8d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.672583 Jul 30 21:01:31.788482 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 132/321] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:31 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:01:31.801601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:31.803388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:31.805601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:31.821007 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7838e17f-639f-4195-ac97-ece55761d82e tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1453 microversion: 2.1 time: 0.893104 Jul 30 21:01:31.821662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.825652 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 190/322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:30 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1453 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:31.831833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:31.836528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:31.840773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.847989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.849552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.854163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.854670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:31.857009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:31.863846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.252370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:32.264832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-afd92a16-dfbd-4b7a-baa2-6db7d0a59779 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1460 microversion: 2.1 time: 0.437764 Jul 30 21:01:32.267650 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 191/323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:31 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1460 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:32.279925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:32.280770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:32.289522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.290186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.291199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.292241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.334368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:01:32.583600 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-511c1dc3-1898-4103-84ef-9ce6fe1d0b18 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 204 len: 0 microversion: 2.1 time: 0.313837 Jul 30 21:01:32.584205 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 192/324] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:32 2022] DELETE /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:32.599599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-23fc0f7c-19f9-4eba-9012-7494d4ab2d92 req-fc99f46a-e669-4493-b734-b34968152223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16030f4a-b40f-49fd-827f-c09a808c0e3e", "name": "network-vif-plugged", "status": "completed", "tag": "02cde323-6cb5-4de7-99ed-54209e847243"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:32.610227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-23fc0f7c-19f9-4eba-9012-7494d4ab2d92 req-fc99f46a-e669-4493-b734-b34968152223 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.610956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-23fc0f7c-19f9-4eba-9012-7494d4ab2d92 req-fc99f46a-e669-4493-b734-b34968152223 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.622995 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-23fc0f7c-19f9-4eba-9012-7494d4ab2d92 req-fc99f46a-e669-4493-b734-b34968152223 service nova] Creating event network-vif-plugged:02cde323-6cb5-4de7-99ed-54209e847243 for instance 16030f4a-b40f-49fd-827f-c09a808c0e3e on nch2-master-1 Jul 30 21:01:32.633456 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-23fc0f7c-19f9-4eba-9012-7494d4ab2d92 req-fc99f46a-e669-4493-b734-b34968152223 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046559 Jul 30 21:01:32.634610 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 193/325] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:32.646775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:32.652935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:32.668023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.669402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.672319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.674456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.873565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:32.885747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c563d60d-49f0-451e-ab80-6615d584c083 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 1.093395 Jul 30 21:01:32.887971 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 133/326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:31 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:32.897748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:32.898679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:32.906172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.906903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.908331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.909185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.955095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:32.956539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:32.957906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lazy-loading 'fault' on Instance uuid e517c83e-05d9-4d90-a208-56a25c3f2fb7 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:33.080762 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37ee8a57-078d-4b48-917e-f9497e787fce tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1611 microversion: 2.1 time: 0.443947 Jul 30 21:01:33.081359 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 194/327] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:32 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1611 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:33.094502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:33.095632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:33.111390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.112211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.113521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.114398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.333317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:33.346302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:33.349137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:33.350794 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fcfad41e-5b4a-4caf-b44e-f2fb3d2d8dc2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.265430 Jul 30 21:01:33.352668 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 195/328] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:33 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:33.357790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:33.360757 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:33.360757 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:33.362509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.363136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.364520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.365711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.407940 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-13b08d81-7bbc-4ab9-a03f-150310cea4eb tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053938 Jul 30 21:01:33.408920 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 196/329] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:01:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:33.432444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:33.444998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:33.465878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.466391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.467246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.467771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.528640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Lazy-loading 'flavor' on Instance uuid bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:33.543673 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 while it is in vm_state suspended Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Request method failure captured: Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46/action HTTP/1.1 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 97 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvyBG1NbbUB2p5HiYFa7a_0bXv6u6R_h-kyU82o6I71HF4E-N7cfM1vkjZ8xLNdEDQVLWCmweo_8caDCXqmTLFVNxPxAMboC_knrXEQxvTIfq4maNu67cGtiAt00nZbNOkqDqKf9wXeWfMOr3TMDKAbQOyuDczEswwA2ZR_cE0YEVU Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b93ad6350bfb456dbee1e76756e6b178 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:33.546906 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b93ad6350bfb456dbee1e76756e6b178", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b93ad6350bfb456dbee1e76756e6b178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b93ad6350bfb456dbee1e76756e6b178 Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-471814438 Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveMigrationNegativeTest-471814438-project-admin Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d75b01a28d5c40cb8f6570015c7cb807 Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveMigrationNegativeTest-471814438-project-admin Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Jul 30 21:01:33.548290 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'os-migrateLive' instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 while it is in vm_state suspended Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 30 21:01:33.549000 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:33.550023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 while it is in vm_state suspended Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 while it is in vm_state suspended Jul 30 21:01:33.551189 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:33.554468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 while it is in vm_state suspended {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:33.555640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ecf881f7-199c-4961-8bfc-b53a1b4b46b5 tempest-LiveMigrationNegativeTest-471814438 tempest-LiveMigrationNegativeTest-471814438-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46/action" status: 409 len: 155 microversion: 2.1 time: 0.137052 Jul 30 21:01:33.556755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 197/330] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:01:33 2022] POST /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46/action => generated 155 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:33.558187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:33.573475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:33.574412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:33.575654 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4187a619-9bce-44be-85e8-1a145623589a tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1459 microversion: 2.1 time: 0.683187 Jul 30 21:01:33.587393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.589859 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 134/331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:32 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1459 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:33.590810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.592017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.594830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.689981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:01:33.862218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-99d28a89-74e6-441f-831f-87c7858dffae tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 204 len: 0 microversion: 2.1 time: 0.293105 Jul 30 21:01:33.866748 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 198/332] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:33 2022] DELETE /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:33.872921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:33.873942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:33.885757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.886293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:33.887429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:33.887567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.295330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Calling method '.version_select at 0x7fbb5dab5dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:34.298147 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:34.298147 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:34.299478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.299947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.305905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.306049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.306511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.325813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e76a17ee-7479-4f4f-ae90-4f956e6953f7 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1466 microversion: 2.1 time: 0.453169 Jul 30 21:01:34.326384 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 199/333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:33 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1466 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:34.335751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:34.336377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:34.366998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.370082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.371776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.376004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.411922 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-00b6c495-01a1-498a-a1a8-8b3cb64c905e tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.810552 Jul 30 21:01:34.426412 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 135/334] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:01:33 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:34.438630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:34.443054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:34.463038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.463955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.464982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.469113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.656944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.666775 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-185dae98-b94a-4495-84bf-261182c9a788 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.339476 Jul 30 21:01:34.682347 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 200/335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:34 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:34.847096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.864383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.868166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.875059 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ad0d163-18f8-45ae-b50d-10e09cca30f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1362 microversion: 2.25 time: 0.443673 Jul 30 21:01:34.875922 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 136/336] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:34 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:34.925199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e6441d0e-64a1-4d62-9e7b-dc82af5ca50e tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Calling method '.version_select at 0x7fbb5d690ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:34.928505 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:34.928505 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:34.929662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e6441d0e-64a1-4d62-9e7b-dc82af5ca50e tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e6441d0e-64a1-4d62-9e7b-dc82af5ca50e tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:34.936618 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:01:34.938206 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:34.939144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 30 21:01:34.944756 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:34.946137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e6441d0e-64a1-4d62-9e7b-dc82af5ca50e tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:34.946137 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e6441d0e-64a1-4d62-9e7b-dc82af5ca50e tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.254425 Jul 30 21:01:34.946137 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 201/337] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:01:34 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:34.946137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:34.946137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:34.967329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.969842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:34.970652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:34.971101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:35.044936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:35.045449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:35.045987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lazy-loading 'fault' on Instance uuid e517c83e-05d9-4d90-a208-56a25c3f2fb7 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:35.192699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8bb8f678-42da-4cd9-9d06-9ce5c72d1ef0 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Calling method '.version_select at 0x7fbb5da57700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:35.428790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ee771e50474e268eae2fed07e43fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e222c39108c4ab787d3576d5215aeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:35.439596 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c550d19-c750-47d8-b496-c2cfdc3b1aee tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 200 len: 1459 microversion: 2.1 time: 0.495367 Jul 30 21:01:35.440493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 202/338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:34 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 1459 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:35.449095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9c61803-02c6-4bc9-9c5d-d9b44eef93b2 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Calling method '.version_select at 0x7fbb5d690430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:35.452114 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:35.452114 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:35.454067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c9c61803-02c6-4bc9-9c5d-d9b44eef93b2 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9c61803-02c6-4bc9-9c5d-d9b44eef93b2 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:35.459018 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1'} Jul 30 21:01:35.460394 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:35.461113 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 30 21:01:35.462166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.463116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9c61803-02c6-4bc9-9c5d-d9b44eef93b2 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:35.463116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9c61803-02c6-4bc9-9c5d-d9b44eef93b2 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018769 Jul 30 21:01:35.466288 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 203/339] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:01:35 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:35.476719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:35.477701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:35.486042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:35.486853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:35.488018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:35.489620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:35.537076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:35.552664 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8bb8f678-42da-4cd9-9d06-9ce5c72d1ef0 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 371 microversion: 2.1 time: 0.672666 Jul 30 21:01:35.553401 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 137/340] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:01:34 2022] GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 371 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:35.573315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f3b28cd-2ff2-4ebc-92c0-e32ddfb7522c tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Calling method '.version_select at 0x7fbb5da3bdc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:35.574295 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:35.574295 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:35.607493 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3f3b28cd-2ff2-4ebc-92c0-e32ddfb7522c tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f3b28cd-2ff2-4ebc-92c0-e32ddfb7522c tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:35.610631 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'nonexistent_hostname'} Jul 30 21:01:35.612114 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:35.612998 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 30 21:01:35.614327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:35.615748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:35.618355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f3b28cd-2ff2-4ebc-92c0-e32ddfb7522c tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:35.621416 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f3b28cd-2ff2-4ebc-92c0-e32ddfb7522c tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.058876 Jul 30 21:01:35.628743 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 138/341] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Jul 30 21:01:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:35.635451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5da4e280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:36.067348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.068387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.073073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.073912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.167246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.176409 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e27c6a67-318c-4bd1-83e5-338601e9805b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1466 microversion: 2.1 time: 0.703804 Jul 30 21:01:36.177901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1f28751-15be-4ef1-b5a4-0d6abdad2b74 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 328 microversion: 2.1 time: 0.541003 Jul 30 21:01:36.179155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 139/342] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:35 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 328 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:36.182739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 204/343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:35 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1466 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:36.184258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f536fe60-1927-45d4-a3ba-b8472a9f9d7a req-0ba96220-565b-4106-9832-ce1ae0e048c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e517c83e-05d9-4d90-a208-56a25c3f2fb7", "name": "network-vif-deleted", "tag": "2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:36.209974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98ceb11f-4580-49ec-a5b2-a895f7ebe726 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Calling method '.version_select at 0x7fbb5d6d1b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.210866 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:36.210866 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:36.213609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98ceb11f-4580-49ec-a5b2-a895f7ebe726 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98ceb11f-4580-49ec-a5b2-a895f7ebe726 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:36.218475 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1'} Jul 30 21:01:36.219855 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:36.220587 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 30 21:01:36.221675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.222638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f536fe60-1927-45d4-a3ba-b8472a9f9d7a req-0ba96220-565b-4106-9832-ce1ae0e048c1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.222726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98ceb11f-4580-49ec-a5b2-a895f7ebe726 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:36.222798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f536fe60-1927-45d4-a3ba-b8472a9f9d7a req-0ba96220-565b-4106-9832-ce1ae0e048c1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.224342 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98ceb11f-4580-49ec-a5b2-a895f7ebe726 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.037303 Jul 30 21:01:36.229889 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 205/344] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:36.248361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.249019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:36.249128 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f536fe60-1927-45d4-a3ba-b8472a9f9d7a req-0ba96220-565b-4106-9832-ce1ae0e048c1 service nova] Creating event network-vif-deleted:2eaac9ae-4d7e-4bca-a64e-2a556e58f1ce for instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 on nch2-master-1 Jul 30 21:01:36.263996 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f536fe60-1927-45d4-a3ba-b8472a9f9d7a req-0ba96220-565b-4106-9832-ce1ae0e048c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083198 Jul 30 21:01:36.264218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.264479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.264688 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 140/345] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:36.271089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.271647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.271928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.272747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:36.296487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.297134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.298040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.298588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.634960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.640134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:36.647235 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1811e8c7-495b-4301-b115-98032d77e3fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.419334 Jul 30 21:01:36.648123 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 206/346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:36.691740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.706704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.717651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:36.724682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eec013bb-87b4-46fc-a127-4d65d84f98c4 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1559 microversion: 2.25 time: 0.458463 Jul 30 21:01:36.724856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1705fb4-7021-46f4-89d5-e2ec68e3b466 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-564138648", "ram": 512, "vcpus": 1, "disk": 10, "id": 963629555, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:36.725945 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 141/347] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1559 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:36.744167 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:36.744167 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:36.748128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebc25ced-e1e7-49f6-83d0-3fd1afc617d6 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Calling method '.version_select at 0x7fbb5da4e550>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.750308 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:36.750308 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:36.767747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ebc25ced-e1e7-49f6-83d0-3fd1afc617d6 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebc25ced-e1e7-49f6-83d0-3fd1afc617d6 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:36.775595 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'nonexistent_hostname'} Jul 30 21:01:36.777159 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.778083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:36.779278 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.780402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebc25ced-e1e7-49f6-83d0-3fd1afc617d6 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:36.780402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebc25ced-e1e7-49f6-83d0-3fd1afc617d6 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051272 Jul 30 21:01:36.780402 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 142/348] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:36.788913 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1705fb4-7021-46f4-89d5-e2ec68e3b466 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.139482 Jul 30 21:01:36.793772 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 207/349] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:36 2022] POST /compute/v2.1/flavors => generated 412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:36.800159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.802897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:36.806773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:36.811323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.811867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.813126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.813669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.830732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 HTTP/1.1 Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:36.833116 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:36.834388 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e517c83e-05d9-4d90-a208-56a25c3f2fb7'} Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:36.835054 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:36.836534 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:36.837756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:36.837756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a1b15d3-ae54-4318-b64c-136acf030b6b tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 404 len: 111 microversion: 2.1 time: 0.039447 Jul 30 21:01:36.837756 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 208/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:36.888131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-903258899", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:36.951664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:36.990089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:36.990930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:36.998100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.998457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:36.999504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:36.999949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.138197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 16030f4a-b40f-49fd-827f-c09a808c0e3e {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:37.215594 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5170f89-af74-4a7d-9213-817266033870 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 2052 microversion: 2.25 time: 0.376585 Jul 30 21:01:37.216188 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 209/351] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:36 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 2052 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:37.220836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26361984-1e45-4180-aa7f-27627d3a53b4 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Calling method '.version_select at 0x7fbb5d6d1f70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.221611 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:37.221611 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:37.222734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-26361984-1e45-4180-aa7f-27627d3a53b4 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26361984-1e45-4180-aa7f-27627d3a53b4 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:37.224623 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1'} Jul 30 21:01:37.225852 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:37.226597 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 30 21:01:37.227655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.228628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26361984-1e45-4180-aa7f-27627d3a53b4 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.228628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26361984-1e45-4180-aa7f-27627d3a53b4 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008892 Jul 30 21:01:37.228628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 210/352] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:37.237124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb0495cb-5176-45f7-9afa-58244270386b tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:37.241013 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:37.241013 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:37.306650 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb0495cb-5176-45f7-9afa-58244270386b tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079124 Jul 30 21:01:37.307267 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 211/353] 10.222.0.17 () {60 vars in 1221 bytes} [Sat Jul 30 21:01:37 2022] POST /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:37.317596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.318109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:37.328062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.328519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.329507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.330098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.345737 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 HTTP/1.1 Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:37.348240 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.349503 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e517c83e-05d9-4d90-a208-56a25c3f2fb7'} Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.350276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.352330 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.354640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.354640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1f54b2c-fc8a-4830-9f78-c19900f209d9 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 404 len: 111 microversion: 2.1 time: 0.041445 Jul 30 21:01:37.354640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 212/354] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:37 2022] DELETE /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:37.355241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.356226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:37.364121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.364898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.367151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.367925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.408806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.409517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.410670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lazy-loading 'fault' on Instance uuid bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:37.473976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:37.482421 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86b3a379-3092-4cee-852e-8e211680e03d tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 200 len: 1309 microversion: 2.1 time: 0.130804 Jul 30 21:01:37.496332 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 213/355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:37.502585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf4f26b9-5aeb-4279-a4b3-2ce4b9da24b7 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Calling method '.version_select at 0x7fbb5d5f2e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.503809 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:37.503809 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:37.513469 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cf4f26b9-5aeb-4279-a4b3-2ce4b9da24b7 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf4f26b9-5aeb-4279-a4b3-2ce4b9da24b7 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:37.515825 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'nonexistent_hostname'} Jul 30 21:01:37.517067 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:37.517776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 30 21:01:37.518798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:37.520378 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.522978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf4f26b9-5aeb-4279-a4b3-2ce4b9da24b7 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.524507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf4f26b9-5aeb-4279-a4b3-2ce4b9da24b7 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.026743 Jul 30 21:01:37.530005 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 214/356] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:37.536467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.537362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:37.546735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.547701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.548690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.549354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.724562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:37.725136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:37.725460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:37.726094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:37.726666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:37.741954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.742994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.744272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.744930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.773889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 16030f4a-b40f-49fd-827f-c09a808c0e3e {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:37.780398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:37.785863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for user 1f7977e44d4b4ad6b5b2e40317492629 and project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:37.802889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.utils [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] cores quota exceeded for 05e9a9bafd714ea0b51c28c6ff4accc7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130983) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 30 21:01:37.804513 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Request method failure captured: Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 144 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zwsa9B0sghN-RRi0C_B3AVPXtsLQDaQOAIQx7DvT1lp2OEBCefmMbYMXVKpJmTTEomFfvbRKQii6YplmpYDSjVV2kajB9BKtaqUxdT9HwogHWfWjyvJrtndHRxtwpZm_gT7ckWfszPN8Mw5I1_yXma2N4qANffTuFGl7nHKp6Cudkw Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:37.809039 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_05e9a9bafd714ea0b51c28c6ff4accc7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 1f7977e44d4b4ad6b5b2e40317492629 Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-903258899", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} Jul 30 21:01:37.810482 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-903258899', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452'}}} Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 30 21:01:37.811161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.812614 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.813782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 30 21:01:37.818742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.819382 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11020eb6-1f6e-471f-bb48-ba9604c45c14 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 2052 microversion: 2.25 time: 0.279483 Jul 30 21:01:37.819382 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 215/357] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 2052 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:37.821118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.822199 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63271242-b4f3-40c1-bd70-2af33456bd82 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.041943 Jul 30 21:01:37.827060 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 143/358] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 1047 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:37.834004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.835271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: e517c83e-05d9-4d90-a208-56a25c3f2fb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:37.848222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.848937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.850338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.851194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.869179 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 HTTP/1.1 Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:37.873104 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.874275 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e517c83e-05d9-4d90-a208-56a25c3f2fb7'} Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.874931 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. Jul 30 21:01:37.876064 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.879608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance e517c83e-05d9-4d90-a208-56a25c3f2fb7 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.881203 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f95a902-2b92-4899-8e31-b4f04ed6086c tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7" status: 404 len: 111 microversion: 2.1 time: 0.052259 Jul 30 21:01:37.881893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 144/359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/servers/e517c83e-05d9-4d90-a208-56a25c3f2fb7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:37.887905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c140e7-9f89-40cd-b1be-039d212d3b1c tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Calling method '.version_select at 0x7fbb5db3f160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.888897 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:37.888897 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:37.892100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15c140e7-9f89-40cd-b1be-039d212d3b1c tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c140e7-9f89-40cd-b1be-039d212d3b1c tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:37.894574 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'ncdv-master-1'} Jul 30 21:01:37.896110 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:37.897008 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 30 21:01:37.898309 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:37.899597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c140e7-9f89-40cd-b1be-039d212d3b1c tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:37.900457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15c140e7-9f89-40cd-b1be-039d212d3b1c tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017374 Jul 30 21:01:37.901402 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 145/360] 10.222.0.17 () {58 vars in 1194 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:37.908743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:37.910542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:37.920240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.920946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:37.922125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:37.922728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.082234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5dde094d-3ec8-4b87-9b08-3344e3a02bb9 tempest-FlavorsExtraSpecsTestJSON-1384632446 tempest-FlavorsExtraSpecsTestJSON-1384632446-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.093325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5dde094d-3ec8-4b87-9b08-3344e3a02bb9 tempest-FlavorsExtraSpecsTestJSON-1384632446 tempest-FlavorsExtraSpecsTestJSON-1384632446-project] 10.222.0.17 "GET /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.275576 Jul 30 21:01:38.100316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 216/361] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:38.105230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d5f20d0>, body: {"quota_set": {"cores": 20}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:38.201821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:38.220296 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3294c6dc-a341-43cd-8a22-01db4fe37a2e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1503 microversion: 2.1 time: 0.317594 Jul 30 21:01:38.221034 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 146/362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:37 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:38.229572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.236335 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:38.236335 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:38.242011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.242674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.245332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.246894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.261370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:38.283033 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20fe27dd-b712-4474-a3b8-2b7c5b11c501 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060880 Jul 30 21:01:38.284394 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 147/363] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:38.297112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.297833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:38.304949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.305642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.306573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.307326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.323170 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 HTTP/1.1 Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:38.325298 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.326662 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2aedf1cc-3ee3-43d6-b8d4-987236379ab2'} Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:38.327467 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.328641 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.330589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:38.332309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d537148-be95-4bc6-bba1-43ff1e796dc2 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 404 len: 111 microversion: 2.1 time: 0.045426 Jul 30 21:01:38.333585 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 148/364] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:38 2022] DELETE /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:38.338653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3c23731-f3a6-46e9-a8b7-684fd825ad69 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Calling method '.version_select at 0x7fbb5dad8d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.339729 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:38.339729 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:38.349044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f3c23731-f3a6-46e9-a8b7-684fd825ad69 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3c23731-f3a6-46e9-a8b7-684fd825ad69 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:38.351101 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'nonexistent_hostname'} Jul 30 21:01:38.352459 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:38.353328 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 30 21:01:38.354512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:38.355576 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.357015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3c23731-f3a6-46e9-a8b7-684fd825ad69 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:38.358166 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f3c23731-f3a6-46e9-a8b7-684fd825ad69 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.023480 Jul 30 21:01:38.363225 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 149/365] 10.222.0.17 () {58 vars in 1215 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:38.370047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b436eb67-a26a-4e7d-9ca3-c54959731b66 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:38.373406 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:38.373406 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:38.398327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b436eb67-a26a-4e7d-9ca3-c54959731b66 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033720 Jul 30 21:01:38.399391 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 150/366] 10.222.0.17 () {60 vars in 1221 bytes} [Sat Jul 30 21:01:38 2022] POST /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:38.404795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:38.407494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:38.415095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.415763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.416997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.417820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.547678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.548142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.548959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.549401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.576311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'flavor' on Instance uuid 16030f4a-b40f-49fd-827f-c09a808c0e3e {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:38.654355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Going to try to live migrate instance to nch1-master-1 {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:01:38.701718 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ef389eb-f2f1-474f-ad0d-1985a5c34b3c tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 329 microversion: 2.1 time: 0.599951 Jul 30 21:01:38.703896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 217/367] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:38 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 329 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:38.717565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-41f2a9e9-7e33-456b-be93-06c16467e19c req-b32d406b-8ed3-46a8-b29f-5135a41e4b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46", "name": "network-vif-deleted", "tag": "919322c4-fc9d-41b5-81f9-b7a0ccfb3031"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:38.730693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-41f2a9e9-7e33-456b-be93-06c16467e19c req-b32d406b-8ed3-46a8-b29f-5135a41e4b13 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.731639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-41f2a9e9-7e33-456b-be93-06c16467e19c req-b32d406b-8ed3-46a8-b29f-5135a41e4b13 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.745869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-41f2a9e9-7e33-456b-be93-06c16467e19c req-b32d406b-8ed3-46a8-b29f-5135a41e4b13 service nova] Creating event network-vif-deleted:919322c4-fc9d-41b5-81f9-b7a0ccfb3031 for instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 on nch1-master-1 Jul 30 21:01:38.752896 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-41f2a9e9-7e33-456b-be93-06c16467e19c req-b32d406b-8ed3-46a8-b29f-5135a41e4b13 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047411 Jul 30 21:01:38.754690 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 218/368] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:38.762321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.763458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] [instance: 2aedf1cc-3ee3-43d6-b8d4-987236379ab2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:38.772430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.773325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.774405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.775707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.793712 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] HTTP exception thrown: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Request method failure captured: Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 HTTP/1.1 Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvelH2S7_bipY249z_Aw1hBNKgHHZacbSF7tmgtMYIRf82eLNVXrJCnl6fWOpftUvzBOjkn0fAcA7YW-r1Dcq6OCWGW6GazbAz6Ly8XbUado3_BKgi6yrBxU4CBQw-txbhF7ZJFePhlSH1baV2Vk4SWomgMs1ZNbjLb-iwkIfUpq5M Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:38.796210 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e222c39108c4ab787d3576d5215aeea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e222c39108c4ab787d3576d5215aeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6e222c39108c4ab787d3576d5215aeea Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1657188709 Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 93ee771e50474e268eae2fed07e43fe7 Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1657188709-project Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.797628 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2aedf1cc-3ee3-43d6-b8d4-987236379ab2'} Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:38.798455 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. Jul 30 21:01:38.799843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.802342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] Returning 404 to user: Instance 2aedf1cc-3ee3-43d6-b8d4-987236379ab2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:38.803691 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de6ecc7f-5b60-4b4c-a76f-f948c74b88d6 tempest-DeleteServersAdminTestJSON-1657188709 tempest-DeleteServersAdminTestJSON-1657188709-project] 10.222.0.17 "GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2" status: 404 len: 111 microversion: 2.1 time: 0.047682 Jul 30 21:01:38.807980 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 219/369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/servers/2aedf1cc-3ee3-43d6-b8d4-987236379ab2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:38.820439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-392514e1-1a29-45b1-9001-1ad9fe4412da tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d566f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-392514e1-1a29-45b1-9001-1ad9fe4412da tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 51 Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:38.830899 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: {"status": "enable", "maintenance_mode": "invalid"} Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:38.832828 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'disable', Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Enable', Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Disable', Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance: Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'invalid' Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.833677 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.835245 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.836507 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.836507 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:01:38.836507 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:01:38.836507 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:38.836507 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.838803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-392514e1-1a29-45b1-9001-1ad9fe4412da tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:38.840125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-392514e1-1a29-45b1-9001-1ad9fe4412da tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.029773 Jul 30 21:01:38.840968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 220/370] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 21:01:38 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:38.848854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1f8fc99-0c03-49ad-88b9-f7258437cc16 tempest-FlavorsExtraSpecsTestJSON-1384632446 tempest-FlavorsExtraSpecsTestJSON-1384632446-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.862535 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1f8fc99-0c03-49ad-88b9-f7258437cc16 tempest-FlavorsExtraSpecsTestJSON-1384632446 tempest-FlavorsExtraSpecsTestJSON-1384632446-project] 10.222.0.17 "GET /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019978 Jul 30 21:01:38.864300 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 221/371] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:38.871895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:38.872622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:38.880363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.880837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.881686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:38.882236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:38.901176 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] HTTP exception thrown: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Request method failure captured: Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 HTTP/1.1 Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZvwnUFPtn-sLyZhpDBe1ftCclBaYY1HSljGgI6mQclmxa47Zy-o1FOF69DS-6GsNadWUxtNP8FTlxRdl-Qs0U0Tz7ih1BNHTCavDLdl8cBmCiR9IYSXsckxCJsPX5JPzH8FTY649GAdM3pXclPWmGVzWlsKmTbFItkOe4ZCgTw5Fyg Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0e047bc76bc845649a0b0704a4931f7d Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:38.903139 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0e047bc76bc845649a0b0704a4931f7d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0e047bc76bc845649a0b0704a4931f7d Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveMigrationNegativeTest-1905378325-project Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 950f96b926474852acb90a959e369999 Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveMigrationNegativeTest-1905378325-project Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. Jul 30 21:01:38.905068 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46'} Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:38.905769 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. Jul 30 21:01:38.907099 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:38.909982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Returning 404 to user: Instance bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:38.909982 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d27a6c14-4c5d-45cf-ba63-2413e89b05fa tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46" status: 404 len: 111 microversion: 2.1 time: 0.039365 Jul 30 21:01:38.909982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 222/372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/servers/bb29b0f7-bdbd-40ef-9dc0-ce9de30fde46 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:38.915117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6759860a-470f-4788-8051-fd7e28618d3d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Calling method '.version_select at 0x7fbb5d5663a0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:39.531198 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6759860a-470f-4788-8051-fd7e28618d3d tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 371 microversion: 2.1 time: 0.624750 Jul 30 21:01:39.532912 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 223/373] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:01:38 2022] GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 371 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:39.551258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e914dae-7023-47fa-8052-9238eadeb368 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d595940>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e914dae-7023-47fa-8052-9238eadeb368 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 51 Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:39.556361 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: {"status": "invalid", "maintenance_mode": "enable"} Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:39.557886 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'disable', Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Enable', Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Disable', Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance: Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'invalid' Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:39.558767 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:39.561268 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:39.562995 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:39.562995 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:01:39.562995 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:01:39.562995 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 30 21:01:39.562995 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:39.565078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e914dae-7023-47fa-8052-9238eadeb368 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:39.567347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e914dae-7023-47fa-8052-9238eadeb368 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.031910 Jul 30 21:01:39.571905 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 224/374] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 21:01:39 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:39.586008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e1a246e-2807-46fd-b552-5c1bd1ae2e4e tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:39.594040 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:39.594040 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:39.648067 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e1a246e-2807-46fd-b552-5c1bd1ae2e4e tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074687 Jul 30 21:01:39.666398 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 225/375] 10.222.0.17 () {60 vars in 1221 bytes} [Sat Jul 30 21:01:39 2022] POST /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:39.677809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:39.678723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:39.691308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:39.692405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:39.694673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:39.700915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:39.775263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:01:39.942151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16f39172-f508-45da-8852-d87100ac8299 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 204 len: 0 microversion: 2.1 time: 0.270003 Jul 30 21:01:39.943704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 226/376] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:01:39 2022] DELETE /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:39.952968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:39.954090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:39.967891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:39.969150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:39.972996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:39.973889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:40.438796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:40.450982 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55a79ce0-95c4-4846-a8b0-a1461df0f852 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1493 microversion: 2.1 time: 0.504822 Jul 30 21:01:40.453113 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 227/377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:39 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1493 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:40.460162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d595550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:41.040659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:41.042841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:41.046111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:41.048423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:41.199790 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75485833-eada-4e8b-b1b4-248a739d88d4 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 328 microversion: 2.1 time: 0.745302 Jul 30 21:01:41.209084 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 228/378] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:40 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 328 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:41.217558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a259017d-c2d3-41d1-ba8a-bb65b6f8e546 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Action: 'update', calling method: .version_select at 0x7fbb5d5823a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:41.226584 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:41.226584 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:41.230270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a259017d-c2d3-41d1-ba8a-bb65b6f8e546 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9ead5ffce65e49c1a87fe7028c9ec10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7bd6e94c0e4dd19031469571cfd844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a259017d-c2d3-41d1-ba8a-bb65b6f8e546 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Request method failure captured: Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 50 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwrJ23l3KuDKRbaA_OdgM-B0b_C6n4GjVBTBj7ERjaN1GFNFUmJdhsz63MGK0ZHjdzNJBbd2-5heyHmtprHMzfrDRDzPjdpMIN8RZ4E8fQ7YwMxlnpJ-GJoKGDOJoNFTmliRuYf6g4U-GFF0xBmHX05Q_Y36sEZyCZMKma7nHknXWc Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:41.240418 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff7bd6e94c0e4dd19031469571cfd844", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff7bd6e94c0e4dd19031469571cfd844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff7bd6e94c0e4dd19031469571cfd844 Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-918889254 Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9ead5ffce65e49c1a87fe7028c9ec10e Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-918889254-project Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: {"status": "enable", "maintenance_mode": "enable"} Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 30 21:01:41.241672 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:41.242444 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 30 21:01:41.243583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.246556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a259017d-c2d3-41d1-ba8a-bb65b6f8e546 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:41.247643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a259017d-c2d3-41d1-ba8a-bb65b6f8e546 tempest-HostsAdminNegativeTestJSON-918889254 tempest-HostsAdminNegativeTestJSON-918889254-project] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.037490 Jul 30 21:01:41.248404 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 229/379] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 21:01:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:41.262573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44f5f5a4-4473-4f1a-9f73-26fbecab28bb tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:41.275257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44f5f5a4-4473-4f1a-9f73-26fbecab28bb tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016164 Jul 30 21:01:41.276531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 230/380] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:01:41 2022] GET /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:41.282457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:41.283421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:41.291185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:41.291902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:41.293105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:41.293756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:41.609569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:41.621371 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa2cc7e4-e1ba-4f78-a61a-8d4b7a68006b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1472 microversion: 2.1 time: 0.343409 Jul 30 21:01:41.639570 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 231/381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:41 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:41.647201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f83c34e-e1f1-4f89-ab18-04995da26cec tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '.version_select at 0x7fbb5d6904c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:41.656596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f83c34e-e1f1-4f89-ab18-04995da26cec tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:41.657478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f83c34e-e1f1-4f89-ab18-04995da26cec tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:41.678467 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f83c34e-e1f1-4f89-ab18-04995da26cec tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 737 microversion: 2.1 time: 0.037261 Jul 30 21:01:41.689710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 232/382] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:01:41 2022] GET /compute/v2.1/os-migrations => generated 737 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:41.697201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc4be70e-ba20-42d5-aad2-c538bbef6616 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d58d1f0>, body: {"status": null, "maintenance_mode": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc4be70e-ba20-42d5-aad2-c538bbef6616 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 42 Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:41.703622 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: {"status": null, "maintenance_mode": null} Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 30 21:01:41.704996 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'disable', Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Enable', Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'Disable', Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance: Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi None Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:41.706064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:41.709890 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:41.711365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:01:41.711365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:01:41.711365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 30 21:01:41.711365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:41.712767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc4be70e-ba20-42d5-aad2-c538bbef6616 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:41.714577 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc4be70e-ba20-42d5-aad2-c538bbef6616 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.023165 Jul 30 21:01:41.715792 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 233/383] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 30 21:01:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:41.725650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6bc9906c-cefa-406d-8c09-88bd46a58d68 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:41.731695 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:41.731695 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:41.756997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=6,nova_api:INSERT=4,nova_api:RELEASE=5,nova_api:UPDATE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:41.780097 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6bc9906c-cefa-406d-8c09-88bd46a58d68 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.062363 Jul 30 21:01:41.796306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 234/384] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:41 2022] PUT /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes => generated 22 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:41.804830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1241259970", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:41.904624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:42.145584 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a27c3eb2-588e-44d8-9496-912cdf1acf8b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e/action" status: 202 len: 0 microversion: 2.25 time: 3.744848 Jul 30 21:01:42.147966 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 151/385] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:01:38 2022] POST /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e/action => generated 0 bytes in 3748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:42.170565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:42.174055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:42.214089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.227222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.232901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.233533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.538340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:42.539597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:42.540378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:42.540971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:42.541582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:42.574360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.580379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.591187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.592139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.661314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:42.672567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for user 1f7977e44d4b4ad6b5b2e40317492629 and project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:42.697315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.utils [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] instances quota exceeded for 05e9a9bafd714ea0b51c28c6ff4accc7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130984) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 30 21:01:42.701673 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Request method failure captured: Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 145 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zwsa9B0sghN-RRi0C_B3AVPXtsLQDaQOAIQx7DvT1lp2OEBCefmMbYMXVKpJmTTEomFfvbRKQii6YplmpYDSjVV2kajB9BKtaqUxdT9HwogHWfWjyvJrtndHRxtwpZm_gT7ckWfszPN8Mw5I1_yXma2N4qANffTuFGl7nHKp6Cudkw Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:42.706051 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_05e9a9bafd714ea0b51c28c6ff4accc7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 1f7977e44d4b4ad6b5b2e40317492629 Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1241259970", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} Jul 30 21:01:42.708165 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1241259970', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452'}}} Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 30 21:01:42.709030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:42.710206 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.711676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 30 21:01:42.713123 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.719028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:42.720295 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cc635d3-7585-444f-81d3-cbb0c7372b7a tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.922151 Jul 30 21:01:42.727082 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 235/386] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 930 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:42.739866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d58d9d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:42.746676 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:42.746676 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:42.748118 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.hosts [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Enabling host nonexistent_hostname. Jul 30 21:01:42.768521 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Request method failure captured: Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 50 Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwtCFVhj9MXu9p4r4NT1yNnOzX4BEz-QtuF2-ccfoiVaFX58Dyadw5QrQw8U-jjxQJbM2UqK4N4WJTCRZVhMv7m5jMclDCro1xNfzbRjyKWaheO_FnrACnaofIULjSYXx53pAttJFjKLU6CE8E84JXsRX3cfT65JWe39Djpr9k3zqM Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:42.774266 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_276e47b9c5bf488fa69b8e429c328cbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/276e47b9c5bf488fa69b8e429c328cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 276e47b9c5bf488fa69b8e429c328cbf Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-310839836 Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a4b87dcc4fd645c89ae095a2a6a378f4 Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-310839836-project-admin Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: {"status": "enable", "maintenance_mode": "enable"} Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:42.775762 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 30 21:01:42.776682 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:42.777781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 30 21:01:42.779085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:42.781115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:42.783579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8de5ddfe-e7de-4870-a90e-97e5e58db576 tempest-HostsAdminNegativeTestJSON-310839836 tempest-HostsAdminNegativeTestJSON-310839836-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.055039 Jul 30 21:01:42.787792 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 236/387] 10.222.0.17 () {60 vars in 1211 bytes} [Sat Jul 30 21:01:42 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:01:42.796471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1de15a7-afbc-4d2d-a2b3-45bbe647e8cc tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:42.833120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1de15a7-afbc-4d2d-a2b3-45bbe647e8cc tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044030 Jul 30 21:01:42.841427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 237/388] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:01:42 2022] GET /compute/v2.1/flavors/963629555/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:42.855657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e6bf9c40-5c8c-4d54-9273-2f8ed74defa0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1644 microversion: 2.1 time: 0.706424 Jul 30 21:01:42.858708 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 152/389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:42 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1644 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:42.860798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:42.861795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:42.875493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c39dbd54-22b4-4da7-a338-0f76110be9ae req-d3ad47d4-2020-4bbb-9ecd-e70e2d0d85ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa59e938-eca3-4f85-9979-6916e3ab04ff", "name": "network-vif-deleted", "tag": "d4349851-888d-4550-8fe2-7aa292b790dd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:42.882356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.890090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.892660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.899042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.917516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c39dbd54-22b4-4da7-a338-0f76110be9ae req-d3ad47d4-2020-4bbb-9ecd-e70e2d0d85ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.923241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c39dbd54-22b4-4da7-a338-0f76110be9ae req-d3ad47d4-2020-4bbb-9ecd-e70e2d0d85ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:42.946310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c39dbd54-22b4-4da7-a338-0f76110be9ae req-d3ad47d4-2020-4bbb-9ecd-e70e2d0d85ba service nova] Creating event network-vif-deleted:d4349851-888d-4550-8fe2-7aa292b790dd for instance fa59e938-eca3-4f85-9979-6916e3ab04ff on nch2-master-1 Jul 30 21:01:42.960411 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c39dbd54-22b4-4da7-a338-0f76110be9ae req-d3ad47d4-2020-4bbb-9ecd-e70e2d0d85ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099983 Jul 30 21:01:42.961242 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 153/390] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:42.972879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:42.974132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:42.981129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:42.982244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:43.001547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:43.002275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:43.120440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:43.120733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:43.121215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lazy-loading 'fault' on Instance uuid fa59e938-eca3-4f85-9979-6916e3ab04ff {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:43.342145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950f96b926474852acb90a959e369999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e047bc76bc845649a0b0704a4931f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:43.354196 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7294087-35e2-493c-8cff-02f684f53347 tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 200 len: 1307 microversion: 2.1 time: 0.389734 Jul 30 21:01:43.359977 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 154/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:42 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:43.367972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d85faf0>, body: {"quota_set": {"instances": 10}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:43.652049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:43.669487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:43.671748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:43.675759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af375993-1244-4f08-a1c2-79ae4b266326 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.835003 Jul 30 21:01:43.676780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 238/392] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:42 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:43.687770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4bfc427-5969-4c62-83e3-79a9610e4ef7 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:43.688696 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:43.688696 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:43.748517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4bfc427-5969-4c62-83e3-79a9610e4ef7 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.070518 Jul 30 21:01:43.752471 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 239/393] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:01:43 2022] DELETE /compute/v2.1/flavors/963629555/os-extra_specs/hw:numa_nodes => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:43.783156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1013129111", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "68a236a2-c168-48e8-bff4-a731709fe73b"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:43.940192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] validate_networks() for [('68a236a2-c168-48e8-bff4-a731709fe73b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:44.075732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:44.076473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:44.082951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:44.083618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:44.237181 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d5fbc4c0-cb51-431d-990c-7e06f83bae46 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 329 microversion: 2.1 time: 0.873665 Jul 30 21:01:44.241174 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 155/394] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:43 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 329 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:44.250594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e807c938-61a2-40ff-bd7b-83d78654aece tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:44.256340 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:44.256340 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:44.289234 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e807c938-61a2-40ff-bd7b-83d78654aece tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/963629555/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.046555 Jul 30 21:01:44.294183 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 156/395] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:01:44 2022] DELETE /compute/v2.1/flavors/963629555/os-extra_specs/hw:cpu_policy => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:01:44.301112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6541cca1-f69e-46e3-bb23-dd3f9b3aa40a tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Calling method '.version_select at 0x7fbb5d9f7700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:44.647572 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6541cca1-f69e-46e3-bb23-dd3f9b3aa40a tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 371 microversion: 2.1 time: 0.351483 Jul 30 21:01:44.649355 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 157/396] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:01:44 2022] GET /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:44.657587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bfe74f69-b840-421a-9d3b-c1e873f8f2a1 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:44.670802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bfe74f69-b840-421a-9d3b-c1e873f8f2a1 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/963629555/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019444 Jul 30 21:01:44.680358 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 158/397] 10.222.0.17 () {58 vars in 1200 bytes} [Sat Jul 30 21:01:44 2022] GET /compute/v2.1/flavors/963629555/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:44.706060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:44.713095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] [instance: fa59e938-eca3-4f85-9979-6916e3ab04ff] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:44.715434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:44.730924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:44.731437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:44.734092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:44.742803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:44.771675 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] HTTP exception thrown: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Request method failure captured: Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff HTTP/1.1 Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZvwnUFPtn-sLyZhpDBe1ftCclBaYY1HSljGgI6mQclmxa47Zy-o1FOF69DS-6GsNadWUxtNP8FTlxRdl-Qs0U0Tz7ih1BNHTCavDLdl8cBmCiR9IYSXsckxCJsPX5JPzH8FTY649GAdM3pXclPWmGVzWlsKmTbFItkOe4ZCgTw5Fyg Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0e047bc76bc845649a0b0704a4931f7d Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:44.777637 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0e047bc76bc845649a0b0704a4931f7d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e047bc76bc845649a0b0704a4931f7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0e047bc76bc845649a0b0704a4931f7d Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1905378325 Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-LiveMigrationNegativeTest-1905378325-project Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 950f96b926474852acb90a959e369999 Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-LiveMigrationNegativeTest-1905378325-project Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. Jul 30 21:01:44.779011 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'fa59e938-eca3-4f85-9979-6916e3ab04ff'} Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:44.779768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. Jul 30 21:01:44.780954 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:44.783490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] Returning 404 to user: Instance fa59e938-eca3-4f85-9979-6916e3ab04ff could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:44.788688 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-338f8343-0568-4e91-9cf6-7a7e23e5835b tempest-LiveMigrationNegativeTest-1905378325 tempest-LiveMigrationNegativeTest-1905378325-project] 10.222.0.17 "GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff" status: 404 len: 111 microversion: 2.1 time: 0.106863 Jul 30 21:01:44.789661 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 159/398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:44 2022] GET /compute/v2.1/servers/fa59e938-eca3-4f85-9979-6916e3ab04ff => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:44.812946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d9fd280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:45.633771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:45.634333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:45.635198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:45.639389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:45.755402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9be8f36-84d3-4e2d-b5cd-3f920d6ad644 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 325 microversion: 2.1 time: 0.964109 Jul 30 21:01:45.760217 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 160/399] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:44 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 325 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:45.781711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b5dc989-bea8-4462-b255-f36e7269e901 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:45.786854 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:45.786854 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:45.850826 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b5dc989-bea8-4462-b255-f36e7269e901 tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/963629555" status: 202 len: 0 microversion: 2.1 time: 0.088359 Jul 30 21:01:45.852968 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 161/400] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:01:45 2022] DELETE /compute/v2.1/flavors/963629555 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:01:45.864363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:45.872109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:45.897191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:45.898393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:45.902200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:45.903375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:46.135039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:46.135735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:46.136213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:46.136736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:46.137256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:46.169491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:46.170361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:46.178078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:46.180278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:46.269518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:46.286496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for user 96815c6776f1464a8b6350b4a52d4548 and project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:46.326638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:01:46.331993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:01:46.471525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:46.474605 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfd947df-b243-4036-ab05-80ec65ac4d60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.718166 Jul 30 21:01:46.475468 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 240/401] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:01:46.483570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1ae1753f-ca3c-435b-bee4-eee55b679189 req-ec74f05e-4537-46ab-b338-d61f3de93051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16030f4a-b40f-49fd-827f-c09a808c0e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "02cde323-6cb5-4de7-99ed-54209e847243"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:46.488863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:46.493657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:46.494896 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1fa44b0b-44bb-4b71-b4de-c3fd1f2cf9f3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.640739 Jul 30 21:01:46.509578 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 162/402] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:45 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:46.519823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2bd18b14-0692-458c-8d9f-f278a38a12cb tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:46.534408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ae1753f-ca3c-435b-bee4-eee55b679189 req-ec74f05e-4537-46ab-b338-d61f3de93051 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:46.537430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ae1753f-ca3c-435b-bee4-eee55b679189 req-ec74f05e-4537-46ab-b338-d61f3de93051 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:46.551733 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1ae1753f-ca3c-435b-bee4-eee55b679189 req-ec74f05e-4537-46ab-b338-d61f3de93051 service nova] Creating event network-vif-unplugged:02cde323-6cb5-4de7-99ed-54209e847243 for instance 16030f4a-b40f-49fd-827f-c09a808c0e3e on nch2-master-1 Jul 30 21:01:46.558603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1ae1753f-ca3c-435b-bee4-eee55b679189 req-ec74f05e-4537-46ab-b338-d61f3de93051 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078844 Jul 30 21:01:46.559603 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 241/403] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:46.583521 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2bd18b14-0692-458c-8d9f-f278a38a12cb tempest-FlavorsExtraSpecsTestJSON-1723019607 tempest-FlavorsExtraSpecsTestJSON-1723019607-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084321 Jul 30 21:01:46.588810 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 163/404] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:01:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:46.608493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-595378785", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:46.703858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:47.061645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Calling method '.version_select at 0x7fbb5d4ac0d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:47.071265 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:47.071265 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:47.077509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.078133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.135869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.137217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.164666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.165535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.189217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.189984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.221697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.222578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.235896 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dbea943a-9236-4352-89e4-8cdbc8cf997b tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.674457 Jul 30 21:01:47.237219 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 242/405] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 30 21:01:46 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:47.249317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-757c21dc-4749-4efb-ad56-bd60bd5965df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:47.253247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-757c21dc-4749-4efb-ad56-bd60bd5965df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:47.301282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:47.301810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:47.302194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:47.302614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:47.303051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:47.325231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.325720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.327356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.332035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.384646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:47.397630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Getting quotas for user 1f7977e44d4b4ad6b5b2e40317492629 and project 05e9a9bafd714ea0b51c28c6ff4accc7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:47.435670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.utils [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] ram quota exceeded for 05e9a9bafd714ea0b51c28c6ff4accc7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130983) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 30 21:01:47.436296 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Request method failure captured: Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 144 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zwsa9B0sghN-RRi0C_B3AVPXtsLQDaQOAIQx7DvT1lp2OEBCefmMbYMXVKpJmTTEomFfvbRKQii6YplmpYDSjVV2kajB9BKtaqUxdT9HwogHWfWjyvJrtndHRxtwpZm_gT7ckWfszPN8Mw5I1_yXma2N4qANffTuFGl7nHKp6Cudkw Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:47.440052 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_05e9a9bafd714ea0b51c28c6ff4accc7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 1f7977e44d4b4ad6b5b2e40317492629 Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-595378785", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} Jul 30 21:01:47.442092 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-595378785', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452'}}} Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 30 21:01:47.442792 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:47.443877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.445035 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:47.446190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bed2ce89-2c80-4aa1-b3f2-df8ca726cd07 tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.847234 Jul 30 21:01:47.449074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 164/406] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 852 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:47.468761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Calling method '.version_select at 0x7fbb5d8cb670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:47.474229 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:47.474229 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:47.476786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.478432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.500997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-757c21dc-4749-4efb-ad56-bd60bd5965df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:47.509565 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-757c21dc-4749-4efb-ad56-bd60bd5965df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1211 microversion: 2.1 time: 0.269994 Jul 30 21:01:47.525876 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 243/407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:47 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1211 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:47.531553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d4c54c0>, body: {"quota_set": {"ram": 51200}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:47.577735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.578266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.651000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.651562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.705794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.707001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.791346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.791832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.814224 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e599aea3-4140-4d2d-bee2-2058d7a38698 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.358301 Jul 30 21:01:47.824262 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 165/408] 10.222.0.17 () {60 vars in 1222 bytes} [Sat Jul 30 21:01:47 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:47.837498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:47.838620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:47.875889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.876809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:47.880363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:47.881031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.424740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.425975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.427005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.429096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.612297 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90a7dca3-0373-4358-a7ca-e659e85c0ba9 tempest-QuotasAdminNegativeTest-1647191395 tempest-QuotasAdminNegativeTest-1647191395-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 200 len: 329 microversion: 2.1 time: 1.084817 Jul 30 21:01:48.614730 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 244/409] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:47 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 329 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:48.625290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Calling method '.version_select at 0x7fbb5d4ac9d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:48.628729 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:48.628729 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:48.630680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.631536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.669007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.669912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.678498 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17f0467d-2ae6-47fe-85d6-3ad856f1fd55 tempest-HypervisorAdminV253TestBase-383549386 tempest-HypervisorAdminV253TestBase-383549386-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/703239a7-74e0-4a21-a959-015082b9464d" status: 200 len: 792 microversion: 2.53 time: 0.062092 Jul 30 21:01:48.679597 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 245/410] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 30 21:01:48 2022] GET /compute/v2.1/os-hypervisors/703239a7-74e0-4a21-a959-015082b9464d => generated 792 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:48.695589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:48.696437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:48.705192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.705950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.707661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.708316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.713310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:48.769786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:48.789883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:48.789883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:48.794057 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20162b44-4f35-48ac-a607-5fa663f2be24 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.967968 Jul 30 21:01:48.808923 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 166/411] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:47 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:48.817286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f27fc3de-f150-4dba-9838-233f903ac7cc tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Action: 'update', calling method: .version_select at 0x7fbb5d85f8b0>, body: {"quota_set": {"ram": 0}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:48.824331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f27fc3de-f150-4dba-9838-233f903ac7cc tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1f7977e44d4b4ad6b5b2e40317492629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e9a9bafd714ea0b51c28c6ff4accc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f27fc3de-f150-4dba-9838-233f903ac7cc tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Request method failure captured: Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 HTTP/1.1 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 25 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zwsa9B0sghN-RRi0C_B3AVPXtsLQDaQOAIQx7DvT1lp2OEBCefmMbYMXVKpJmTTEomFfvbRKQii6YplmpYDSjVV2kajB9BKtaqUxdT9HwogHWfWjyvJrtndHRxtwpZm_gT7ckWfszPN8Mw5I1_yXma2N4qANffTuFGl7nHKp6Cudkw Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:01:48.827377 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_05e9a9bafd714ea0b51c28c6ff4accc7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05e9a9bafd714ea0b51c28c6ff4accc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 05e9a9bafd714ea0b51c28c6ff4accc7 Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-338253201 Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 1f7977e44d4b4ad6b5b2e40317492629 Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-QuotasAdminNegativeTest-338253201-project Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: {"quota_set": {"ram": 0}} Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 30 21:01:48.828768 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '05e9a9bafd714ea0b51c28c6ff4accc7', 'body': {'quota_set': {'ram': 0}}} Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:48.829547 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:48.830799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 30 21:01:48.833162 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:48.838581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f27fc3de-f150-4dba-9838-233f903ac7cc tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:48.842001 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f27fc3de-f150-4dba-9838-233f903ac7cc tempest-QuotasAdminNegativeTest-338253201 tempest-QuotasAdminNegativeTest-338253201-project] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7" status: 403 len: 116 microversion: 2.1 time: 0.030975 Jul 30 21:01:48.849580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 167/412] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:01:48 2022] PUT /compute/v2.1/os-quota-sets/05e9a9bafd714ea0b51c28c6ff4accc7 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:48.858921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-da5b1a4e-451f-461b-a6f8-f3d08a5708ae req-d9c1c15b-83ff-471b-b746-90a17e3e8120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16030f4a-b40f-49fd-827f-c09a808c0e3e", "tag": "02cde323-6cb5-4de7-99ed-54209e847243"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:48.862044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:48.875968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da5b1a4e-451f-461b-a6f8-f3d08a5708ae req-d9c1c15b-83ff-471b-b746-90a17e3e8120 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:48.876666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da5b1a4e-451f-461b-a6f8-f3d08a5708ae req-d9c1c15b-83ff-471b-b746-90a17e3e8120 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:48.879606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ecb450b-f188-4bd2-aca0-9230ae08ac5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1269 microversion: 2.1 time: 0.185781 Jul 30 21:01:48.881782 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 246/413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:48 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:48.916897 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-da5b1a4e-451f-461b-a6f8-f3d08a5708ae req-d9c1c15b-83ff-471b-b746-90a17e3e8120 service nova] Creating event network-changed:02cde323-6cb5-4de7-99ed-54209e847243 for instance 16030f4a-b40f-49fd-827f-c09a808c0e3e on nch2-master-1 Jul 30 21:01:48.929526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-da5b1a4e-451f-461b-a6f8-f3d08a5708ae req-d9c1c15b-83ff-471b-b746-90a17e3e8120 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078365 Jul 30 21:01:48.932392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 168/414] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:49.566902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7b72f6c-4b7d-4a75-945f-ce2ecaea4cad tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:49.584317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7b72f6c-4b7d-4a75-945f-ce2ecaea4cad tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.700255 Jul 30 21:01:49.585121 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 247/415] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:01:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:49.822075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:49.823483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:49.839876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:49.843107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:49.845762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:49.846633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:50.048210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:50.059063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:50.060913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:50.062455 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc4f187d-24a6-4eb3-a921-e9e10bdfc612 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.246519 Jul 30 21:01:50.075969 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 248/416] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:49 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:50.083516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:50.084223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:50.093242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:50.093636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:50.094494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:50.094944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:50.166124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:50.178315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e89b2320-4cb1-45df-a714-78e0febbf3db tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1269 microversion: 2.1 time: 0.100887 Jul 30 21:01:50.178991 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 249/417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:50 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:50.264018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2e7e798-f961-4fb2-9d14-731c67412a96 tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1655665557", "id": 246069507, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:50.277627 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:50.277627 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:50.304002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2e7e798-f961-4fb2-9d14-731c67412a96 tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.710923 Jul 30 21:01:50.317296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-68049851-fbd6-4def-9f92-181af662220e tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:50.327816 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 169/418] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:49 2022] POST /compute/v2.1/flavors => generated 422 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:50.332291 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-68049851-fbd6-4def-9f92-181af662220e tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016699 Jul 30 21:01:50.342477 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 250/419] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Jul 30 21:01:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:01:50.344575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93109113-f6a4-42f1-9270-63fceb66d8cd tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1546812315", "id": 1053981702, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:50.387124 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-93109113-f6a4-42f1-9270-63fceb66d8cd tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.048061 Jul 30 21:01:50.395023 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 170/420] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:50 2022] POST /compute/v2.1/flavors => generated 425 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:50.406304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa0db2a6-e3c2-4583-bf23-cac03d4e34ea tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:50.419524 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa0db2a6-e3c2-4583-bf23-cac03d4e34ea tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016649 Jul 30 21:01:50.423019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 251/421] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Jul 30 21:01:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:01:50.441240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8981cad-b79b-41ee-a405-ff93848712d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Action: 'create', calling method: .version_select at 0x7fbb5d85faf0>, body: {"keypair": {"name": "tempest-keypair-1101770249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1wsgpuuvY3YE3OXDFizwRDPtNPo7nbxgQv9ZAVF/RL/MlPUCvC2MZ9nZFXBSZA/qrq8xiqNLtssfpnr6xljPVcUA2bYkyI97x/2UurOnaUu48t/IdEBxqLrwxDRVHecA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:50.489319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c8981cad-b79b-41ee-a405-ff93848712d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:50.510093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c8981cad-b79b-41ee-a405-ff93848712d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for user b2a05aa5d80844848bf57f6ca093e582 and project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:50.563065 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8981cad-b79b-41ee-a405-ff93848712d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130608 Jul 30 21:01:50.570300 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 171/422] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:01:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:51.089326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:51.089949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:51.101819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:51.112096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:51.113539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:51.113986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:51.205610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:51.206553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:51.218992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:51.219500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:51.220309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:51.220756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:51.532771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:51.546723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:51.550940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:51.554100 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c1960b8-2d23-41de-a524-4e1b4c4cf0d7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.468629 Jul 30 21:01:51.558160 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 252/423] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:51 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:51.781817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:51.793218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-719d2cd3-25af-4faa-b957-204d305d42c5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.595805 Jul 30 21:01:51.796184 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 172/424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:51 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:52.283775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-27503a53-376b-4938-aaff-b82a2596fc16 req-152f4e35-04d0-4710-aa12-ff046bfe6b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e122a06c-f596-4f07-8a71-0afeabaf9749", "tag": "2814b9b0-cbb7-4f40-8a8e-39c2d8863d85"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:52.299819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-27503a53-376b-4938-aaff-b82a2596fc16 req-152f4e35-04d0-4710-aa12-ff046bfe6b52 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:52.311251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-27503a53-376b-4938-aaff-b82a2596fc16 req-152f4e35-04d0-4710-aa12-ff046bfe6b52 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:52.352468 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-27503a53-376b-4938-aaff-b82a2596fc16 req-152f4e35-04d0-4710-aa12-ff046bfe6b52 service nova] Creating event network-changed:2814b9b0-cbb7-4f40-8a8e-39c2d8863d85 for instance e122a06c-f596-4f07-8a71-0afeabaf9749 on nch1-master-1 Jul 30 21:01:52.368607 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-27503a53-376b-4938-aaff-b82a2596fc16 req-152f4e35-04d0-4710-aa12-ff046bfe6b52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089375 Jul 30 21:01:52.377565 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 253/425] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:52.581461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:52.582216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:52.601841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:52.602312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:52.603108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:52.603635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.059522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:53.074012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:53.075616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:53.077011 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a59a1b4-f8fa-4e14-8877-442c896dcdb3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.503507 Jul 30 21:01:53.078491 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 173/426] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:52 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:53.089397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:53.090044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:53.115578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:53.116052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.123960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:53.124711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.402745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Calling method '.version_select at 0x7fbb5d58d430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:53.408178 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:53.408178 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:53.409722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:53.410184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.465669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:53.466165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.512313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:53.512792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:53.526901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4ecaf867-46e7-4072-8b68-65194a5f9ea0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.853237 Jul 30 21:01:53.531175 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 254/427] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:01:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:54.036822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.052098 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55c03d1c-c8ca-4939-bba9-64cd002e2a8d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.968442 Jul 30 21:01:54.052733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 174/428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:53 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:54.100936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.102307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:54.118757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.119653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.120921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.121587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.123087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a545af1-aa50-4719-8fba-1f3ab7eca323 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Calling method '.version_select at 0x7fbb5d4acca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.124512 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:54.124512 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:54.125646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a545af1-aa50-4719-8fba-1f3ab7eca323 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '68142e14d77c4c1e8249d90cd3e8c1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e36ee8bd784bdea8aa1f7bec70b796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a545af1-aa50-4719-8fba-1f3ab7eca323 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Request method failure captured: Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zw-ngcEguC6z3LVVHVUDBJkkeC_NAHykKVJOQZWqGMqUDLue2tmwqHfSvftu7WSVQ-8QOZjgjD-IfsqIR5OhL2_IYVyf_bSGv_WRmAq4OujoKhUPlK6UDjzUbY0Uc0GWO8CLq0hnYQD43AOSszrDfNRKE9mlYZRDcMQ30zc1tGAu_I Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c6e36ee8bd784bdea8aa1f7bec70b796 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:54.127872 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c6e36ee8bd784bdea8aa1f7bec70b796", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c6e36ee8bd784bdea8aa1f7bec70b796 Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 68142e14d77c4c1e8249d90cd3e8c1fa Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 30 21:01:54.129800 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'nch1-master-1'} Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:54.130532 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 30 21:01:54.131693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.132684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a545af1-aa50-4719-8fba-1f3ab7eca323 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:54.133554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a545af1-aa50-4719-8fba-1f3ab7eca323 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.592212 Jul 30 21:01:54.136396 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 255/429] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:01:53 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 599 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:01:54.149656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Calling method '.version_select at 0x7fbb5d476550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.158303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.161657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.199854 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Request method failure captured: Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxAaGBCoCu4vkIjJSx-hNgexZ_ND3Br_oI3tAba9zLbWy5d_HrxzSUOqo-nLNtHkokDzQ1J-XA25zsx2MUKiy9VB8-z942jRUBeqRWhJ0lXGzN-ORUUqF__Jk-EmTeJ6sLvdYhYdwHl4p8V6OfvaaMC2ydUHPaX8He6-d-mi6S8HDQ Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 509e418052584bd0b6b9da5735109d0c Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:54.203847 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_509e418052584bd0b6b9da5735109d0c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 509e418052584bd0b6b9da5735109d0c Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: fc88f95a97e24c6f836ef5ba592d6fc7 Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 30 21:01:54.205466 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.206300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.207517 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.207517 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:54.207517 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:54.207517 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 30 21:01:54.207517 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.209545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:54.210782 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a41846c1-cb69-440a-961f-ff93c3a28310 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.065926 Jul 30 21:01:54.216184 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 256/430] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:01:54 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:54.221668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Calling method '.version_select at 0x7fbb5d476280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.223266 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:54.223266 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:54.224912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.225603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.238775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:RELEASE=2,nova_api:SELECT=91,nova_api:SAVEPOINT=1,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:54.244663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.245809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.260143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.260912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.271384 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b91c0a0-6cf0-4043-9ac1-2764a1db55a0 tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053580 Jul 30 21:01:54.272261 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 257/431] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:01:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:54.285633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-145d96de-b0c2-4329-9b27-0c3b1ad0c029 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Calling method '.version_select at 0x7fbb5d4769d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.286885 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:54.286885 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:54.288649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-145d96de-b0c2-4329-9b27-0c3b1ad0c029 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '68142e14d77c4c1e8249d90cd3e8c1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e36ee8bd784bdea8aa1f7bec70b796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-145d96de-b0c2-4329-9b27-0c3b1ad0c029 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Request method failure captured: Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zw-ngcEguC6z3LVVHVUDBJkkeC_NAHykKVJOQZWqGMqUDLue2tmwqHfSvftu7WSVQ-8QOZjgjD-IfsqIR5OhL2_IYVyf_bSGv_WRmAq4OujoKhUPlK6UDjzUbY0Uc0GWO8CLq0hnYQD43AOSszrDfNRKE9mlYZRDcMQ30zc1tGAu_I Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c6e36ee8bd784bdea8aa1f7bec70b796 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:54.290580 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c6e36ee8bd784bdea8aa1f7bec70b796", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6e36ee8bd784bdea8aa1f7bec70b796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c6e36ee8bd784bdea8aa1f7bec70b796 Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713 Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 68142e14d77c4c1e8249d90cd3e8c1fa Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 30 21:01:54.292181 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1'} Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:54.292884 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 30 21:01:54.294056 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.297052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-145d96de-b0c2-4329-9b27-0c3b1ad0c029 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:54.297808 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-145d96de-b0c2-4329-9b27-0c3b1ad0c029 tempest-HypervisorAdminNegativeUnderV252Test-1649948713 tempest-HypervisorAdminNegativeUnderV252Test-1649948713-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018420 Jul 30 21:01:54.305279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 258/432] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:01:54 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:54.314210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Calling method '.version_select at 0x7fbb5d47d280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:54.317715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.319751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.332738 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] HTTP exception thrown: No hypervisor matching '468f8926-f6a3-4819-a119-c441b96a638d' could be found. Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Request method failure captured: Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors/468f8926-f6a3-4819-a119-c441b96a638d/servers HTTP/1.1 Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxAaGBCoCu4vkIjJSx-hNgexZ_ND3Br_oI3tAba9zLbWy5d_HrxzSUOqo-nLNtHkokDzQ1J-XA25zsx2MUKiy9VB8-z942jRUBeqRWhJ0lXGzN-ORUUqF__Jk-EmTeJ6sLvdYhYdwHl4p8V6OfvaaMC2ydUHPaX8He6-d-mi6S8HDQ Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 509e418052584bd0b6b9da5735109d0c Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:54.335528 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_509e418052584bd0b6b9da5735109d0c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/509e418052584bd0b6b9da5735109d0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 509e418052584bd0b6b9da5735109d0c Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272 Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: fc88f95a97e24c6f836ef5ba592d6fc7 Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: exception: No hypervisor matching '468f8926-f6a3-4819-a119-c441b96a638d' could be found. Jul 30 21:01:54.336816 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '468f8926-f6a3-4819-a119-c441b96a638d'} Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '468f8926-f6a3-4819-a119-c441b96a638d' could be found. Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.337523 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '468f8926-f6a3-4819-a119-c441b96a638d' could be found. Jul 30 21:01:54.338583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.341105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] Returning 404 to user: No hypervisor matching '468f8926-f6a3-4819-a119-c441b96a638d' could be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:54.342736 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5babb43-53e3-4403-ba07-c5eb9e013eed tempest-HypervisorAdminNegativeUnderV252Test-37108272 tempest-HypervisorAdminNegativeUnderV252Test-37108272-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/468f8926-f6a3-4819-a119-c441b96a638d/servers" status: 404 len: 123 microversion: 2.1 time: 0.035604 Jul 30 21:01:54.347522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.348524 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 259/433] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Jul 30 21:01:54 2022] GET /compute/v2.1/os-hypervisors/468f8926-f6a3-4819-a119-c441b96a638d/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:01:54.357423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.359000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:54.360209 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e9c5c7c2-4253-46d1-9a66-91411e4f7fb8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.263504 Jul 30 21:01:54.360770 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 175/434] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:54 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:54.947317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d674790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:54.951717 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:54.951717 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:54.955630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.956618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.966835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:54.968407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:54.980522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] HTTP exception thrown: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Request method failure captured: Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 HTTP/1.1 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 56 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxCui0xWONkF96BXz2J_j9f7xuc6cLcoo6HNC1BuH2PJRQ-TElrIFFbFQFMyYLi4cyHpp4zO8jtz8528-tfvZ4XAq2EwVNp3fpZIrOAaL8KgsLngM3h65pBerZM9x_pGJxtnDc6drabi6Vp6BkKEvIPoUiU-j-Y70FCbwlHULQPM-g Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.53 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:54.983578 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a07e4e5480d482cb79f386337e0c00b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0666095c0f6c4718abcb6cf4f2e0faf9 Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:54.984926 ncdv-master-1 devstack@n-api.service[130984]: exception: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6bfbfbef-d06e-465e-8d9b-0d8427611f70', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.985729 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:54.991957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Returning 404 to user: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e06e720-4f73-40e5-a14c-005b01384eb3 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70" status: 404 len: 110 microversion: 2.53 time: 0.439277 Jul 30 21:01:54.993476 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 260/435] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Jul 30 21:01:54 2022] PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 => generated 110 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:54.996379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d85f820>, body: {"status": "disabled"} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:54.999803 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:54.999803 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:55.001078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.006782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.017776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.018719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.030583 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] HTTP exception thrown: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Request method failure captured: Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 HTTP/1.1 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 22 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxCui0xWONkF96BXz2J_j9f7xuc6cLcoo6HNC1BuH2PJRQ-TElrIFFbFQFMyYLi4cyHpp4zO8jtz8528-tfvZ4XAq2EwVNp3fpZIrOAaL8KgsLngM3h65pBerZM9x_pGJxtnDc6drabi6Vp6BkKEvIPoUiU-j-Y70FCbwlHULQPM-g Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.53 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:01:55.035054 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a07e4e5480d482cb79f386337e0c00b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 0666095c0f6c4718abcb6cf4f2e0faf9 Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: {"status": "disabled"} Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: exception: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.036697 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6bfbfbef-d06e-465e-8d9b-0d8427611f70', 'body': {'status': 'disabled'}} Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.037497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:55.038677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:55.039945 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.039945 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.040289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Returning 404 to user: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:55.042403 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f5918ee5-6f02-40f0-97d7-ae6893161451 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70" status: 404 len: 110 microversion: 2.53 time: 0.050032 Jul 30 21:01:55.044489 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 176/436] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Jul 30 21:01:54 2022] PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:55.053137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d476820>, body: {"status": "enabled"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:55.057816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.059242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.071905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.073323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:55.073944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:55.075220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.081997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.083051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.083871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.090621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.091582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] HTTP exception thrown: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Request method failure captured: Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 HTTP/1.1 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 21 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxCui0xWONkF96BXz2J_j9f7xuc6cLcoo6HNC1BuH2PJRQ-TElrIFFbFQFMyYLi4cyHpp4zO8jtz8528-tfvZ4XAq2EwVNp3fpZIrOAaL8KgsLngM3h65pBerZM9x_pGJxtnDc6drabi6Vp6BkKEvIPoUiU-j-Y70FCbwlHULQPM-g Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.53 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:01:55.095867 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a07e4e5480d482cb79f386337e0c00b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a07e4e5480d482cb79f386337e0c00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7a07e4e5480d482cb79f386337e0c00b Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525 Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0666095c0f6c4718abcb6cf4f2e0faf9 Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: {"status": "enabled"} Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: exception: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.097891 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6bfbfbef-d06e-465e-8d9b-0d8427611f70', 'body': {'status': 'enabled'}} Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.098673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:01:55.099935 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:01:55.101241 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. Jul 30 21:01:55.101241 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:55.101241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Returning 404 to user: Service 6bfbfbef-d06e-465e-8d9b-0d8427611f70 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:55.101241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d48cd72e-397c-4391-8535-93873fb45af6 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70" status: 404 len: 110 microversion: 2.53 time: 0.051206 Jul 30 21:01:55.102322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 261/437] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Jul 30 21:01:55 2022] PUT /compute/v2.1/os-services/6bfbfbef-d06e-465e-8d9b-0d8427611f70 => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:55.117416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:55.122454 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:55.122454 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:55.124311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.124793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.130231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.132170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.149643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:55.200962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d12f7140-2093-4cca-b4df-8f629caedcb0 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.093826 Jul 30 21:01:55.209324 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 262/438] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Jul 30 21:01:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:55.221418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1854532261", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "1053981702", "adminPass": "***", "networks": [{"uuid": "26970fab-7b49-4381-be37-ad8625117c4b"}], "security_groups": [{"name": "tempest-securitygroup--14340033"}], "key_name": "tempest-keypair-1101770249", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:55.455896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] validate_networks() for [('26970fab-7b49-4381-be37-ad8625117c4b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:55.493158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:55.502959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d62d6ac3-84fc-455c-ae04-c3d5d6aa6159 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.433502 Jul 30 21:01:55.507377 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 177/439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:55 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:55.512511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:55.516058 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:55.516058 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:55.517292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.517975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.542985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.543926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.633913 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa8e3649-b054-47e8-a118-b96e8aea6c1f tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.125245 Jul 30 21:01:55.638996 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 178/440] 10.222.0.17 () {60 vars in 1211 bytes} [Sat Jul 30 21:01:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:55.650962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:55.651699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:55.664483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.664956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.669356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:55.671418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:55.969367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:55.978260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:55.987427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:55.989092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-339e143f-59e5-4ab9-b83a-e345b952515f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1569 microversion: 2.25 time: 0.348702 Jul 30 21:01:55.989724 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 179/441] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:55 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1569 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:56.000254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:56.005000 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:56.005000 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:56.007119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.007813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.008833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.009443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.053750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d4834633-65a5-4513-96b0-a9f53f67e7c9 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060466 Jul 30 21:01:56.055088 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 180/442] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Jul 30 21:01:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:56.074557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:56.094863 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:56.094863 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:56.098050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.103317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.105977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.107937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.188326 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b88730b-93ab-45a1-b85a-807ec13f6c72 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.125687 Jul 30 21:01:56.192861 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 181/443] 10.222.0.17 () {60 vars in 1237 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:56.209761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:56.214100 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:56.214100 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:56.218620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.220621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.222382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.225794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.260046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d324b6d6-f66b-4744-b13a-5e6263ae7b5c tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.056777 Jul 30 21:01:56.260906 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 182/444] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:01:56.270720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:56.271970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:56.272623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:56.273045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:56.273470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:56.281527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:56.292214 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:56.292214 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:56.294318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.296003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.296893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.297466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.298452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.299496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:56.300277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.300918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:56.317089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:56.337166 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f089800a-3833-4534-b216-18cb9dadbd93 tempest-ServicesAdminNegativeV253TestJSON-1947482525 tempest-ServicesAdminNegativeV253TestJSON-1947482525-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.059601 Jul 30 21:01:56.338211 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 183/445] 10.222.0.17 () {60 vars in 1239 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:56.340748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:56.347655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for user b2a05aa5d80844848bf57f6ca093e582 and project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:01:56.365329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:01:56.367959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:01:56.449045 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f90fcab3-f54c-46e9-a5b6-5de0c4b920d2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.238339 Jul 30 21:01:56.450888 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 263/446] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:01:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:01:56.813115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73a00eff-30e0-4e10-a849-7f6881c7efea tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-551744640", "id": 431611694, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:56.816621 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:56.816621 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:56.841491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73a00eff-30e0-4e10-a849-7f6881c7efea tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.499087 Jul 30 21:01:56.843213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 184/447] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:01:56 2022] POST /compute/v2.1/flavors => generated 445 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:56.848956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa026e61-e6ba-40c4-b1b9-e44b56663f3b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:56.852050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa026e61-e6ba-40c4-b1b9-e44b56663f3b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:56.961727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fa026e61-e6ba-40c4-b1b9-e44b56663f3b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:56.972287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa026e61-e6ba-40c4-b1b9-e44b56663f3b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1265 microversion: 2.1 time: 0.127776 Jul 30 21:01:56.975416 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 185/448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:56.996578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.008278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:57.022930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.023694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.024653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.025319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.110838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c346adf-4933-4180-aa8b-d37f22bab165 tempest-ServicesAdminNegativeV253TestJSON-821008213 tempest-ServicesAdminNegativeV253TestJSON-821008213-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.115135 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:57.115135 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:57.116738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c346adf-4933-4180-aa8b-d37f22bab165 tempest-ServicesAdminNegativeV253TestJSON-821008213 tempest-ServicesAdminNegativeV253TestJSON-821008213-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9a8dc3e3d50349a1964b714ffe3f5ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2282b704d7a040d785c8b90286ca9116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c346adf-4933-4180-aa8b-d37f22bab165 tempest-ServicesAdminNegativeV253TestJSON-821008213 tempest-ServicesAdminNegativeV253TestJSON-821008213-project] Request method failure captured: Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxA6vzr5ePrF_VY-IkMNaWcDX4B3SiCjJW9sXbg6JeZyzcK33yt0XKqmsqD00D1Bi4x2gxa-bjyg4FM1Q6AYUwL48wfjiYxvk0tXujMcvFN597ODy_JvuvJHjDIX1Oc-sUhrwwVcPzYiuxCS2PTOpp_mA0xNmx_1ESPJn8Qh8aCIWg Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.53 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2282b704d7a040d785c8b90286ca9116 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-821008213 Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:01:57.122053 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2282b704d7a040d785c8b90286ca9116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2282b704d7a040d785c8b90286ca9116", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2282b704d7a040d785c8b90286ca9116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2282b704d7a040d785c8b90286ca9116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-821008213 Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2282b704d7a040d785c8b90286ca9116 Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-821008213 Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-821008213-project Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9a8dc3e3d50349a1964b714ffe3f5ca7 Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-821008213-project Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:01:57.123498 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:01:57.124210 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:01:57.125278 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:01:57.129778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c346adf-4933-4180-aa8b-d37f22bab165 tempest-ServicesAdminNegativeV253TestJSON-821008213 tempest-ServicesAdminNegativeV253TestJSON-821008213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:01:57.135308 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c346adf-4933-4180-aa8b-d37f22bab165 tempest-ServicesAdminNegativeV253TestJSON-821008213 tempest-ServicesAdminNegativeV253TestJSON-821008213-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.681206 Jul 30 21:01:57.137931 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 264/449] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 686 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:01:57.454040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:57.469931 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bbfd1b74-8504-440a-a99b-1b7874e3834c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.493091 Jul 30 21:01:57.485870 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 186/450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:56 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:57.496056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.496725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:57.504973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.505852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.506967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.507671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.802611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:57.812655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:57.818034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:57.821017 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d687d478-817c-4f84-880f-08fbffcd9d20 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1559 microversion: 2.25 time: 0.332578 Jul 30 21:01:57.822091 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 187/451] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:57 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1559 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:57.842987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3828da5c-7036-4972-85bb-ed8eeb6a9f25 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '.version_select at 0x7fbb5d7e3700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.847531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3828da5c-7036-4972-85bb-ed8eeb6a9f25 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.848079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3828da5c-7036-4972-85bb-ed8eeb6a9f25 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.850436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06fdba7e-e50d-4882-aa0f-3745c2a353ff tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.864001 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3828da5c-7036-4972-85bb-ed8eeb6a9f25 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.024589 Jul 30 21:01:57.873338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 188/452] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 30 21:01:57 2022] GET /compute/v2.1/os-migrations => generated 856 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:01:57.878635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:57.879377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:57.885678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.886237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.887302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:57.887866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:57.918506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06fdba7e-e50d-4882-aa0f-3745c2a353ff tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] 10.222.0.17 "GET /compute/v2.1/flavors/431611694" status: 200 len: 445 microversion: 2.55 time: 0.774101 Jul 30 21:01:57.922892 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 265/453] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 30 21:01:57 2022] GET /compute/v2.1/flavors/431611694 => generated 445 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:57.955647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7578a85-ea31-41fd-8dfb-0e1c6152a057 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5fdd6700>, body: {"flavor": {"description": "new"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:57.993722 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:57.993722 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:01:58.046401 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7578a85-ea31-41fd-8dfb-0e1c6152a057 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/431611694" status: 200 len: 446 microversion: 2.55 time: 0.112398 Jul 30 21:01:58.047684 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 266/454] 10.222.0.17 () {62 vars in 1216 bytes} [Sat Jul 30 21:01:57 2022] PUT /compute/v2.1/flavors/431611694 => generated 446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:01:58.055814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.057296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:58.070870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:58.071837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:58.073701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:58.074157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:58.134457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 16030f4a-b40f-49fd-827f-c09a808c0e3e {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:01:58.179159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:58.197630 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa036c9f-f7e6-4f65-8e94-7508108ef3e5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 2052 microversion: 2.25 time: 0.322919 Jul 30 21:01:58.199759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a4fa63f6-1e1c-489e-8d84-a34c3a40ff16 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1317 microversion: 2.1 time: 0.143391 Jul 30 21:01:58.208008 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 189/455] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:01:57 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 2052 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:58.229029 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 267/456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:58 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:58.230573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-391d3a50-a4e7-4f20-9cb8-15752a24e587 tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.273627 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-391d3a50-a4e7-4f20-9cb8-15752a24e587 tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.064037 Jul 30 21:01:58.276079 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 190/457] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:01:58 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:58.294005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6da6cb6a-1275-4c1b-a4b1-6b244cab284c tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.328103 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6da6cb6a-1275-4c1b-a4b1-6b244cab284c tempest-FlavorsV255TestJSON-779079076 tempest-FlavorsV255TestJSON-779079076-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.038156 Jul 30 21:01:58.329949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 268/458] 10.222.0.17 () {60 vars in 1166 bytes} [Sat Jul 30 21:01:58 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:58.347655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ef5b2fc-1229-47ff-b6d8-d179a86f8d08 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.348846 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:01:58.348846 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:01:58.382747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ef5b2fc-1229-47ff-b6d8-d179a86f8d08 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/431611694" status: 202 len: 0 microversion: 2.55 time: 0.039976 Jul 30 21:01:58.384807 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 191/459] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 30 21:01:58 2022] DELETE /compute/v2.1/flavors/431611694 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:01:58.393264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f3ffbd3-7e9b-493e-ba3d-68407a682f27 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.431229 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f3ffbd3-7e9b-493e-ba3d-68407a682f27 tempest-FlavorsV255TestJSON-871789618 tempest-FlavorsV255TestJSON-871789618-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.041727 Jul 30 21:01:58.441081 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 269/460] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:01:58 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:01:58.494150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:58.495328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:58.506070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:58.508611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:58.509430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:58.509885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:58.709817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1507021413", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:58.815241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] validate_networks() for [('f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:01:58.957935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:58.981403 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77309333-508c-4c60-8a17-55d13092c457 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.490024 Jul 30 21:01:58.983093 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 192/461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:58 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:01:59.015616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-25382203-20e2-4336-9bc7-5420845a5668 req-2b020093-2802-4546-acc4-11cfbcdabc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e122a06c-f596-4f07-8a71-0afeabaf9749", "name": "network-vif-plugged", "status": "completed", "tag": "2814b9b0-cbb7-4f40-8a8e-39c2d8863d85"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:01:59.030232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25382203-20e2-4336-9bc7-5420845a5668 req-2b020093-2802-4546-acc4-11cfbcdabc2a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:59.031242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25382203-20e2-4336-9bc7-5420845a5668 req-2b020093-2802-4546-acc4-11cfbcdabc2a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:59.053526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-25382203-20e2-4336-9bc7-5420845a5668 req-2b020093-2802-4546-acc4-11cfbcdabc2a service nova] Creating event network-vif-plugged:2814b9b0-cbb7-4f40-8a8e-39c2d8863d85 for instance e122a06c-f596-4f07-8a71-0afeabaf9749 on nch1-master-1 Jul 30 21:01:59.084012 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-25382203-20e2-4336-9bc7-5420845a5668 req-2b020093-2802-4546-acc4-11cfbcdabc2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094863 Jul 30 21:01:59.089214 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 193/462] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:01:59.232551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:01:59.233262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:01:59.246155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:59.247470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:59.251031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:59.251446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:59.349390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:01:59.359317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ec60799-d933-44db-a1e7-c84ca8d4fb04 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1323 microversion: 2.1 time: 0.130840 Jul 30 21:01:59.370533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 194/463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:01:59 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1323 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:01:59.904120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:01:59.904696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:01:59.905437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:01:59.906189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:01:59.906859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:01:59.923307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:59.925638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:59.927416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:01:59.943024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:01:59.955177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=21 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:59.975184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:01:59.980259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for user 46d7264a2f63436bb8519cd8cec6d9f5 and project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:00.009485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:00.010352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:00.034727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:00.035364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:00.036271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:00.036849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:00.042913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:00.055998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:00.167241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2c17c14b-f547-4407-b782-c3a79d975e47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.463715 Jul 30 21:02:00.174181 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 270/464] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:02:00.183156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:00.186804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:00.305221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:00.317672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:00.323522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:00.326080 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7cc0abbc-77cc-454c-a80e-c259ee35991c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1262 microversion: 2.25 time: 0.148795 Jul 30 21:02:00.344920 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 271/465] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:00 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1262 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:00.360813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:00.372436 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d5e1bdb-aa46-4e63-b6da-851526e4dfac tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1311 microversion: 2.1 time: 0.366830 Jul 30 21:02:00.390865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:00.390865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:00.392534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 195/466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:00 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1311 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:00.396293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:00.396698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:00.397493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:00.397947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:00.912603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:00.919762 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20b0cc01-3602-4711-9dcf-bd09da34da4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.535125 Jul 30 21:02:00.920636 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 272/467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:00 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:01.716735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1768890719", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:01.823162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:01.950634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2fe9d2b-40fb-405a-b063-75a17a0cd85d tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d5f24c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:02.282080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:02.282531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:02.283024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:02.283514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:02.284614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:02.295849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=47 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:02.318116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.318597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.319524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.319981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.331311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=27 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:02.344332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:02.350251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for user 794f1a4f424d4b71a23649a4d178df28 and project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:02.363478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:02.366070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:02.419793 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ac484d3-b46f-413d-8418-2353631d8a4d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274820 Jul 30 21:02:02.421001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 196/468] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:02.426651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:02.427637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:02.439384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.439885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.440739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.441193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.510280 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2fe9d2b-40fb-405a-b063-75a17a0cd85d tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32" status: 200 len: 371 microversion: 2.1 time: 1.170076 Jul 30 21:02:02.519164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 273/469] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:02:01 2022] GET /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32 => generated 371 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:02.525009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-405624dd-f5a4-484b-b79f-63ade40be892 req-ce1c3b77-bc9d-418d-95e3-f028149d1788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64c39d9-ba7b-4de4-b129-e17f43a0cb67", "tag": "1359954f-9542-4a77-8e10-d59cb81727eb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:02.538954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-405624dd-f5a4-484b-b79f-63ade40be892 req-ce1c3b77-bc9d-418d-95e3-f028149d1788 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.539751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-405624dd-f5a4-484b-b79f-63ade40be892 req-ce1c3b77-bc9d-418d-95e3-f028149d1788 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.556375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:02.565648 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-405624dd-f5a4-484b-b79f-63ade40be892 req-ce1c3b77-bc9d-418d-95e3-f028149d1788 service nova] Creating event network-changed:1359954f-9542-4a77-8e10-d59cb81727eb for instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 on nch2-master-1 Jul 30 21:02:02.568955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:02.573887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:02.575606 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-037d44a5-9885-44d2-89cc-2a2606deba28 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1320 microversion: 2.25 time: 0.153454 Jul 30 21:02:02.576992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-405624dd-f5a4-484b-b79f-63ade40be892 req-ce1c3b77-bc9d-418d-95e3-f028149d1788 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055432 Jul 30 21:02:02.587568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 274/470] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:02.589562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 197/471] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:02 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:02.595630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:02.596334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:02.601032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:02.601864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:02.608758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.609279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.609462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.610439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.610900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.611564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.612428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:02.614266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:02.848217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:02.858557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b2ea849-0893-4321-9a73-2e41f102bd67 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1494 microversion: 2.1 time: 0.269452 Jul 30 21:02:02.860043 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 275/472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:02 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1494 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:02.866221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d58d310>, body: {"quota_set": {"ram": "5120"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:03.016818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:03.034109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7111bf2-a7c2-4cf8-9634-2b8345c1d99d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.440565 Jul 30 21:02:03.038475 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 198/473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:02 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:03.052767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-938838436", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:03.143066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:03.720491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.722988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.726402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.729387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.733984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:03.734639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:03.735205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:03.735877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:03.736388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:03.752577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.753744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.754852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.755588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.776614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:03.781495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for user 794f1a4f424d4b71a23649a4d178df28 and project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:03.796365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:03.799602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:03.848721 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b06303ff-dbcd-4764-b6bb-b3c022696f18 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32" status: 200 len: 328 microversion: 2.1 time: 0.987400 Jul 30 21:02:03.849381 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 276/474] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:02:02 2022] PUT /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32 => generated 328 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:03.865197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:03.865760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:03.885880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.886262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.890175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.890673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.903917 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5771bd49-1585-4f48-a765-e2e29621b901 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863739 Jul 30 21:02:03.904920 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 199/475] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:03.918813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:03.921438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:03.934855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.936461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:03.937836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:03.938692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:04.272084 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b0e5434-e17d-43b7-9587-479a92b41856 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1645 microversion: 2.1 time: 0.413749 Jul 30 21:02:04.287704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 277/476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:03 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1645 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:04.293117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25e29eab-9eca-4aac-9d72-1b28abdf9ed5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:04.308488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25e29eab-9eca-4aac-9d72-1b28abdf9ed5 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32" status: 202 len: 0 microversion: 2.1 time: 0.019243 Jul 30 21:02:04.313075 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 278/477] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:02:04 2022] DELETE /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:04.319358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a66b3afa-4ff1-44d6-bb4b-312ec0bb64bd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:04.320288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a66b3afa-4ff1-44d6-bb4b-312ec0bb64bd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:04.434620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a66b3afa-4ff1-44d6-bb4b-312ec0bb64bd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:04.445800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a66b3afa-4ff1-44d6-bb4b-312ec0bb64bd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1213 microversion: 2.1 time: 0.131085 Jul 30 21:02:04.448223 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 279/478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:04 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:04.461860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:04.466931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:04.482558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:04.483033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:04.483886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:04.488095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:04.495328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:04.507852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:04.512662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:04.516108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5d96ff5a-9588-421c-ac6c-d34a020e476f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.609727 Jul 30 21:02:04.517472 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 200/479] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:03 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:04.873266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:04.894545 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e035d5fe-bd10-4ea3-a189-225656e9c5e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.441900 Jul 30 21:02:04.897066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 280/480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:04 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:04.906566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:04.909930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:04.921958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:04.922519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:04.923744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:04.925132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:04.928640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f7e0e43-986c-489e-9588-666e683a9cd8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Action: 'create', calling method: .version_select at 0x7fbb5d7f7d30>, body: {"keypair": {"name": "tempest-keypair-1057772976", "type": "ssh", "user_id": "c9fa37569c0b40dda5ee332c28aab5b3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKqG+2Q4yc27A8q5w0IJ6vUTxzggBvIwfNnwTdfg+mebCRBBbOXg9XW/+PyS7AHGzBL1K/vBcqsQ4MorOjrVs/0Rg56IY6QlloeWAlyDSi6UvtbVvNDZg8uF2UbvUiYnA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:04.966699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6f7e0e43-986c-489e-9588-666e683a9cd8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:04.975272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6f7e0e43-986c-489e-9588-666e683a9cd8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for user f30b0cdda320406cbceb41bd29c42f6e and project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:05.032867 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f7e0e43-986c-489e-9588-666e683a9cd8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.512606 Jul 30 21:02:05.039584 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 201/481] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:02:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 516 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:02:05.046895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-25be56e1-6c77-4b27-bf87-f7f86b971f54 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d8721f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:05.140423 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a247c902-2628-47c5-ba73-a1af54c14d2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1645 microversion: 2.1 time: 0.238476 Jul 30 21:02:05.156799 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 281/482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:04 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1645 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:05.178154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-acc27e20-8e86-4a44-95b1-973ba159159a req-db78c6d5-5f41-4030-a7af-f1e62438ba1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3342a77-a30b-4279-81ad-4dc2565c46bb", "tag": "d85d36ee-c722-43a4-80db-13af2e6a562b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:05.198775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-acc27e20-8e86-4a44-95b1-973ba159159a req-db78c6d5-5f41-4030-a7af-f1e62438ba1d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.201404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-acc27e20-8e86-4a44-95b1-973ba159159a req-db78c6d5-5f41-4030-a7af-f1e62438ba1d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.236137 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-acc27e20-8e86-4a44-95b1-973ba159159a req-db78c6d5-5f41-4030-a7af-f1e62438ba1d service nova] Creating event network-changed:d85d36ee-c722-43a4-80db-13af2e6a562b for instance c3342a77-a30b-4279-81ad-4dc2565c46bb on nch2-master-1 Jul 30 21:02:05.243754 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-acc27e20-8e86-4a44-95b1-973ba159159a req-db78c6d5-5f41-4030-a7af-f1e62438ba1d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079151 Jul 30 21:02:05.247644 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 282/483] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:05.264281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc8a6cd7-81f5-4802-9143-5d85581e39a8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Action: 'create', calling method: .version_select at 0x7fbb5d4761f0>, body: {"keypair": {"name": "tempest-keypair-795474400", "type": "ssh", "user_id": "c9fa37569c0b40dda5ee332c28aab5b3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIThNZ/YFE+HCCMFa7DPkYbUv5H0hzNJNPtIKfOE+AzpHnwy29ErkYY612Yp8JmbaNH+siUIzTEIQw6h4rNBSstv6eYsKss0hpF0SZjaIAT/auvG1qPlIMQkor6TbfrI/w=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:05.276866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:05.337398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cc8a6cd7-81f5-4802-9143-5d85581e39a8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:05.342493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cc8a6cd7-81f5-4802-9143-5d85581e39a8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for user f30b0cdda320406cbceb41bd29c42f6e and project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:05.398543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc8a6cd7-81f5-4802-9143-5d85581e39a8 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.148618 Jul 30 21:02:05.399761 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 283/484] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:02:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:02:05.408269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:05.411728 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:05.411728 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:05.418394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.419879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.420885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.422959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.492093 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-25be56e1-6c77-4b27-bf87-f7f86b971f54 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32" status: 200 len: 371 microversion: 2.1 time: 0.454829 Jul 30 21:02:05.498798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 202/485] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/os-quota-sets/1636951001054e278919006d65686c32 => generated 371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:05.505944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e736e85-3b13-4062-9e64-ae42e3ca1bad tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Calling method '.version_select at 0x7fbb5d892c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:05.520306 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15caab0d-ab81-413e-9118-4055d9ca6613 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.119331 Jul 30 21:02:05.523796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 284/486] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:05.539772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e736e85-3b13-4062-9e64-ae42e3ca1bad tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1057772976?user_id=c9fa37569c0b40dda5ee332c28aab5b3" status: 200 len: 512 microversion: 2.10 time: 0.034492 Jul 30 21:02:05.549951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:05.549951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:05.553274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 203/487] 10.222.0.17 () {60 vars in 1340 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1057772976?user_id=c9fa37569c0b40dda5ee332c28aab5b3 => generated 512 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:05.560105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:05.564278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.564760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.566130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.566579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.567777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:05.582479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.582954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.587835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.588308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.771719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7dc00ae-10c6-4c7b-b60f-6b77213b0039 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749/action" status: 202 len: 0 microversion: 2.1 time: 0.214458 Jul 30 21:02:05.776026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 204/488] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:05 2022] POST /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:05.794240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:05.795892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:05.813344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.813805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.814694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:05.815187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:05.834425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:05.837959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:05.848932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e79f616-716a-4288-9e2c-1f7ea5d94c48 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1273 microversion: 2.1 time: 0.322848 Jul 30 21:02:05.849729 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 285/489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:05.873985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-237c9334-0f1a-418f-bef9-d25d73303876 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Action: 'create', calling method: .version_select at 0x7fbb5d4338b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-108140447", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdFB8x07wXXVoinaookGVZOT9zb4zVMa2qLJ1nnHHE/RiZ5PUtib9Jl6kdpoGIQcLZc5AdDwpR/WnEb6ZehtPi87NrdNr9TEU3mvYcdU59cfienmCltWS/XbQLIgUqing=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:05.891581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=71 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:05.893317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-237c9334-0f1a-418f-bef9-d25d73303876 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:05.899581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-237c9334-0f1a-418f-bef9-d25d73303876 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Getting quotas for user f30b0cdda320406cbceb41bd29c42f6e and project 2c02809c27a9408196c9c786844fcd00. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:05.941987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-237c9334-0f1a-418f-bef9-d25d73303876 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.072266 Jul 30 21:02:05.942789 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 286/490] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:02:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:02:06.311266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:06.319425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:06.341367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d4c5040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.342492 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:06.342492 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:06.343788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.344489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.355496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:06.360754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:06.369371 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f487134-ed38-4a9e-920e-48a438f8564b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.591531 Jul 30 21:02:06.370963 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 205/491] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:06.394391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.395664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:06.397501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.404959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.425523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.425844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.426687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.431887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.447673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.448071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.469973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c459c33f-4124-44fb-8640-1399683370e1 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.525875 Jul 30 21:02:06.473571 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 287/492] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:06.484222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-475e5fcf-506e-438c-bec1-f0df9354b20c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d47dd30>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.666751 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-475e5fcf-506e-438c-bec1-f0df9354b20c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.192039 Jul 30 21:02:06.680811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 288/493] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:02:06 2022] GET /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8/defaults => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:06.697463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.698106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:06.709145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.709606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.710395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.710838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.737535 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c3803c5-d2eb-475c-ad10-2470b4d2289b tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1630 microversion: 2.1 time: 0.363646 Jul 30 21:02:06.745339 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 206/494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:06 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1630 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:06.751263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d067bfd-fae9-48f4-a93e-ccd38849f8e6 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Calling method '.version_select at 0x7fbb5d8729d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.760101 ncdv-master-1 devstack@n-api.service[130983]: WARNING oslo_db.sqlalchemy.utils [None req-0d067bfd-fae9-48f4-a93e-ccd38849f8e6 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:02:06.778478 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d067bfd-fae9-48f4-a93e-ccd38849f8e6 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs?user_id=c9fa37569c0b40dda5ee332c28aab5b3" status: 200 len: 725 microversion: 2.10 time: 0.031040 Jul 30 21:02:06.781167 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 207/495] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Jul 30 21:02:06 2022] GET /compute/v2.1/os-keypairs?user_id=c9fa37569c0b40dda5ee332c28aab5b3 => generated 725 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:06.793682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d78a670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:06.798202 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:06.798202 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:06.801383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.804057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.848561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.849177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.860130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:06.866958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.867661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.881270 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1b0270c-c75c-47ea-a684-3d895aa4ed76 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.097151 Jul 30 21:02:06.882405 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 208/496] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:02:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:06.889925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:06.893902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:06.911233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.911794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.912645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:06.915154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:06.963256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lazy-loading 'flavor' on Instance uuid e122a06c-f596-4f07-8a71-0afeabaf9749 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:06.990357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Going to try to live migrate instance to nch2-master-1 {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:02:07.093111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:07.103560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2b7df612-c7ea-4d20-ba67-b5eed5a7c93b tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.414413 Jul 30 21:02:07.107510 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 289/497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:06 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:07.116600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d696222b-bbdf-4bda-b165-942dc681a211 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Calling method '.version_select at 0x7fbb5d420c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:07.162137 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d696222b-bbdf-4bda-b165-942dc681a211 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-108140447" status: 204 len: 0 microversion: 2.10 time: 0.053446 Jul 30 21:02:07.163412 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 290/498] 10.222.0.17 () {60 vars in 1322 bytes} [Sat Jul 30 21:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-108140447 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:02:07.172064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:07.174031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:07.194963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:07.195892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:07.196728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:07.200262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:07.609761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:07.624319 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c996e1ff-e41a-46fc-a3c1-9d2569e857cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.459651 Jul 30 21:02:07.637874 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 291/499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:07 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:07.642742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d47db80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:07.644086 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:07.644086 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:07.645721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:07.660019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:07.691927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:07.692403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:07.729346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:07.731370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:07.744200 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe5c4695-8635-4f23-8c2a-25de3940c691 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104837 Jul 30 21:02:07.748310 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 292/500] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:07.757901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d4c5790>, body: {"quota_set": {"ram": "5120"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:08.014172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.014866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.015785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.016234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.124797 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b951ef9a-7cab-414b-84c4-ca15a69941ce tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05" status: 200 len: 328 microversion: 2.1 time: 0.372648 Jul 30 21:02:08.133986 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 293/501] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:02:07 2022] PUT /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05 => generated 328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:08.152550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e79eb9c5-35ec-401a-96be-1e5480b145eb tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Calling method '.version_select at 0x7fbb5d4205e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:08.201455 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e79eb9c5-35ec-401a-96be-1e5480b145eb tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795474400?user_id=c9fa37569c0b40dda5ee332c28aab5b3" status: 204 len: 0 microversion: 2.10 time: 0.053480 Jul 30 21:02:08.202706 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 294/502] 10.222.0.17 () {60 vars in 1340 bytes} [Sat Jul 30 21:02:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795474400?user_id=c9fa37569c0b40dda5ee332c28aab5b3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:02:08.208993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:08.210600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:08.218990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.219822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.223876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.227351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.697285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:08.706831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:08.708516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:08.709731 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50d7a1b1-b6a8-4a6f-956c-64bfab2d0061 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.505653 Jul 30 21:02:08.718250 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 295/503] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:08 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:08.718250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d4acaf0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:08.718250 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:08.718250 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:08.718250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.718824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.746765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.747517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.759740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-efd957d1-c9f4-47c5-8690-d7c4779c9620 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.048258 Jul 30 21:02:08.770354 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 296/504] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:02:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:08.776047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:08.776682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:08.784209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.785035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:08.785492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:08.785945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.277439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:09.296173 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0e5ea1e3-f910-4c8d-8548-6d07d7fcc5b4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.524607 Jul 30 21:02:09.311334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 297/505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:08 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:09.317342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d4205e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:09.409122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.410649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.411827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.412527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.433497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-78afb240-d680-4bd7-a61e-0e2f2c081c64 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05/detail" status: 200 len: 916 microversion: 2.1 time: 0.120850 Jul 30 21:02:09.434500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 298/506] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:02:09 2022] GET /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05/detail => generated 916 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:09.469741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-dd2e7a04-1b74-47da-8055-695f17782073 req-c9e85b9a-15c9-4e8c-b903-cdddac917873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64c39d9-ba7b-4de4-b129-e17f43a0cb67", "name": "network-vif-plugged", "status": "completed", "tag": "1359954f-9542-4a77-8e10-d59cb81727eb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:09.484220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5298e27a-f1eb-4ef6-8ba9-341d89584a52 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749/action" status: 202 len: 0 microversion: 2.1 time: 2.599779 Jul 30 21:02:09.485537 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 209/507] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:06 2022] POST /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749/action => generated 0 bytes in 2602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:09.497204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22ed182f-791f-4bf9-9e1a-d02913b0fc90 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] Calling method '.version_select at 0x7fbb5d78aca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:09.523699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-dd2e7a04-1b74-47da-8055-695f17782073 req-c9e85b9a-15c9-4e8c-b903-cdddac917873 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.528926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-dd2e7a04-1b74-47da-8055-695f17782073 req-c9e85b9a-15c9-4e8c-b903-cdddac917873 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.568564 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-dd2e7a04-1b74-47da-8055-695f17782073 req-c9e85b9a-15c9-4e8c-b903-cdddac917873 service nova] Creating event network-vif-plugged:1359954f-9542-4a77-8e10-d59cb81727eb for instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 on nch2-master-1 Jul 30 21:02:09.573637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-dd2e7a04-1b74-47da-8055-695f17782073 req-c9e85b9a-15c9-4e8c-b903-cdddac917873 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112056 Jul 30 21:02:09.575138 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 299/508] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:09.579820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:09.581456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:09.600734 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22ed182f-791f-4bf9-9e1a-d02913b0fc90 tempest-KeyPairsV210TestJSON-1369393973 tempest-KeyPairsV210TestJSON-1369393973-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057772976?user_id=c9fa37569c0b40dda5ee332c28aab5b3" status: 204 len: 0 microversion: 2.10 time: 0.108027 Jul 30 21:02:09.604237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 210/509] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057772976?user_id=c9fa37569c0b40dda5ee332c28aab5b3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:02:09.618006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.618696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.620563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.621181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.622948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c62a67c-9938-4ab6-a943-5afc520aa9ae tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d872af0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:09.626715 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:09.626715 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:09.629579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c62a67c-9938-4ab6-a943-5afc520aa9ae tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.633979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c62a67c-9938-4ab6-a943-5afc520aa9ae tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.703159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c62a67c-9938-4ab6-a943-5afc520aa9ae tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.097429 Jul 30 21:02:09.708421 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 211/510] 10.222.0.17 () {58 vars in 1179 bytes} [Sat Jul 30 21:02:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:09.733318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-145f571c-4298-4e48-b0d8-93d8c168204d req-5b58680b-7ef9-47a1-938e-cf44f619823c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:09.770318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-145f571c-4298-4e48-b0d8-93d8c168204d req-5b58680b-7ef9-47a1-938e-cf44f619823c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.771539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-145f571c-4298-4e48-b0d8-93d8c168204d req-5b58680b-7ef9-47a1-938e-cf44f619823c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.817878 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-145f571c-4298-4e48-b0d8-93d8c168204d req-5b58680b-7ef9-47a1-938e-cf44f619823c service nova] Creating event network-changed:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:02:09.832064 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-145f571c-4298-4e48-b0d8-93d8c168204d req-5b58680b-7ef9-47a1-938e-cf44f619823c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121844 Jul 30 21:02:09.832668 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 212/511] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:09.843492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:09.845557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:09.864609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.866998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:09.869215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:09.870887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.196150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:10.203622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:10.210443 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21cae8ab-c333-4bcb-a7ae-629625aff3df tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.374649 Jul 30 21:02:10.213438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 213/512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:09 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:10.229346 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfe5a18d-7c01-4895-b080-e76a8b5f8f15 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.653507 Jul 30 21:02:10.232218 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 300/513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:09 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:10.232792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d7e3820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:10.238674 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:10.238674 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:10.239150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:10.240178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.240491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:10.240760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.248213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.248983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.249966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.250599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.275472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.276001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.309114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.313185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.333068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4711db42-6087-47ae-85a3-5bb5eba82d7d tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.115432 Jul 30 21:02:10.341172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 214/514] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:10.352102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d719c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:10.551312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:10.562979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:10.565077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:10.567148 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d70d94a2-dd5a-4afa-b841-3eaf1a1dc483 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.332879 Jul 30 21:02:10.568316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 301/515] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:10 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:10.573073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:10.573982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:10.590654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.591136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.592012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.592462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.674929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.676298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.677643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.678413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.722520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.722937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.723812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.724309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.804467 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3efcc9f-870c-4826-986f-9b39175849f4 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05?user_id=43946045d67a47bb8a98d284c359d50c" status: 200 len: 328 microversion: 2.1 time: 0.461874 Jul 30 21:02:10.805792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 215/516] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:02:10 2022] PUT /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05?user_id=43946045d67a47bb8a98d284c359d50c => generated 328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:10.811347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d78a670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:10.812797 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:10.812797 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:10.814400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.816254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.866453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:10.867194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:10.878016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a4979af-68d2-46d4-b12d-ec5cd90f036c tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.070364 Jul 30 21:02:10.879109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 216/517] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:02:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:10.884584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-043b1f7b-d63f-478d-aa2e-b515eb524034 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d734820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.034959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-043b1f7b-d63f-478d-aa2e-b515eb524034 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05?user_id=43946045d67a47bb8a98d284c359d50c" status: 200 len: 370 microversion: 2.1 time: 0.154278 Jul 30 21:02:11.035967 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 217/518] 10.222.0.17 () {58 vars in 1323 bytes} [Sat Jul 30 21:02:10 2022] GET /compute/v2.1/os-quota-sets/66a22f3ac1fc4302a21fa129e6b02d05?user_id=43946045d67a47bb8a98d284c359d50c => generated 370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:11.040620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d700430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.041785 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:11.041785 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:11.045070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:11.058412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.060725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.066235 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-906287d4-dee5-4f45-b09e-dd9bcf7f9141 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1389 microversion: 2.1 time: 0.496402 Jul 30 21:02:11.067112 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 302/519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:10 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1389 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:11.084258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.084916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.093803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31c1cb37-a25c-46e0-b204-6ca96bd7ad12 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.056663 Jul 30 21:02:11.094562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 218/520] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:02:11 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:11.108739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Calling method '.version_select at 0x7fbb5d3fd670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.109635 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:11.109635 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:11.110814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.111270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.127731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.128453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.141632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.142402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.236359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.237484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:11.252030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.252821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.254760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.256747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.349739 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a5699d4-2bf9-4695-9cac-5fe58ec6ead6 tempest-HypervisorAdminTestJSON-1390177776 tempest-HypervisorAdminTestJSON-1390177776-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.244395 Jul 30 21:02:11.350818 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 303/521] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 30 21:02:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:11.356925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.357605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:11.376046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.380759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.384074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.384741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.584626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:11.592869 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41f0d396-b619-40ea-8f39-84d77fa199f5 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.362484 Jul 30 21:02:11.607347 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 219/522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:11 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:11.613106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:11.619455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:11.646052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.649449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:11.651503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:11.651977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.255581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:12.271163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:12.278890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:12.280810 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-687b84b3-02dc-4508-8e00-b79bc7490c96 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.679990 Jul 30 21:02:12.282719 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 220/523] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:11 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:12.290205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e078e802-7fc9-4dbf-b79b-bc21f818fff3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Calling method '.version_select at 0x7fbb5d7001f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:12.539450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:12.565622 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b8eacae9-9277-476a-ae7d-681f604172a1 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 1.208578 Jul 30 21:02:12.567110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 304/524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:11 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:12.576983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bfdf28f4-fe6e-405f-99e2-c2033bbb38aa req-999a0ac3-86da-488a-b77e-dc2c2228b242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93785e3-3220-43c5-9b10-a2283a0d475c", "tag": "5977521f-81ef-4036-bcbc-0f538bede8d3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:12.600493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bfdf28f4-fe6e-405f-99e2-c2033bbb38aa req-999a0ac3-86da-488a-b77e-dc2c2228b242 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.601352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bfdf28f4-fe6e-405f-99e2-c2033bbb38aa req-999a0ac3-86da-488a-b77e-dc2c2228b242 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.631529 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bfdf28f4-fe6e-405f-99e2-c2033bbb38aa req-999a0ac3-86da-488a-b77e-dc2c2228b242 service nova] Creating event network-changed:5977521f-81ef-4036-bcbc-0f538bede8d3 for instance a93785e3-3220-43c5-9b10-a2283a0d475c on nch2-master-1 Jul 30 21:02:12.641020 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bfdf28f4-fe6e-405f-99e2-c2033bbb38aa req-999a0ac3-86da-488a-b77e-dc2c2228b242 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070756 Jul 30 21:02:12.642239 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 305/525] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:12.652099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9c4aa4ba-8815-45de-aef9-25e077d5b5ce req-1c5c2571-58f0-4387-95f5-c9139df7c308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3342a77-a30b-4279-81ad-4dc2565c46bb", "name": "network-vif-plugged", "status": "completed", "tag": "d85d36ee-c722-43a4-80db-13af2e6a562b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:12.665540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9c4aa4ba-8815-45de-aef9-25e077d5b5ce req-1c5c2571-58f0-4387-95f5-c9139df7c308 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.667225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9c4aa4ba-8815-45de-aef9-25e077d5b5ce req-1c5c2571-58f0-4387-95f5-c9139df7c308 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.719693 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e078e802-7fc9-4dbf-b79b-bc21f818fff3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.434486 Jul 30 21:02:12.720351 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 221/526] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:02:12 2022] GET /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8/defaults => generated 371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:12.735255 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9c4aa4ba-8815-45de-aef9-25e077d5b5ce req-1c5c2571-58f0-4387-95f5-c9139df7c308 service nova] Creating event network-vif-plugged:d85d36ee-c722-43a4-80db-13af2e6a562b for instance c3342a77-a30b-4279-81ad-4dc2565c46bb on nch2-master-1 Jul 30 21:02:12.740020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:12.740668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:12.753815 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9c4aa4ba-8815-45de-aef9-25e077d5b5ce req-1c5c2571-58f0-4387-95f5-c9139df7c308 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102911 Jul 30 21:02:12.757051 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 306/527] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:12.767562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.768818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.771063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.774326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.775058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:12.776344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:12.797967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.800952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:12.802712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:12.803955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.202238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:13.246182 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a9f349e-2c61-4aa9-bf1a-8b79eeb367c6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.486852 Jul 30 21:02:13.247454 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 307/528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:12 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:13.252303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d684550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:13.338046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.338793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.341481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.341974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.362432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:13.591479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:13.612671 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2f58645-ecf1-4729-ae0f-97778b9d109c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1588 microversion: 2.1 time: 0.889559 Jul 30 21:02:13.623592 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 222/529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:12 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1588 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:13.636325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:13.637054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:13.645634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.646097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.646915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.647374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.701188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-baa802c8-a104-47ed-8813-bc2ed3ed10f3 tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8" status: 200 len: 329 microversion: 2.1 time: 0.449305 Jul 30 21:02:13.701188 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 308/530] 10.222.0.17 () {60 vars in 1263 bytes} [Sat Jul 30 21:02:13 2022] PUT /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8 => generated 329 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:13.709005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:13.710012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:13.717628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.718334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.719196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:13.719757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:13.956464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:13.964717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:13.966470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:13.967815 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae65348a-675b-4033-bccc-8ba5556a0753 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1362 microversion: 2.25 time: 0.342975 Jul 30 21:02:13.968852 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 223/531] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:13 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:13.974792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:13.980996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:14.009893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.019936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.020810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.021279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.200316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:14.216165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa7401ba-cfe5-4c38-9d8c-006cb9ddec1f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.514334 Jul 30 21:02:14.217239 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 309/532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:13 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:14.222507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d476670>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:14.267726 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64159b03-9727-4bc7-8857-2c16ecfc7a77 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.297273 Jul 30 21:02:14.279231 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 224/533] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:02:13 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:14.290329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:14.291388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:14.301313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.302742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.303899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.304690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.572787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:14.584674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d311ffa3-0968-4f6c-95fc-1c5a4c76940e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.303821 Jul 30 21:02:14.587214 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 225/534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:14 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:14.726999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.730169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.732960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.743539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.748833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-88f93e93-6092-4a11-ba7f-4b0d688fbbf9 req-52af6a0b-e0e3-4367-bef5-bc5c926c3999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e122a06c-f596-4f07-8a71-0afeabaf9749", "name": "network-vif-unplugged", "status": "completed", "tag": "2814b9b0-cbb7-4f40-8a8e-39c2d8863d85"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:14.814828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-88f93e93-6092-4a11-ba7f-4b0d688fbbf9 req-52af6a0b-e0e3-4367-bef5-bc5c926c3999 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:14.817989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-88f93e93-6092-4a11-ba7f-4b0d688fbbf9 req-52af6a0b-e0e3-4367-bef5-bc5c926c3999 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:14.873036 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-88f93e93-6092-4a11-ba7f-4b0d688fbbf9 req-52af6a0b-e0e3-4367-bef5-bc5c926c3999 service nova] Creating event network-vif-unplugged:2814b9b0-cbb7-4f40-8a8e-39c2d8863d85 for instance e122a06c-f596-4f07-8a71-0afeabaf9749 on nch1-master-1 Jul 30 21:02:14.896747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-88f93e93-6092-4a11-ba7f-4b0d688fbbf9 req-52af6a0b-e0e3-4367-bef5-bc5c926c3999 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146996 Jul 30 21:02:14.914920 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 226/535] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:02:14.991479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:14.992437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:15.011356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.013980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.019043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.022093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.404158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:15.410983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.416910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:15.431464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:15.432733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b7bbf54-9ad6-44a3-8282-534c23095317 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1558 microversion: 2.25 time: 0.445849 Jul 30 21:02:15.440885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 227/536] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:14 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1558 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:15.456711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:15.457614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=27,nova_api:UPDATE=13 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.459005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:15.483950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.484504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.489743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.492403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.520419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e2a95bd-c79e-4b63-8cac-533d1bda548c tempest-QuotasAdminTestJSON-479583664 tempest-QuotasAdminTestJSON-479583664-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8" status: 200 len: 329 microversion: 2.1 time: 1.301821 Jul 30 21:02:15.528367 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 310/537] 10.222.0.17 () {60 vars in 1263 bytes} [Sat Jul 30 21:02:14 2022] PUT /compute/v2.1/os-quota-sets/adf4314354ea4f54a022211569ff95e8 => generated 329 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:15.535984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:15.537197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:15.552085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.552561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.554518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.554977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.601908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.874279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:15.887362 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7338ba23-a25a-46e1-805c-22a4bd226c99 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.443965 Jul 30 21:02:15.890142 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 228/538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:15 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:15.899660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:15.901124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:15.909694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.910329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:15.911587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:15.912283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:16.150726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:16.158947 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94c98791-f2a3-4b57-af48-17a66b2d411c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.264073 Jul 30 21:02:16.161254 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 229/539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:15 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:16.674665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:16.725367 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bfa81dac-e439-4c8c-8e48-799a8dd105e0 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 2051 microversion: 2.25 time: 1.198285 Jul 30 21:02:16.726700 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 311/540] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:15 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 2051 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:16.752832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:16.753795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:16.769466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:16.770148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:16.771150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:16.771782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:16.922139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:16.922770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:16.929601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:16.930069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:16.930863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:16.937170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.179539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:17.205236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6d251fb2-4697-4e50-a6f4-0cb2df4ea000 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 2051 microversion: 2.25 time: 0.456439 Jul 30 21:02:17.205833 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 230/541] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:16 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 2051 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:17.223178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7b5c131e-9892-4881-8fe6-64cb323a70ea req-08a7b31c-5af0-4fcb-8d31-32d3a5426131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e122a06c-f596-4f07-8a71-0afeabaf9749", "tag": "2814b9b0-cbb7-4f40-8a8e-39c2d8863d85"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:17.239341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b5c131e-9892-4881-8fe6-64cb323a70ea req-08a7b31c-5af0-4fcb-8d31-32d3a5426131 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.241626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b5c131e-9892-4881-8fe6-64cb323a70ea req-08a7b31c-5af0-4fcb-8d31-32d3a5426131 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.271014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:17.277464 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7b5c131e-9892-4881-8fe6-64cb323a70ea req-08a7b31c-5af0-4fcb-8d31-32d3a5426131 service nova] Creating event network-changed:2814b9b0-cbb7-4f40-8a8e-39c2d8863d85 for instance e122a06c-f596-4f07-8a71-0afeabaf9749 on nch1-master-1 Jul 30 21:02:17.279911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c80eac5a-96b9-44cd-83ef-9433ce44a6da tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.361666 Jul 30 21:02:17.286195 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7b5c131e-9892-4881-8fe6-64cb323a70ea req-08a7b31c-5af0-4fcb-8d31-32d3a5426131 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073392 Jul 30 21:02:17.286731 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 312/542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:16 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:17.300686 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 231/543] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:17.313853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:17.314307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:17.324593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.325250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.326213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.326953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.678351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8537746a-8ceb-4399-abf5-da6534dc2949 tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] Action: 'create', calling method: .version_select at 0x7fbb5d3b41f0>, body: {"security_group": {"name": "tempest-securitygroup-641860247", "description": "tempest-description-2117199361"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:17.738484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:17.760334 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43b178ef-21ea-42cd-bee0-1bcc1055c6f7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.457386 Jul 30 21:02:17.760976 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 232/544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:17 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:17.773941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:17.784533 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:17.784533 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:17.788336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.790081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.792122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.793828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.867806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b617ca35-fbd8-4581-bb1f-440d3e4ea8ba tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.102854 Jul 30 21:02:17.870876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 233/545] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Jul 30 21:02:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:17.894621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-da6e2978-a8bb-412f-9078-851bebfae95a req-0df619b9-6d3f-4b9a-a2b3-d11d1c692bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-plugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:17.916416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da6e2978-a8bb-412f-9078-851bebfae95a req-0df619b9-6d3f-4b9a-a2b3-d11d1c692bc8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:17.916770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da6e2978-a8bb-412f-9078-851bebfae95a req-0df619b9-6d3f-4b9a-a2b3-d11d1c692bc8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:17.949098 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-da6e2978-a8bb-412f-9078-851bebfae95a req-0df619b9-6d3f-4b9a-a2b3-d11d1c692bc8 service nova] Creating event network-vif-plugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:02:17.963495 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-da6e2978-a8bb-412f-9078-851bebfae95a req-0df619b9-6d3f-4b9a-a2b3-d11d1c692bc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081531 Jul 30 21:02:17.964484 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 234/546] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:02:17.975969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:17.977783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:17.999123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.001367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:18.011706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.015760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:18.154589 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c14dfd49-bdf0-40ba-aacb-4979de17640b tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb/action" status: 202 len: 0 microversion: 2.25 time: 0.184510 Jul 30 21:02:18.175462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 235/547] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:02:17 2022] POST /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:02:18.200814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:18.203900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:18.220801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.224100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:18.225144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.225748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:18.556365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:18.588913 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-450af733-90cc-419c-9848-9fce1d47d8a1 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 2056 microversion: 2.25 time: 0.403654 Jul 30 21:02:18.589882 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 236/548] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:18 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 2056 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:18.603362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:18.608941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:18.621344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.623278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:18.624332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:18.626539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.003871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:19.030308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-197f4eaa-8c0f-4947-abe5-8bcb71079c65 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.428320 Jul 30 21:02:19.048175 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 237/549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:18 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:19.055454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:19.056195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:19.068534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:19.068998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.069795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:19.070247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.134628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8537746a-8ceb-4399-abf5-da6534dc2949 tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.846491 Jul 30 21:02:19.135555 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 313/550] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:02:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:19.143321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:19.144987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:19.173901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:19.177271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.178545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:19.180651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.631624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:19.647690 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd8ba700-1577-4bd5-bd5d-bb15935841e2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 200 len: 1588 microversion: 2.1 time: 0.510077 Jul 30 21:02:19.648641 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 314/551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:19 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 1588 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:19.685630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d4514d3-c803-4333-bada-a5fd26ea370d tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] Action: 'create', calling method: .version_select at 0x7fbb5d47d4c0>, body: {"security_group": {"name": "tempest-securitygroup-891100928", "description": "tempest-description-681295681"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:19.812046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:19.821738 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6804ece8-cc62-495c-a786-ceb2c1811800 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.776917 Jul 30 21:02:19.829746 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 238/552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:19 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:19.842351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d4eb9266-60b3-454d-aeed-8cabe508ade7 req-ca09bc06-2bf1-4582-b22a-dbf64787086b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64c39d9-ba7b-4de4-b129-e17f43a0cb67", "tag": "1359954f-9542-4a77-8e10-d59cb81727eb"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:19.878894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d4eb9266-60b3-454d-aeed-8cabe508ade7 req-ca09bc06-2bf1-4582-b22a-dbf64787086b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:19.888467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d4eb9266-60b3-454d-aeed-8cabe508ade7 req-ca09bc06-2bf1-4582-b22a-dbf64787086b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:19.914475 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d4eb9266-60b3-454d-aeed-8cabe508ade7 req-ca09bc06-2bf1-4582-b22a-dbf64787086b service nova] Creating event network-changed:1359954f-9542-4a77-8e10-d59cb81727eb for instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 on nch2-master-1 Jul 30 21:02:19.947179 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d4eb9266-60b3-454d-aeed-8cabe508ade7 req-ca09bc06-2bf1-4582-b22a-dbf64787086b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113129 Jul 30 21:02:19.949272 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 239/553] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:19.964418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:19.967891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:19.998824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:20.003501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:20.006096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:20.008393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:20.582082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:20.610574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5353a7e4-664e-4426-958d-cd4ff3f11c49 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 2036 microversion: 2.25 time: 0.659921 Jul 30 21:02:20.616323 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 240/554] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:19 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 2036 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:20.624011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:20.627691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:20.654670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:20.657901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:20.659613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:20.666905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:20.910425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d4514d3-c803-4333-bada-a5fd26ea370d tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.234873 Jul 30 21:02:20.911666 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 315/555] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:02:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:20.917286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cd865981-1ce4-4eb6-9d72-a40871511037 req-89245122-b018-42f7-8d23-cb79f6829d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93785e3-3220-43c5-9b10-a2283a0d475c", "name": "network-vif-plugged", "status": "completed", "tag": "5977521f-81ef-4036-bcbc-0f538bede8d3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:20.949953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cd865981-1ce4-4eb6-9d72-a40871511037 req-89245122-b018-42f7-8d23-cb79f6829d66 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:20.950413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cd865981-1ce4-4eb6-9d72-a40871511037 req-89245122-b018-42f7-8d23-cb79f6829d66 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:20.962017 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cd865981-1ce4-4eb6-9d72-a40871511037 req-89245122-b018-42f7-8d23-cb79f6829d66 service nova] Creating event network-vif-plugged:5977521f-81ef-4036-bcbc-0f538bede8d3 for instance a93785e3-3220-43c5-9b10-a2283a0d475c on nch2-master-1 Jul 30 21:02:20.967510 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cd865981-1ce4-4eb6-9d72-a40871511037 req-89245122-b018-42f7-8d23-cb79f6829d66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053994 Jul 30 21:02:20.968682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 316/556] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:21.029447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=33 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:21.478974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Calling method '.version_select at 0x7fbb5d409ee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:21.479879 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:21.479879 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:21.481349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.481962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.511520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:21.523070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.525873 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b9a9afe-85e7-49b1-aa6a-d71a9c72cad0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1313 microversion: 2.1 time: 0.907702 Jul 30 21:02:21.527134 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 241/557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:20 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:21.527495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.546666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.551065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.562678 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39d84042-ad55-4167-bada-2852f2cc7390 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.592568 Jul 30 21:02:21.568710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:21.574026 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 317/558] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:02:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:21.575958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:21.579244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:21.587235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:21.587874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:21.593027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.594346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.596847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.599372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.601048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.610343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.611453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:21.611996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:21.679209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'flavor' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:21.711096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Going to try to live migrate instance to nch1-master-1 {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:02:22.441250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:22.455564 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39f75a2b-dda0-4153-b72a-3ffa5be3cd27 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.879524 Jul 30 21:02:22.468432 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 318/559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:21 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:23.044675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a021dd2-a95f-4970-9e04-0a84e3475ee7 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] Action: 'create', calling method: .version_select at 0x7fbb5d409dc0>, body: {"security_group": {"name": "tempest-securitygroup-1225184213", "description": "tempest-description-1095887546"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:24.111329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a021dd2-a95f-4970-9e04-0a84e3475ee7 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.641406 Jul 30 21:02:24.121633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 319/560] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:02:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:24.127642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Calling method '.version_select at 0x7fbb5d76b790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:24.128762 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:24.128762 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:24.135265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.136201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:24.175780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.176486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:24.190893 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-117c9a6f-d167-4a82-8627-d6e2db8a6606 tempest-HypervisorAdminV228Test-333301882 tempest-HypervisorAdminV228Test-333301882-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.067718 Jul 30 21:02:24.191548 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 320/561] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 21:02:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:24.219257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:24.219919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:24.256592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.259694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:24.260754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.261116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:24.668847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb29c9f8-7356-4ffb-af1f-8d4bf4eced03 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb/action" status: 202 len: 0 microversion: 2.25 time: 3.140022 Jul 30 21:02:24.670200 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 242/562] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:02:21 2022] POST /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb/action => generated 0 bytes in 3142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:02:24.756219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=13 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:24.875152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:24.889585 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bef570c-a01c-4db9-b948-ffdd397b116f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1463 microversion: 2.1 time: 0.693092 Jul 30 21:02:24.906392 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 321/563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:24 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1463 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:24.922624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:24.923935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:24.934046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.934674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:24.936116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:24.937113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.070118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d696430>, body: {"quota_set": {"ram": "5120"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:25.164788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.165351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.166188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.166647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.176607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:25.238343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fa2bd35-7101-4618-ba28-f866cea1e431 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0" status: 200 len: 148 microversion: 2.57 time: 0.566822 Jul 30 21:02:25.239168 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 243/564] 10.222.0.17 () {62 vars in 1303 bytes} [Sat Jul 30 21:02:24 2022] PUT /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0 => generated 148 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:25.244546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-743fa457-649c-4ae1-8260-3bbef89c9b17 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] Action: 'create', calling method: .version_select at 0x7fbb5d700670>, body: {"security_group": {"name": "tempest-securitygroup-1287669456", "description": "tempest-description-216921594"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:25.507649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=81 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:25.650616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-743fa457-649c-4ae1-8260-3bbef89c9b17 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.410042 Jul 30 21:02:25.651608 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 244/565] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:02:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:25.656877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:25.657817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:25.672414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.673650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.674476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.674933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.856552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:25.871365 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-167550fa-850e-4dbb-9be7-07fece40be35 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1504 microversion: 2.1 time: 0.963356 Jul 30 21:02:25.871957 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 322/566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:24 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1504 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:25.883853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:25.885771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:25.887735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:25.892994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:25.894520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:25.895719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-db7ad935-e11a-46e6-a1a8-00ff4f65ac2a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.242903 Jul 30 21:02:25.896278 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 245/567] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:25 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:25.897691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.898451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.899450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:25.900226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:25.902702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Calling method '.version_select at 0x7fbb5d719670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:26.222037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:26.222821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:26.223673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:26.224281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:26.254832 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9479974f-6cf1-429a-94a8-28100fa50542 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0/detail" status: 200 len: 463 microversion: 2.57 time: 0.354835 Jul 30 21:02:26.255992 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 246/568] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Jul 30 21:02:25 2022] GET /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0/detail => generated 463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:26.274032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72a8bd34-96fc-4241-979a-6837d87d2e23 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] Calling method '.version_select at 0x7fbb5d7000d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:26.381183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:26.409138 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5388b872-9636-4a9d-b03b-5d6b3161c5bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1464 microversion: 2.1 time: 0.520900 Jul 30 21:02:26.414451 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 323/569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:25 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1464 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:26.618018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1122492695", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e22ad54e-f15a-40e3-aa8b-d60574d444e8"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:26.715381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:27.245044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:27.245560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:27.246656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:27.247156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:27.247673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:27.284659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:27.285311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:27.286442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:27.287088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:27.343192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:27.351410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Getting quotas for user 794f1a4f424d4b71a23649a4d178df28 and project 7f71035a2ae04a76a9e82b6ccd3759cc. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:27.378431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:27.381174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:27.467963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a77b57d-1316-493e-b849-a3f25949a54b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855746 Jul 30 21:02:27.475315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 324/570] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:27.480544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d4aca60>, body: {"quota_set": {"ram": "2048"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:28.091607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.092206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.093523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.094082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.175797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.176206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.176961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.177405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.337448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33887029-a616-4d48-b8de-253c9c4e287c tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0?user_id=06191d3198294fe69ddc234ad730578b" status: 200 len: 148 microversion: 2.57 time: 0.865673 Jul 30 21:02:28.338941 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 325/571] 10.222.0.17 () {62 vars in 1384 bytes} [Sat Jul 30 21:02:27 2022] PUT /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0?user_id=06191d3198294fe69ddc234ad730578b => generated 148 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:28.344826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:28.346235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:28.354508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.356087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.357869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.358590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.674756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:28.686499 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d9ff5a2-6dad-4c53-8223-484bf166978b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1479 microversion: 2.1 time: 0.346041 Jul 30 21:02:28.687105 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 326/572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:28 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1479 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:28.697681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:28.698558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:28.713530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.717372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.718475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:28.719876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:28.987352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:28.999679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:29.001287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:29.003040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53b0331e-fd58-4f8a-a616-db07fbada109 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.312373 Jul 30 21:02:29.022790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 327/573] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:28 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:29.033736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:29.034359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:29.047379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.047852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:29.048807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.049253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:29.173763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72a8bd34-96fc-4241-979a-6837d87d2e23 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11053 microversion: 2.1 time: 2.915760 Jul 30 21:02:29.175239 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 247/574] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:02:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11053 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:29.177462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:29.180384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8029d1af-c18f-42c9-9380-2af4e9f362b3 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] Calling method '.version_select at 0x7fbb5d66ff70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:29.187368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67fc1e35-45aa-4e53-8c77-cc91c460a305 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1266 microversion: 2.1 time: 0.162167 Jul 30 21:02:29.187949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 328/575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:29 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:29.207532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e1701257-2b8d-4382-8978-8539cb7b8353 req-987d8dd2-69e4-4989-bb8b-860246b5a27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3342a77-a30b-4279-81ad-4dc2565c46bb", "name": "network-vif-unplugged", "status": "completed", "tag": "d85d36ee-c722-43a4-80db-13af2e6a562b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:29.238976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1701257-2b8d-4382-8978-8539cb7b8353 req-987d8dd2-69e4-4989-bb8b-860246b5a27d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.240403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1701257-2b8d-4382-8978-8539cb7b8353 req-987d8dd2-69e4-4989-bb8b-860246b5a27d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:29.255933 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e1701257-2b8d-4382-8978-8539cb7b8353 req-987d8dd2-69e4-4989-bb8b-860246b5a27d service nova] Creating event network-vif-unplugged:d85d36ee-c722-43a4-80db-13af2e6a562b for instance c3342a77-a30b-4279-81ad-4dc2565c46bb on nch2-master-1 Jul 30 21:02:29.261985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e1701257-2b8d-4382-8978-8539cb7b8353 req-987d8dd2-69e4-4989-bb8b-860246b5a27d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072599 Jul 30 21:02:29.263199 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 329/576] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:29.598883 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8029d1af-c18f-42c9-9380-2af4e9f362b3 tempest-QuotasAdminTestV257-2070427145 tempest-QuotasAdminTestV257-2070427145-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0?user_id=06191d3198294fe69ddc234ad730578b" status: 200 len: 190 microversion: 2.57 time: 0.422185 Jul 30 21:02:29.601947 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 248/577] 10.222.0.17 () {60 vars in 1364 bytes} [Sat Jul 30 21:02:29 2022] GET /compute/v2.1/os-quota-sets/4d6f6bd9a1474ee1afd21a8b0af48cc0?user_id=06191d3198294fe69ddc234ad730578b => generated 190 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:29.618626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa63b399-2bdd-44c5-bcb2-6cb76a78784f tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '.version_select at 0x7fbb5d6b4430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:29.624742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa63b399-2bdd-44c5-bcb2-6cb76a78784f tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.625870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa63b399-2bdd-44c5-bcb2-6cb76a78784f tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:29.635891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-adeec45b-4f32-47a8-ae25-4163c7b1febf tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Action: 'create', calling method: .version_select at 0x7fbb5d3fd0d0>, body: {"keypair": {"name": "tempest-keypair-1119317742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmGS6H0gV0hpsG+xnW7rz100F+Fg+K6A9iYBOTPe3MWz6Td8VqfiuHYffAG9rE03qTwWF9Xz3E+TqluArWoAK3QunFoL00FPpK44rdJl+2dz76VPeTZw8ghTDTeyMiDLA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:29.644082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa63b399-2bdd-44c5-bcb2-6cb76a78784f tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.040632 Jul 30 21:02:29.645804 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 249/578] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:02:29 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:29.651240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01df5923-da48-46cb-93b3-5c731ec646df tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] Calling method '.version_select at 0x7fbb5d662c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:29.670698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-adeec45b-4f32-47a8-ae25-4163c7b1febf tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:29.678231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-adeec45b-4f32-47a8-ae25-4163c7b1febf tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for user f8b35ab211584884a72057fa31184836 and project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:29.724536 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-adeec45b-4f32-47a8-ae25-4163c7b1febf tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.459808 Jul 30 21:02:29.731917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 330/579] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:02:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:29.736885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:29.740984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:29.758061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.759870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:29.764671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:29.765375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:30.016673 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01df5923-da48-46cb-93b3-5c731ec646df tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.368651 Jul 30 21:02:30.019032 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 250/580] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Jul 30 21:02:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:30.152783 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5730f0d-0a39-433f-bd5d-f3d8f5f2aeb9 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1630 microversion: 2.1 time: 0.419502 Jul 30 21:02:30.154449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 331/581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:29 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1630 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:30.169487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:30.170709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:30.193379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:30.194109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:30.200936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:30.201415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:30.347237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aaff769-7efa-434c-acd1-077577691da5 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Calling method '.version_select at 0x7fbb5d66f1f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:30.348873 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:30.348873 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:30.350302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8aaff769-7efa-434c-acd1-077577691da5 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fd423d778b194bfcb727a5209690445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8deb5dbf70f6412cbf8ac59ead5a9458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aaff769-7efa-434c-acd1-077577691da5 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Request method failure captured: Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxkuZdzv9-_4-oGgIoPzuJaWMpZkLim6LxH4hU18ZI6tfGQGJtgNL1XwRWgKHE8qhjGJhELadOngtoMhqHsABSNsaXQ4hxFjwvfvem2RJ4UGbw8xd5eVUxICX6XLU2vHLcyUACyrD-Ywmpv5zhTekbeC4U3wnv_qCOtXgvaThZhbYU Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:02:30.352801 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8deb5dbf70f6412cbf8ac59ead5a9458", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fd423d778b194bfcb727a5209690445c Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:02:30.354188 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:30.355017 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 30 21:02:30.356212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.359482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aaff769-7efa-434c-acd1-077577691da5 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:30.360560 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8aaff769-7efa-434c-acd1-077577691da5 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.339708 Jul 30 21:02:30.361715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 251/582] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:02:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:30.368459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da231c68-831a-445c-b66f-48fd05491df5 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] Calling method '.version_select at 0x7fbb5db16820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:30.542199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:30.560990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:30.562765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:30.564967 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0dc05b48-bdf9-49ae-a646-d53ac9633c47 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.409479 Jul 30 21:02:30.566133 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 332/583] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:30 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:30.571854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7865925f-aa18-4c0b-b78d-e3c862e417aa tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: .version_select at 0x7fbb5d35a940>, body: {"keypair": {"name": "tempest-keypair-1294741800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON21PmcandXudNsy2SRczdiaiGa7SnyBZXeoUI+5EKeJGaGFvGipubBctIPNYE+FDFtfTcVcS0FaGMi6ODa1zXSi2rj3q9nQStesaWYAUObRtI3w2DknADrLprj8rlk9A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:30.607940 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da231c68-831a-445c-b66f-48fd05491df5 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/21a3ef1d-ba4d-4275-b9e1-9bc47c3170c2" status: 202 len: 0 microversion: 2.1 time: 0.244790 Jul 30 21:02:30.608668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7865925f-aa18-4c0b-b78d-e3c862e417aa tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for project 81fb262c72e0468e92246bf31d93a204. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:30.609053 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 252/584] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:02:30 2022] DELETE /compute/v2.1/os-security-groups/21a3ef1d-ba4d-4275-b9e1-9bc47c3170c2 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:30.613583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7865925f-aa18-4c0b-b78d-e3c862e417aa tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for user 96815c6776f1464a8b6350b4a52d4548 and project 81fb262c72e0468e92246bf31d93a204. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:30.618728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:30.620173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:30.620396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:30.641778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:30.645415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:30.648733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:30.652334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:30.653391 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7865925f-aa18-4c0b-b78d-e3c862e417aa tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085760 Jul 30 21:02:30.655200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 333/585] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:02:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:30.695999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5337edc-b729-425d-b73d-c86c1f1372a9 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Calling method '.version_select at 0x7fbb5d47dca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:30.700007 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:30.700007 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:30.704438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b5337edc-b729-425d-b73d-c86c1f1372a9 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fd423d778b194bfcb727a5209690445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8deb5dbf70f6412cbf8ac59ead5a9458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5337edc-b729-425d-b73d-c86c1f1372a9 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Request method failure captured: Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxkuZdzv9-_4-oGgIoPzuJaWMpZkLim6LxH4hU18ZI6tfGQGJtgNL1XwRWgKHE8qhjGJhELadOngtoMhqHsABSNsaXQ4hxFjwvfvem2RJ4UGbw8xd5eVUxICX6XLU2vHLcyUACyrD-Ywmpv5zhTekbeC4U3wnv_qCOtXgvaThZhbYU Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:02:30.708193 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8deb5dbf70f6412cbf8ac59ead5a9458", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: fd423d778b194bfcb727a5209690445c Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:02:30.709602 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:30.711750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 30 21:02:30.712901 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:30.719050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5337edc-b729-425d-b73d-c86c1f1372a9 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:30.722229 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b5337edc-b729-425d-b73d-c86c1f1372a9 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.065358 Jul 30 21:02:30.724142 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 334/586] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:30 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:30.749006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2749018-5179-47b9-ae37-538619d6f628 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] Calling method '.version_select at 0x7fbb5d684550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.002810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:31.021945 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf199244-3865-423b-b131-8af17b98d7cb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.407938 Jul 30 21:02:31.031021 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 253/587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:30 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:31.046033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c98a06-541a-4bd6-b6fc-87eba0ec27e6 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Calling method '.version_select at 0x7fbb5db16820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.047238 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:31.047238 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:31.049501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15c98a06-541a-4bd6-b6fc-87eba0ec27e6 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fd423d778b194bfcb727a5209690445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8deb5dbf70f6412cbf8ac59ead5a9458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c98a06-541a-4bd6-b6fc-87eba0ec27e6 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Request method failure captured: Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxkuZdzv9-_4-oGgIoPzuJaWMpZkLim6LxH4hU18ZI6tfGQGJtgNL1XwRWgKHE8qhjGJhELadOngtoMhqHsABSNsaXQ4hxFjwvfvem2RJ4UGbw8xd5eVUxICX6XLU2vHLcyUACyrD-Ywmpv5zhTekbeC4U3wnv_qCOtXgvaThZhbYU Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:02:31.051552 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8deb5dbf70f6412cbf8ac59ead5a9458", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fd423d778b194bfcb727a5209690445c Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:02:31.053095 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:31.053939 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 30 21:02:31.055099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.057546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c98a06-541a-4bd6-b6fc-87eba0ec27e6 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:31.058596 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15c98a06-541a-4bd6-b6fc-87eba0ec27e6 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026168 Jul 30 21:02:31.059357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 254/588] 10.222.0.17 () {58 vars in 1179 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:31.381495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Calling method '.version_select at 0x7fbb5d66f8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.382398 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:31.382398 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:31.384389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.385036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.409443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.410294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.425757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.426588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.435527 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7df4ff8c-18d6-4a7d-be4c-25b659f8a3de tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.370219 Jul 30 21:02:31.436764 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 255/589] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:31.451773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0de32faf-50b1-480d-a6d9-a0234b0ede7f req-151c5920-4386-4d56-a859-e6583ecb3f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3342a77-a30b-4279-81ad-4dc2565c46bb", "tag": "d85d36ee-c722-43a4-80db-13af2e6a562b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:31.478031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0de32faf-50b1-480d-a6d9-a0234b0ede7f req-151c5920-4386-4d56-a859-e6583ecb3f83 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.478502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0de32faf-50b1-480d-a6d9-a0234b0ede7f req-151c5920-4386-4d56-a859-e6583ecb3f83 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.492596 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0de32faf-50b1-480d-a6d9-a0234b0ede7f req-151c5920-4386-4d56-a859-e6583ecb3f83 service nova] Creating event network-changed:d85d36ee-c722-43a4-80db-13af2e6a562b for instance c3342a77-a30b-4279-81ad-4dc2565c46bb on nch2-master-1 Jul 30 21:02:31.502526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0de32faf-50b1-480d-a6d9-a0234b0ede7f req-151c5920-4386-4d56-a859-e6583ecb3f83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064209 Jul 30 21:02:31.503517 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 256/590] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:31.525483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-65745ae5-60f3-41ab-8495-1471ef04023f tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Calling method '.version_select at 0x7fbb5d66f700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.526564 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:31.526564 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:31.527864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-65745ae5-60f3-41ab-8495-1471ef04023f tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fd423d778b194bfcb727a5209690445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8deb5dbf70f6412cbf8ac59ead5a9458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-65745ae5-60f3-41ab-8495-1471ef04023f tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Request method failure captured: Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxkuZdzv9-_4-oGgIoPzuJaWMpZkLim6LxH4hU18ZI6tfGQGJtgNL1XwRWgKHE8qhjGJhELadOngtoMhqHsABSNsaXQ4hxFjwvfvem2RJ4UGbw8xd5eVUxICX6XLU2vHLcyUACyrD-Ywmpv5zhTekbeC4U3wnv_qCOtXgvaThZhbYU Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:02:31.529584 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8deb5dbf70f6412cbf8ac59ead5a9458", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fd423d778b194bfcb727a5209690445c Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1'} Jul 30 21:02:31.531086 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:31.531934 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 30 21:02:31.533638 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.534615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-65745ae5-60f3-41ab-8495-1471ef04023f tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:31.534615 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-65745ae5-60f3-41ab-8495-1471ef04023f tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025825 Jul 30 21:02:31.547689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 257/591] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:31.552688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de19318f-80af-43be-a53c-b2cd9e5cc75f tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Calling method '.version_select at 0x7fbb5d78f9d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.554386 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-de19318f-80af-43be-a53c-b2cd9e5cc75f tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] HTTP exception thrown: Hypervisor with ID '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' could not be found. Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de19318f-80af-43be-a53c-b2cd9e5cc75f tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Request method failure captured: Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hypervisors/35c8cbf4-27ff-4aef-ae88-4509f5d0a808/uptime HTTP/1.1 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zxl5s-f0aZ9DVRgyZRc12wCGvfs4vKsxlRitkyTfBNp0zZubZvFe7qN6rUpxHHWBQVE65465TGGuDVb4kT01Kck2jlUwyc06LKfTWjfWEMBq4YkoroLDSOi0RLClTBGdJp4MzW6GWje3HV-0dPsTotAnE_n-xPf8lViI6WN8unXs94 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d18572c631c540dd8fda667bde89bf25 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:02:31.562629 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d18572c631c540dd8fda667bde89bf25", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d18572c631c540dd8fda667bde89bf25 Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 60517c0cc1c647dd993e3c3cb945ac1a Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: exception: Hypervisor with ID '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' could not be found. Jul 30 21:02:31.564149 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '35c8cbf4-27ff-4aef-ae88-4509f5d0a808'} Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 30 21:02:31.564946 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' could not be found. Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:31.566375 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' could not be found. Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de19318f-80af-43be-a53c-b2cd9e5cc75f tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Returning 404 to user: Hypervisor with ID '35c8cbf4-27ff-4aef-ae88-4509f5d0a808' could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:31.570313 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de19318f-80af-43be-a53c-b2cd9e5cc75f tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/35c8cbf4-27ff-4aef-ae88-4509f5d0a808/uptime" status: 404 len: 123 microversion: 2.1 time: 0.021125 Jul 30 21:02:31.571564 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 258/592] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/os-hypervisors/35c8cbf4-27ff-4aef-ae88-4509f5d0a808/uptime => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:31.581491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Calling method '.version_select at 0x7fbb5d700820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.583689 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:31.583689 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:31.588280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.588959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.628592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.629059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.653582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.654653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.666739 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0278dbaf-5b04-4783-bec2-acc98c4a6747 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090100 Jul 30 21:02:31.669298 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 259/593] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:31.676883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:31.677922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:31.687065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.688426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:31.690205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:31.691251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:32.035852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:32.065140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:32.067914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:32.069730 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e421fed-f215-45a9-9595-a9c6b4f9f2aa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.398462 Jul 30 21:02:32.070476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 260/594] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:31 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:32.075886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e1d8457-0d42-4eea-90c1-145664d879f4 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Calling method '.version_select at 0x7fbb5d700dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:32.076873 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:32.076873 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:02:32.078987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e1d8457-0d42-4eea-90c1-145664d879f4 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fd423d778b194bfcb727a5209690445c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8deb5dbf70f6412cbf8ac59ead5a9458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e1d8457-0d42-4eea-90c1-145664d879f4 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Request method failure captured: Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxkuZdzv9-_4-oGgIoPzuJaWMpZkLim6LxH4hU18ZI6tfGQGJtgNL1XwRWgKHE8qhjGJhELadOngtoMhqHsABSNsaXQ4hxFjwvfvem2RJ4UGbw8xd5eVUxICX6XLU2vHLcyUACyrD-Ywmpv5zhTekbeC4U3wnv_qCOtXgvaThZhbYU Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:02:32.081608 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8deb5dbf70f6412cbf8ac59ead5a9458", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8deb5dbf70f6412cbf8ac59ead5a9458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8deb5dbf70f6412cbf8ac59ead5a9458 Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916 Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fd423d778b194bfcb727a5209690445c Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1516666916-project Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1'} Jul 30 21:02:32.082924 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:32.083744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 30 21:02:32.084840 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.088277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e1d8457-0d42-4eea-90c1-145664d879f4 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:32.089344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e1d8457-0d42-4eea-90c1-145664d879f4 tempest-HypervisorAdminNegativeTestJSON-1516666916 tempest-HypervisorAdminNegativeTestJSON-1516666916-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017838 Jul 30 21:02:32.090576 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 261/595] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:02:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:32.098646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:32.099406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:32.108190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:32.108905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:32.110154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:32.110868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:32.372524 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2749018-5179-47b9-ae37-538619d6f628 tempest-SecurityGroupsTestAdminJSON-115643030 tempest-SecurityGroupsTestAdminJSON-115643030-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/bf3aaba7-7b7d-4f3d-a25a-01389bc3dc76" status: 202 len: 0 microversion: 2.1 time: 1.641870 Jul 30 21:02:32.378646 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 335/596] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:02:30 2022] DELETE /compute/v2.1/os-security-groups/bf3aaba7-7b7d-4f3d-a25a-01389bc3dc76 => generated 0 bytes in 1654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:32.384677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b31c484-04e4-483b-b339-ddb829e95fb0 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Calling method '.version_select at 0x7fbb5d3b09d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:32.386767 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:02:32.386767 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:02:32.388319 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0b31c484-04e4-483b-b339-ddb829e95fb0 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] HTTP exception thrown: Hypervisor with ID 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' could not be found. Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b31c484-04e4-483b-b339-ddb829e95fb0 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Request method failure captured: Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-hypervisors/feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c HTTP/1.1 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zxl5s-f0aZ9DVRgyZRc12wCGvfs4vKsxlRitkyTfBNp0zZubZvFe7qN6rUpxHHWBQVE65465TGGuDVb4kT01Kck2jlUwyc06LKfTWjfWEMBq4YkoroLDSOi0RLClTBGdJp4MzW6GWje3HV-0dPsTotAnE_n-xPf8lViI6WN8unXs94 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d18572c631c540dd8fda667bde89bf25 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:02:32.391059 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d18572c631c540dd8fda667bde89bf25", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d18572c631c540dd8fda667bde89bf25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d18572c631c540dd8fda667bde89bf25 Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-387093017 Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 60517c0cc1c647dd993e3c3cb945ac1a Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: exception: Hypervisor with ID 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' could not be found. Jul 30 21:02:32.392454 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c'} Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 30 21:02:32.393267 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:02:32.394530 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' could not be found. Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' could not be found. Jul 30 21:02:32.397541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:02:32.399782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b31c484-04e4-483b-b339-ddb829e95fb0 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] Returning 404 to user: Hypervisor with ID 'feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c' could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:32.400889 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b31c484-04e4-483b-b339-ddb829e95fb0 tempest-HypervisorAdminNegativeTestJSON-387093017 tempest-HypervisorAdminNegativeTestJSON-387093017-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c" status: 404 len: 123 microversion: 2.1 time: 0.020397 Jul 30 21:02:32.402017 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 336/597] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:02:32 2022] GET /compute/v2.1/os-hypervisors/feb0a3fc-2f35-403a-9bf0-8c784e2f8f0c => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:32.414281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fcd15b81-399c-4a40-9ede-b84d5d4a9b84 tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] Calling method '.version_select at 0x7fbb5d35aaf0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:32.740340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:32.749146 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bbda8bad-51c8-4dc4-9259-08a3e5a205e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.657035 Jul 30 21:02:32.764283 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 262/598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:32 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:33.093526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:33.094452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:33.101533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:33.102263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:33.103313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:33.103965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:33.327787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fcd15b81-399c-4a40-9ede-b84d5d4a9b84 tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/c0c5cd31-6f5c-48ff-8c9a-02e58e96028d" status: 202 len: 0 microversion: 2.1 time: 0.924392 Jul 30 21:02:33.335772 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 337/599] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:02:32 2022] DELETE /compute/v2.1/os-security-groups/c0c5cd31-6f5c-48ff-8c9a-02e58e96028d => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:33.343208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-048517af-68ba-4984-9ec2-71b3f90d3fcd tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] Calling method '.version_select at 0x7fbb5d3c3ee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:33.613867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:33.625085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:33.626902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:33.628446 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7570219e-5282-42fc-9b08-f5b49002767b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.539365 Jul 30 21:02:33.643750 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 263/600] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:33 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:02:33.792300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:33.807406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:33.820867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:33.821570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:33.822984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:33.824098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:34.162525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-048517af-68ba-4984-9ec2-71b3f90d3fcd tempest-SecurityGroupsTestAdminJSON-1804425821 tempest-SecurityGroupsTestAdminJSON-1804425821-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d588c4ae-e931-4bd0-9cdb-82e0ed645b3b" status: 202 len: 0 microversion: 2.1 time: 0.824914 Jul 30 21:02:34.163753 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 338/601] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:02:33 2022] DELETE /compute/v2.1/os-security-groups/d588c4ae-e931-4bd0-9cdb-82e0ed645b3b => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:34.175306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-657240b4-77c6-457e-8fe5-310be6c7f40b req-00a46db9-d92a-41e3-afac-758fdf2dd20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f650875c-acea-4ada-bf93-9e8f03540c5a", "tag": "d8a45442-0149-496e-90cb-ce280ddcbcec"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:34.187422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-657240b4-77c6-457e-8fe5-310be6c7f40b req-00a46db9-d92a-41e3-afac-758fdf2dd20e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:34.188196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-657240b4-77c6-457e-8fe5-310be6c7f40b req-00a46db9-d92a-41e3-afac-758fdf2dd20e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:34.223166 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-657240b4-77c6-457e-8fe5-310be6c7f40b req-00a46db9-d92a-41e3-afac-758fdf2dd20e service nova] Creating event network-changed:d8a45442-0149-496e-90cb-ce280ddcbcec for instance f650875c-acea-4ada-bf93-9e8f03540c5a on nch1-master-1 Jul 30 21:02:34.242151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-657240b4-77c6-457e-8fe5-310be6c7f40b req-00a46db9-d92a-41e3-afac-758fdf2dd20e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067069 Jul 30 21:02:34.244815 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 339/602] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:34.365329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:34.379528 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75d8fd00-8367-454a-8e37-7836a07d4861 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.604697 Jul 30 21:02:34.391326 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 264/603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:33 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:34.652574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:34.653737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:34.672390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:34.675157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:34.677949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:34.680178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:34.716980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-101767934", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "958fb119-4aee-4de6-9af0-281e0123ec69"}], "security_groups": [{"name": "tempest-securitygroup--415782457"}], "key_name": "tempest-keypair-1119317742", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:35.019444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] validate_networks() for [('958fb119-4aee-4de6-9af0-281e0123ec69', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:35.075668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:35.087531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:35.090456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:35.092164 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87477966-b699-45cc-9931-0f5c61b66bd0 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.445123 Jul 30 21:02:35.106788 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 340/604] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:34 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:35.402177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:35.403745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:35.411940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:35.416010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:35.419674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:35.419674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:35.425575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.599582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:35.608276 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-495ab8a1-7b16-4f2f-99f8-b29932e45935 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.210159 Jul 30 21:02:35.609037 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 341/605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:35 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:35.630275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-706069421", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "68a236a2-c168-48e8-bff4-a731709fe73b"}], "security_groups": [{"name": "tempest-securitygroup--1759113823"}], "key_name": "tempest-keypair-1294741800", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:35.718052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:35.718492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:35.718981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:35.719594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:35.720696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:35.731056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:35.731790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:35.732970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:35.733607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:35.743644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=15 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:35.759323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:35.764229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for user f8b35ab211584884a72057fa31184836 and project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:35.772918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] validate_networks() for [('68a236a2-c168-48e8-bff4-a731709fe73b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:35.777807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:35.780180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:35.837809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-17611a03-3099-4070-bb62-3604e8fbff32 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.124881 Jul 30 21:02:35.839072 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 265/606] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:35.854874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5957b47-e71a-4245-9f2a-d73bf3761dbd tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:35.855542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f5957b47-e71a-4245-9f2a-d73bf3761dbd tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:35.941783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f5957b47-e71a-4245-9f2a-d73bf3761dbd tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:35.949421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f5957b47-e71a-4245-9f2a-d73bf3761dbd tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1241 microversion: 2.1 time: 0.103037 Jul 30 21:02:35.951185 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 266/607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:35 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:36.119474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:36.120327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:36.155525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.156311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.175720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.179804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.528253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:36.542038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:36.550052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:36.554769 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-754c7284-ef2d-4e35-b712-76ef836549be tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.440477 Jul 30 21:02:36.557452 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 267/608] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:36 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:36.629936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:36.630600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:36.641367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.643053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.645134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.646953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.861877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:36.862398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:36.862800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:36.863227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:36.864150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:36.887964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.888441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.889297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:36.889757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:36.967867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:36.981980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for user 96815c6776f1464a8b6350b4a52d4548 and project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:37.024986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:37.027932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:37.134757 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69ad7e15-87b3-4dc5-a936-aedc0d4f8081 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.515183 Jul 30 21:02:37.137807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 342/609] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:37.152547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:37.154152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:37.165706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:37.166520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:37.167633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:37.169268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:37.400934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:37.411343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f6ab12ba-becd-4b16-bd7b-18a62802c601 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.785729 Jul 30 21:02:37.414431 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 268/610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:36 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:37.441610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc6abdf7-3c87-4f6f-955f-8514ad1ddcd4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:37.442350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc6abdf7-3c87-4f6f-955f-8514ad1ddcd4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:37.576784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:37.589579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8103c743-63de-49bc-97b7-98d3fad5d362 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1293 microversion: 2.1 time: 0.449243 Jul 30 21:02:37.593202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 343/611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:37 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1293 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:37.607281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:37.607948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:37.623594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:37.624119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:37.624862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:37.625440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:37.763769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bc6abdf7-3c87-4f6f-955f-8514ad1ddcd4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:37.779458 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc6abdf7-3c87-4f6f-955f-8514ad1ddcd4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1234 microversion: 2.1 time: 0.360026 Jul 30 21:02:37.797490 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 269/612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:37 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1234 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:38.042880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:38.061577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:38.066292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:38.067704 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b1a12e5-b9b5-43dd-a7c8-50640a60f6ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1568 microversion: 2.25 time: 0.469076 Jul 30 21:02:38.072461 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 344/613] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:37 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:38.435937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:38.436763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:38.450307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.451117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:38.454069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.454773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:38.620487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:38.622002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:38.638877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.639685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:38.642320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.644175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:38.699010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:38.713089 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4a0f926e-4828-45e2-b332-ac9027d7f098 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.281357 Jul 30 21:02:38.731324 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 270/614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:38 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:38.807864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:38.808988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:38.861016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.865024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:38.867509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:38.868557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:39.136777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:39.148841 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eabe83d2-8ec5-4968-8fd7-68d1b2aa219e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1304 microversion: 2.1 time: 0.345779 Jul 30 21:02:39.150713 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 271/615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:38 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1304 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:39.160730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:39.161693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:39.178441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:39.179642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:39.180946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:39.181529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:39.261975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:39.280328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfb16afd-a2c0-4a56-acb2-a61d9c24b779 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.664834 Jul 30 21:02:39.282655 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 345/616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:38 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:39.602957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:39.614211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-708462518", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:39.626608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:39.633169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:39.636816 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ed30f9d-c1a5-4977-933d-d5ec6a534959 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1543 microversion: 2.25 time: 0.483730 Jul 30 21:02:39.655243 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 272/617] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:39 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1543 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:39.669432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41da14d8-6aeb-4e89-8ce8-803b0a8949ed tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '.version_select at 0x7fbb5d6564c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:39.687086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41da14d8-6aeb-4e89-8ce8-803b0a8949ed tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:39.692789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41da14d8-6aeb-4e89-8ce8-803b0a8949ed tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:39.722264 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41da14d8-6aeb-4e89-8ce8-803b0a8949ed tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.053909 Jul 30 21:02:39.727675 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 273/618] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 30 21:02:39 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:39.738083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:39.738698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:39.739794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:39.747383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:39.748680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:39.749637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:39.750177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.053304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:02:40.083809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ec347c4-a777-417b-85fd-2f2019943c6e tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 2036 microversion: 2.25 time: 0.349941 Jul 30 21:02:40.085155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 274/619] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:39 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 2036 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:40.090578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:40.091636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:40.098309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.099231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.100253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.100962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.117624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:40.231851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:40.232490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:40.234198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:40.236497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:40.238884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:40.255817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.256481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.257852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.258738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.286747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Getting quotas for project b0afe6bde6aa4c1dbe9a01c553ee801f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:40.313162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Getting quotas for user e4b9f2d931d64de6a0ecdb1082102adb and project b0afe6bde6aa4c1dbe9a01c553ee801f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:40.345580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:40.348802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:40.379713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:40.404169 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-088563da-e04d-493a-9a89-b3f137997d37 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.316510 Jul 30 21:02:40.405923 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 275/620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:40 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:40.415698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d06a754-9594-4db2-8dda-2682c1538e00 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: .version_select at 0x7fbb5d7e34c0>, body: {"keypair": {"name": "tempest-keypair-1645645957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAHk3hooBN6awm9WUw4Rpm4cFkx2Qvy7g9mXx4eBPnss7feVO0u5Iy9DmnQmoUpbKTppukDKpELBxeNLqkhw82oks5IS6JXfEvyK5izUgjVs2Uh1rCGjvh9QvxLQoGzxg=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:40.472325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc5b3d9c-4c51-479c-8918-8d6117f54940 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187876 Jul 30 21:02:40.474996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 346/621] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:40.484408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7d06a754-9594-4db2-8dda-2682c1538e00 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for project bfb74be507694713821cb1a68619f9e2. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:40.492735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:40.493619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:40.497328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7d06a754-9594-4db2-8dda-2682c1538e00 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for user 46d7264a2f63436bb8519cd8cec6d9f5 and project bfb74be507694713821cb1a68619f9e2. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:40.516441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.516913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.517704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.518154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.556217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:40.591763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d06a754-9594-4db2-8dda-2682c1538e00 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.182408 Jul 30 21:02:40.596284 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 276/622] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:02:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:02:40.624289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:40.627694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:40.643034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.643648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:40.647959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:40.648555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:41.051843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:41.063181 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5214244f-54ac-4f67-98e4-5a9421cc66cb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.586643 Jul 30 21:02:41.078249 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 347/623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:40 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:41.089941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49e7e0e5-c5eb-42c9-b83e-68d7d9eb0b7b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:41.093170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49e7e0e5-c5eb-42c9-b83e-68d7d9eb0b7b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:41.253581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49e7e0e5-c5eb-42c9-b83e-68d7d9eb0b7b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:41.264338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49e7e0e5-c5eb-42c9-b83e-68d7d9eb0b7b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1222 microversion: 2.1 time: 0.184849 Jul 30 21:02:41.273766 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 348/624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:41 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:41.290643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-712a4a35-1612-43a9-965f-f63201343ae6 req-82b6688f-4d4d-45a2-94df-252f5a0b9ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3766e564-dc7d-4328-9cf8-cd5dd04c9a41", "tag": "f6582567-866b-42b5-9909-5470ec2926cf"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:41.310423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-712a4a35-1612-43a9-965f-f63201343ae6 req-82b6688f-4d4d-45a2-94df-252f5a0b9ab9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:41.311514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-712a4a35-1612-43a9-965f-f63201343ae6 req-82b6688f-4d4d-45a2-94df-252f5a0b9ab9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:41.329689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-712a4a35-1612-43a9-965f-f63201343ae6 req-82b6688f-4d4d-45a2-94df-252f5a0b9ab9 service nova] Creating event network-changed:f6582567-866b-42b5-9909-5470ec2926cf for instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 on nch1-master-1 Jul 30 21:02:41.336019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-712a4a35-1612-43a9-965f-f63201343ae6 req-82b6688f-4d4d-45a2-94df-252f5a0b9ab9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060065 Jul 30 21:02:41.337146 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 349/625] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:41.344108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bc433e05-c864-4eab-bc5e-825474c659ce req-d24b6c7c-59de-460f-8a77-284e6011be11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f650875c-acea-4ada-bf93-9e8f03540c5a", "name": "network-vif-plugged", "status": "completed", "tag": "d8a45442-0149-496e-90cb-ce280ddcbcec"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:41.354298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:41.362671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc433e05-c864-4eab-bc5e-825474c659ce req-d24b6c7c-59de-460f-8a77-284e6011be11 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:41.363420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc433e05-c864-4eab-bc5e-825474c659ce req-d24b6c7c-59de-460f-8a77-284e6011be11 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:41.364108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f20fde3a-bb8b-43ae-b67f-3398c389530b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.766464 Jul 30 21:02:41.365235 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 277/626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:40 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:41.380967 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bc433e05-c864-4eab-bc5e-825474c659ce req-d24b6c7c-59de-460f-8a77-284e6011be11 service nova] Creating event network-vif-plugged:d8a45442-0149-496e-90cb-ce280ddcbcec for instance f650875c-acea-4ada-bf93-9e8f03540c5a on nch1-master-1 Jul 30 21:02:41.389185 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bc433e05-c864-4eab-bc5e-825474c659ce req-d24b6c7c-59de-460f-8a77-284e6011be11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049428 Jul 30 21:02:41.416945 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 350/627] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:41.433266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:41.434086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:41.460657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:41.461236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:41.463162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:41.463673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:41.864747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:41.895509 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfc9cfb5-0ed6-4553-bbf3-76d616cfb766 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.472162 Jul 30 21:02:41.903559 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 278/628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:41 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:42.091766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:42.093183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:42.117423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.118037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.118960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.119450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.304657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:42.305429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:42.319499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.320129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.323723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.323723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.411079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:42.421593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9f21dc84-4f48-42b1-a0b3-05e63a5acca3 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1280 microversion: 2.1 time: 0.125829 Jul 30 21:02:42.423202 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 279/629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:42 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:42.428953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:42.429681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:42.438079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.439405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.440395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.440937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.732304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:42.743187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69071db4-f7b3-4a11-85c6-8981bf53e580 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.318545 Jul 30 21:02:42.743751 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 280/630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:42 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:42.819753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:42.836215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b50de33-2062-4919-bc13-1c8b06962e5a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.750742 Jul 30 21:02:42.851320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 351/631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:42 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:42.917273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:42.918083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:42.924925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.925413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:42.926963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:42.927470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:43.195561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ea707ebe-55e3-411c-be74-41664f9a0f11 req-5e1e561a-2e71-4747-a75c-deeda506a609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:43.213749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ea707ebe-55e3-411c-be74-41664f9a0f11 req-5e1e561a-2e71-4747-a75c-deeda506a609 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:43.215957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ea707ebe-55e3-411c-be74-41664f9a0f11 req-5e1e561a-2e71-4747-a75c-deeda506a609 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:43.232789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:43.244436 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ea707ebe-55e3-411c-be74-41664f9a0f11 req-5e1e561a-2e71-4747-a75c-deeda506a609 service nova] Creating event network-changed:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch1-master-1 Jul 30 21:02:43.251899 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c29f0014-b551-415c-85cf-c6ee329eb8cc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1314 microversion: 2.1 time: 0.338429 Jul 30 21:02:43.252501 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 281/632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:42 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:43.266980 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ea707ebe-55e3-411c-be74-41664f9a0f11 req-5e1e561a-2e71-4747-a75c-deeda506a609 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074725 Jul 30 21:02:43.267989 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 352/633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:43.443396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:43.444258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:43.455435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:43.456130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:43.463101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:43.463874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:43.625942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:43.637311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7046b51e-e684-4d9a-8c88-228a804e77bc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1280 microversion: 2.1 time: 0.197490 Jul 30 21:02:43.639240 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 282/634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:43 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:43.728840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1762067124", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab"}], "security_groups": [{"name": "tempest-securitygroup--16791955"}], "key_name": "tempest-keypair-1645645957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:43.764615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:43.765431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:43.791246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:43.794522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:43.795795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:43.797285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.048316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:44.066399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cad14200-a0de-46ee-a414-0c9eadebdf0c tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.303999 Jul 30 21:02:44.085920 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 283/635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:43 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:44.093604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:44.095944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:44.113480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.115015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.117737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.118509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.322220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:44.331996 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb63ac86-8747-4359-b8a0-7ed617a2a119 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.243731 Jul 30 21:02:44.333172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 284/636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:44 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:44.338330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:44.339149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:44.348022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.348849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.350282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.350873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.499364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] validate_networks() for [('f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:44.527899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:44.537927 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0749353d-d629-49a9-8612-ba0a270cfa2f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1464 microversion: 2.1 time: 0.203371 Jul 30 21:02:44.538417 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 285/637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:44 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:44.764090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:44.770840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'deleted': False, 'project_id': '51761955ec724fd187b41d085bdb4c4d'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:44.777451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.777998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.778857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.779416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.881534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0be8fd89-03c5-4919-bbb0-df8410a7adbb tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.325128 Jul 30 21:02:44.882139 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 286/638] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:02:44 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:02:44.955171 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea6f346f-6737-4efe-8220-9cef8763ec8f tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-29T21%3A02%3A44.589577&end=2022-07-31T21%3A02%3A44.589577" status: 404 len: 112 microversion: - time: 0.066739 Jul 30 21:02:44.960953 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 287/639] 10.222.0.17 () {58 vars in 1316 bytes} [Sat Jul 30 21:02:44 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-29T21%3A02%3A44.589577&end=2022-07-31T21%3A02%3A44.589577 => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 21:02:44.960953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:44.961333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:44.968698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.969161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:44.970253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:44.970510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:45.038665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:45.048596 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5eee1822-0503-4c05-aa1e-62c72a6ebb8b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1280 microversion: 2.1 time: 0.091384 Jul 30 21:02:45.049871 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 288/640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:44 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:45.054921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:45.061924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'deleted': False} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:45.069133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:45.069810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:45.070989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:45.071470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:45.188809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:02:45.313910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:45.315376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:45.646600 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-103a9306-30c5-4cf1-98d0-ffa49c188b14 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17665 microversion: 2.1 time: 0.595355 Jul 30 21:02:45.647271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 289/641] 10.222.0.17 () {58 vars in 1171 bytes} [Sat Jul 30 21:02:45 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17665 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:02:45.652341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d836e005-87e8-4597-9e04-e3d88971fc89 tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] Calling method '.version_select at 0x7fbb5d719160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:45.660295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d836e005-87e8-4597-9e04-e3d88971fc89 tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d836e005-87e8-4597-9e04-e3d88971fc89 tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] Request method failure captured: Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-simple-tenant-usage/fb71d28e098d4b0faedea05f4c73e6e6?start=2022-07-31T21%3A02%3A44.589577&end=2022-07-29T21%3A02%3A44.589577 HTTP/1.1 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zx0rJ_AtwP4UpyZ7JNMLL-IZ8NFtoWbKCjESX2TRQ3UlhshlanzsG57f5J_ad-7BWgW287kmF3iJYBC1SMvxn_jCX4EDKKGPDM9GBr3cO2ez6PA4nfFyO7kx8DNEavTIeo1tYS5c-GuCkP18KMdekbDoP06jvgSaGZIEZPWvRv9eGE Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: baaf155303074f2da715975a4eb0e3e7 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1017142793 Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:02:45.663401 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baaf155303074f2da715975a4eb0e3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baaf155303074f2da715975a4eb0e3e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baaf155303074f2da715975a4eb0e3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baaf155303074f2da715975a4eb0e3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1017142793 Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: baaf155303074f2da715975a4eb0e3e7 Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1017142793 Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d08b09fd20564df7a735b1bfb084e4e7 Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid start time. The start time cannot occur after the end time. Jul 30 21:02:45.665077 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'fb71d28e098d4b0faedea05f4c73e6e6'} Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 30 21:02:45.666514 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 30 21:02:45.667880 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:45.670585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d836e005-87e8-4597-9e04-e3d88971fc89 tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:45.671935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d836e005-87e8-4597-9e04-e3d88971fc89 tempest-TenantUsagesNegativeTestJSON-1017142793 tempest-TenantUsagesNegativeTestJSON-1017142793-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/fb71d28e098d4b0faedea05f4c73e6e6?start=2022-07-31T21%3A02%3A44.589577&end=2022-07-29T21%3A02%3A44.589577" status: 400 len: 111 microversion: 2.1 time: 0.023412 Jul 30 21:02:45.674039 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 290/642] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Jul 30 21:02:45 2022] GET /compute/v2.1/os-simple-tenant-usage/fb71d28e098d4b0faedea05f4c73e6e6?start=2022-07-31T21%3A02%3A44.589577&end=2022-07-29T21%3A02%3A44.589577 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:02:45.684425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:45.685609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:45.884483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:45.884868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:45.885657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:45.886110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.020015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:46.028267 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64b372d9-285a-4c87-a572-574d8d9cec04 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.352354 Jul 30 21:02:46.028875 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 291/643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:45 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:46.034083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.034703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:46.041176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.041642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.042468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.042921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.415706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:46.424421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75843404-e566-4abb-8db3-21f5063a7c89 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.394506 Jul 30 21:02:46.424992 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 292/644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:46.429686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.435540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'deleted': False, 'project_id': '51761955ec724fd187b41d085bdb4c4d'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:46.441030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.441517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.442339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.442780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.470286 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9cfe9cb2-3ce4-4a21-9482-27fdbd1cc191 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?tenant_id=7f71035a2ae04a76a9e82b6ccd3759cc" status: 200 len: 15 microversion: 2.1 time: 0.044047 Jul 30 21:02:46.470842 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 293/645] 10.222.0.17 () {58 vars in 1231 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/servers/detail?tenant_id=7f71035a2ae04a76a9e82b6ccd3759cc => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:02:46.584705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:46.585946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:46.586729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:46.587234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:46.587751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:46.590733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0971411b-67ba-4cd6-81d6-d6a21808e1c6 tempest-TenantUsagesNegativeTestJSON-1487370168 tempest-TenantUsagesNegativeTestJSON-1487370168-project] Calling method '.version_select at 0x7fbb5d6b4700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.594375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0971411b-67ba-4cd6-81d6-d6a21808e1c6 tempest-TenantUsagesNegativeTestJSON-1487370168 tempest-TenantUsagesNegativeTestJSON-1487370168-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd8506c8b759245a8b6b69089d30c6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb71d28e098d4b0faedea05f4c73e6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0971411b-67ba-4cd6-81d6-d6a21808e1c6 tempest-TenantUsagesNegativeTestJSON-1487370168 tempest-TenantUsagesNegativeTestJSON-1487370168-project] Request method failure captured: Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-29T21%3A02%3A44.589577&end=2022-07-31T21%3A02%3A44.589577&detailed=1 HTTP/1.1 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zxze7iwuJF5JJoFmNQroFhvovGJ604R8Egf9Vzfyf3nXDdMWogdtJ--J-9FfabQfMYGTQ5zcTxpKJ878ntLbcEYDPtTxbBB9l6ch_mTdGjt0GnM_FYuMo4DaiB4hNNJwak6MVvGKJIofggOmZ_qIPi9AwzdTr-W1gm1M-4PzbZvA5o Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: fb71d28e098d4b0faedea05f4c73e6e6 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1487370168 Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:02:46.596821 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fb71d28e098d4b0faedea05f4c73e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fb71d28e098d4b0faedea05f4c73e6e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb71d28e098d4b0faedea05f4c73e6e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb71d28e098d4b0faedea05f4c73e6e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1487370168 Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: fb71d28e098d4b0faedea05f4c73e6e6 Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1487370168 Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TenantUsagesNegativeTestJSON-1487370168-project Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d8506c8b759245a8b6b69089d30c6f7e Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1487370168-project Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:02:46.598327 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:02:46.599188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:02:46.600434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:02:46.601592 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 30 21:02:46.601592 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:02:46.601739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.601739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.601739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.601739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.602056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0971411b-67ba-4cd6-81d6-d6a21808e1c6 tempest-TenantUsagesNegativeTestJSON-1487370168 tempest-TenantUsagesNegativeTestJSON-1487370168-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:02:46.602056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0971411b-67ba-4cd6-81d6-d6a21808e1c6 tempest-TenantUsagesNegativeTestJSON-1487370168 tempest-TenantUsagesNegativeTestJSON-1487370168-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-29T21%3A02%3A44.589577&end=2022-07-31T21%3A02%3A44.589577&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.129907 Jul 30 21:02:46.604145 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 294/646] 10.222.0.17 () {58 vars in 1335 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-29T21%3A02%3A44.589577&end=2022-07-31T21%3A02%3A44.589577&detailed=1 => generated 123 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:02:46.610885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.611684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:46.620477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:46.620813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.621667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.622983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.624140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.625465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for user 46d7264a2f63436bb8519cd8cec6d9f5 and project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:46.642535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:46.647201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:46.706024 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8ee103e-2993-4a35-b31a-5198d74be1d8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 2.981852 Jul 30 21:02:46.706973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 353/647] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:02:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:02:46.718295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.729922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'tenant_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'deleted': False} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:46.753564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.754214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.755538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:46.756465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:46.827333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:46.866361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-854c13fc-8e8c-48c0-b6d4-2704a0820f41 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.260889 Jul 30 21:02:46.886774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:02:46.908565 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 295/648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:46.931551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:46.934140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:47.107822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:47.117920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:47.118930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.119691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.122996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:47.128306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b50c1a5-67c1-48d9-b21d-3f3b35927143 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1286 microversion: 2.25 time: 0.230223 Jul 30 21:02:47.132459 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 296/649] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:47.138556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:47.139633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:47.151680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.153275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.154679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.155811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.417170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98ff1284-2f52-4999-821f-100d7d76b0c4 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7f71035a2ae04a76a9e82b6ccd3759cc" status: 200 len: 4827 microversion: 2.1 time: 0.708909 Jul 30 21:02:47.418427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 354/650] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:02:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7f71035a2ae04a76a9e82b6ccd3759cc => generated 4827 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:47.424062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-191580d4-14d0-4be8-b6f0-c48809b9c994 req-90a352c0-fbaa-4479-aef0-5cef0eae9c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766e564-dc7d-4328-9cf8-cd5dd04c9a41", "name": "network-vif-plugged", "status": "completed", "tag": "f6582567-866b-42b5-9909-5470ec2926cf"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:47.458205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:47.461927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:47.468160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-191580d4-14d0-4be8-b6f0-c48809b9c994 req-90a352c0-fbaa-4479-aef0-5cef0eae9c4f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.468814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-191580d4-14d0-4be8-b6f0-c48809b9c994 req-90a352c0-fbaa-4479-aef0-5cef0eae9c4f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.483742 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3ebb84b-54d6-4fa5-a07c-06abe317401b tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.346406 Jul 30 21:02:47.495315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 297/651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:47.501489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:47.502403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:47.508615 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-191580d4-14d0-4be8-b6f0-c48809b9c994 req-90a352c0-fbaa-4479-aef0-5cef0eae9c4f service nova] Creating event network-vif-plugged:f6582567-866b-42b5-9909-5470ec2926cf for instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 on nch1-master-1 Jul 30 21:02:47.519238 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-191580d4-14d0-4be8-b6f0-c48809b9c994 req-90a352c0-fbaa-4479-aef0-5cef0eae9c4f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098583 Jul 30 21:02:47.521012 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 355/652] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:47.527099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.528438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.529756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:47.530903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.531496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.542024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'tenant_id': '51761955ec724fd187b41d085bdb4c4d', 'deleted': False} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:47.548593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.549333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.550085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.550590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.788596 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-689acf88-6421-4ea0-b470-129d177a9e69 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51761955ec724fd187b41d085bdb4c4d" status: 200 len: 15 microversion: 2.1 time: 0.266090 Jul 30 21:02:47.792137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:47.807084 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 356/653] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51761955ec724fd187b41d085bdb4c4d => generated 15 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:02:47.808852 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3c0fa1dc-e0ac-4c27-83d7-f3546b1aad60 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.322969 Jul 30 21:02:47.811752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25327e85-6fc2-4550-8ffd-6c5292fbbd22 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:47.814321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 298/654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:47.821538 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25327e85-6fc2-4550-8ffd-6c5292fbbd22 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.013412 Jul 30 21:02:47.836176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 357/655] 10.222.0.17 () {58 vars in 1189 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:02:47.848753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:47.851788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:47.863942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.864770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.866026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.867083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.925819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:47.926595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:47.945479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.945911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.948549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:47.949030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:47.994809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8df7ef97-e2cf-435c-9bd6-f59afe4aef6d tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 0 microversion: 2.1 time: 0.147673 Jul 30 21:02:47.994809 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 299/656] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:47 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:48.003371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:48.011621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:48.012364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:48.024853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.028235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.033405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.035592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.191927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:02:48.264623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d28bf518-4297-416a-b683-2c12decf6602 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.267994 Jul 30 21:02:48.265602 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 300/657] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:48.273070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:48.273708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:48.280687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.281332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.282465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.282933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.382830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:48.393958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:48.395640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:48.397299 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73d8d486-5894-4b40-90bb-60a8cdc7820d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1338 microversion: 2.25 time: 0.130362 Jul 30 21:02:48.411442 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 301/658] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:48 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1338 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:48.419362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:48.422474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:48.429318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.429636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.430553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.431000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.547249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5de767f-e4be-4410-aa05-3125db674524 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 0 microversion: 2.1 time: 0.129823 Jul 30 21:02:48.548016 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 302/659] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:48 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:48.554415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:48.556387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:48.566533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.567745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.569170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.570794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.846073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:48.861880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47c6ff6f-44f4-43f1-9985-b2825320638e tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.310244 Jul 30 21:02:48.875322 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 303/660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:48 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:48.882302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:48.882946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:48.891231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.891494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:48.892214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:48.892678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.079064 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-84f7ebb7-0ee9-4e88-8c68-168d59caacc1 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1615 microversion: 2.1 time: 0.202666 Jul 30 21:02:49.083842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:49.101757 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 304/661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:48 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1615 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:49.106705 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-616be309-2daf-44a0-999b-6b87de395183 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 1.186035 Jul 30 21:02:49.108439 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 358/662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:47 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:49.114557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:49.115639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:49.134414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.134890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:49.135527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.135657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:49.136901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.137809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.148347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.148812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.149615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.150077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.351305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:49.360503 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da1d1c9f-d485-460e-a8f7-288536b69ec7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.257387 Jul 30 21:02:49.375929 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 305/663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:49 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:49.381058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:49.382006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:49.389093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.389565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.390629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.393469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.441802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:02:49.583203 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5f4c85b9-9528-485e-ae3b-c7c82175eed5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 204 len: 0 microversion: 2.1 time: 0.205684 Jul 30 21:02:49.584911 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 306/664] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:02:49 2022] DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:02:49.592896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:49.603420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:49.613883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.616753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.617984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.618636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.653973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d54d2e2e-0fee-405c-b719-ec1243cab9d8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1615 microversion: 2.1 time: 0.541451 Jul 30 21:02:49.656896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 359/665] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:49 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1615 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:49.663821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0c6bc6c7-6431-4011-a543-b3100294d943 req-e3ddd4a7-3d3a-448a-8aa2-efebffab8430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e09b6f-b1fe-404b-8558-2d0d13683751", "tag": "b4ba4d5d-d02b-4505-9172-7b9432faf95e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:49.692535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0c6bc6c7-6431-4011-a543-b3100294d943 req-e3ddd4a7-3d3a-448a-8aa2-efebffab8430 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.693007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0c6bc6c7-6431-4011-a543-b3100294d943 req-e3ddd4a7-3d3a-448a-8aa2-efebffab8430 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.758003 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0c6bc6c7-6431-4011-a543-b3100294d943 req-e3ddd4a7-3d3a-448a-8aa2-efebffab8430 service nova] Creating event network-changed:b4ba4d5d-d02b-4505-9172-7b9432faf95e for instance a0e09b6f-b1fe-404b-8558-2d0d13683751 on nch2-master-1 Jul 30 21:02:49.771328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0c6bc6c7-6431-4011-a543-b3100294d943 req-e3ddd4a7-3d3a-448a-8aa2-efebffab8430 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112960 Jul 30 21:02:49.771991 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 360/666] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:49.779964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:49.784590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:49.790923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:49.793604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:49.794931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:49.797934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:49.799571 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5a55fba7-692e-48e9-b2d9-e814da7ab3a3 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1344 microversion: 2.25 time: 0.211966 Jul 30 21:02:49.801775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.802273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.803808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 307/667] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:49 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:49.806477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:49.807243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:49.830962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-640016205", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "246069507", "adminPass": "***", "networks": [{"uuid": "26970fab-7b49-4381-be37-ad8625117c4b"}], "security_groups": [{"name": "tempest-securitygroup--14340033"}], "key_name": "tempest-keypair-1101770249", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:49.919584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:02:50.010383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] validate_networks() for [('26970fab-7b49-4381-be37-ad8625117c4b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:50.057091 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bbc07f1a-9146-4903-92a8-b81c38467a55 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1988 microversion: 2.1 time: 0.283959 Jul 30 21:02:50.075880 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 361/668] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 30 21:02:49 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1988 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:50.081228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:50.099724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:50.109198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.109732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.111089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.111567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.477653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:50.497629 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96c05b92-1194-41c2-b633-0e02f056683f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1366 microversion: 2.1 time: 0.420398 Jul 30 21:02:50.511609 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 362/669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:50 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:50.533676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:50.542728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:02:50.552006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.553286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.554777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.555458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.587992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5834259-7e76-4ecb-a08e-316e6885e42c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.068270 Jul 30 21:02:50.591131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:50.592051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:50.597925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 363/670] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 30 21:02:50 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:02:50.602581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:50.604375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:50.604904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:50.605099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:50.605916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:50.613522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.614302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.615371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.615987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.646503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.647977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.649404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.650131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.674189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:50.680555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Getting quotas for user b2a05aa5d80844848bf57f6ca093e582 and project 8413d2ad29eb484886bae680d1d1a82b. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:50.693466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:50.697957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:50.782772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c13e0d8-b20e-4153-aa66-84ce02654cfa tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.976612 Jul 30 21:02:50.784302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 308/671] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:50.798924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:50.799940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:50.817532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.818181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:50.819744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:50.820387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.181032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:51.189830 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55fe3d83-94e1-49c1-b4b7-48260bc5fdf6 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.401233 Jul 30 21:02:51.204732 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 309/672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:50 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:51.212070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:51.220861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:51.261334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.262046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.267134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.267859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.334552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:51.456937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20643dd1-d660-4db8-9f70-f9c7bfd3fb4c tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 0 microversion: 2.1 time: 0.248626 Jul 30 21:02:51.461274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 310/673] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:51 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:02:51.465774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:51.481336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7e0f778-cd7a-4456-b458-9ff570176e5d tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.876737 Jul 30 21:02:51.495337 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 364/674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:50 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:51.496679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9322cf8b-5418-4056-99b6-a4cca91fa958 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:51.496679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9322cf8b-5418-4056-99b6-a4cca91fa958 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:51.496938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:51.496938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:51.505839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.506305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.507097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.507594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.567270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:51.755677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9322cf8b-5418-4056-99b6-a4cca91fa958 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:51.759427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=39 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:51.779649 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9322cf8b-5418-4056-99b6-a4cca91fa958 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1262 microversion: 2.1 time: 0.315915 Jul 30 21:02:51.792857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 311/675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:51 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1262 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:51.793059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:51.796442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:51.809611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:51.812030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.815800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:51.822515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:51.829828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.033278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:52.033812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:52.034337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:52.034763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:52.035309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:52.155882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:52.164011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.164011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.164680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.165229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.197127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48b8eaff-7213-4041-b50b-46fd75914afd tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 1068 microversion: 2.1 time: 0.414410 Jul 30 21:02:52.209198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 312/676] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:02:51 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 1068 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 30 21:02:52.222116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:52.224437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:52.248062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.252605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.257084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.259342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.353901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:52.371115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:52.375527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:52.377922 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f5e82d0-c764-4923-8c5b-11b2e873618b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.894600 Jul 30 21:02:52.387195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 365/677] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:51 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:52.396094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:52.396708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:52.416206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.418711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.419622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.420102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.566487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:52.577759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2ea600b-be90-4ea4-8cac-299d7f43b487 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1556 microversion: 2.1 time: 0.377794 Jul 30 21:02:52.581361 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 313/678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:52 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1556 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:52.588898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:52.589529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:52.609282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.610365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:52.612080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:52.613339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.001609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:53.016214 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14f72ee7-b48c-4d43-a34d-3169f44e55a5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.433605 Jul 30 21:02:53.017130 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 314/679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:52 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:53.034640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:53.035513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:53.050457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.051205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.052233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.053061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.552822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:53.614077 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cdeeea77-f658-49c4-b9ea-76608349c414 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 1.223273 Jul 30 21:02:53.618015 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 366/680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:52 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:53.622129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:53.637070 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d6ed513-7a70-482c-a173-d7b3a45d2235 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.618550 Jul 30 21:02:53.637966 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 315/681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:53 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:53.638722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:53.641679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:53.649979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:53.650908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:53.659554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.659998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.665359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.668050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.668244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.668765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.669597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.670059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.803010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:53.815124 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87b9e6fc-639b-4293-ae8e-04b2e4bf4cff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1320 microversion: 2.1 time: 0.175573 Jul 30 21:02:53.815747 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 316/682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:53 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:53.823334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:53.823974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:53.846220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.846793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:53.847657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:53.856156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.006836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c283572-4fd6-4c80-a798-a75ba71be1ee tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.385210 Jul 30 21:02:54.007826 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 367/683] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:02:53 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-interface => generated 284 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:54.019208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7ec19663-ae38-43f5-82f7-b5f581e59b7d req-d37ea8ae-977e-4fcb-a8d4-1c53089eca34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "name": "network-vif-plugged", "status": "completed", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:54.035859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7ec19663-ae38-43f5-82f7-b5f581e59b7d req-d37ea8ae-977e-4fcb-a8d4-1c53089eca34 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.036321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7ec19663-ae38-43f5-82f7-b5f581e59b7d req-d37ea8ae-977e-4fcb-a8d4-1c53089eca34 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.053435 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7ec19663-ae38-43f5-82f7-b5f581e59b7d req-d37ea8ae-977e-4fcb-a8d4-1c53089eca34 service nova] Creating event network-vif-plugged:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch1-master-1 Jul 30 21:02:54.059215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7ec19663-ae38-43f5-82f7-b5f581e59b7d req-d37ea8ae-977e-4fcb-a8d4-1c53089eca34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049280 Jul 30 21:02:54.060410 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 368/684] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:54.066901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7608613d-39e7-4f11-80df-f5bf3c1d3cea req-4bb9a10c-8ae1-4594-a5e5-d6b1ea655644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64c39d9-ba7b-4de4-b129-e17f43a0cb67", "name": "network-vif-deleted", "tag": "1359954f-9542-4a77-8e10-d59cb81727eb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:54.078999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7608613d-39e7-4f11-80df-f5bf3c1d3cea req-4bb9a10c-8ae1-4594-a5e5-d6b1ea655644 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.079690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7608613d-39e7-4f11-80df-f5bf3c1d3cea req-4bb9a10c-8ae1-4594-a5e5-d6b1ea655644 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.093189 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7608613d-39e7-4f11-80df-f5bf3c1d3cea req-4bb9a10c-8ae1-4594-a5e5-d6b1ea655644 service nova] Creating event network-vif-deleted:1359954f-9542-4a77-8e10-d59cb81727eb for instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 on nch2-master-1 Jul 30 21:02:54.098799 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7608613d-39e7-4f11-80df-f5bf3c1d3cea req-4bb9a10c-8ae1-4594-a5e5-d6b1ea655644 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Jul 30 21:02:54.100776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 369/685] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:54.106308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:54.107352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:54.116019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.116716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.117851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.118510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.215962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:54.243164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:54.245095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:54.255307 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cef48985-f5d4-46df-920a-2f6ebdf1607f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.436641 Jul 30 21:02:54.273741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 317/686] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:53 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:54.644864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:54.645965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:54.665405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.668022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.680535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.681812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.891759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:54.901798 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7c42055-de19-4ee3-83fb-1b6dfcb6ba3a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.799546 Jul 30 21:02:54.921674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 370/687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:54 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:54.927203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:54.927951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:54.934683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.935482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:54.936453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:54.937727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.343550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:55.359946 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-36bb7120-64cd-4366-961b-76813132d9fe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1360 microversion: 2.1 time: 0.722278 Jul 30 21:02:55.362034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:55.367849 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 318/688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:54 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1360 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:02:55.374846 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19c44540-d635-493c-842b-1b3838a9f84b tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.450572 Jul 30 21:02:55.376959 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 371/689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:54 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:55.384825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4cc98034-4b80-42dd-af77-2a51426b4503 req-3fb3b69a-da3d-4b3b-af69-1e8b5bc60d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:55.401232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4cc98034-4b80-42dd-af77-2a51426b4503 req-3fb3b69a-da3d-4b3b-af69-1e8b5bc60d01 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:55.402011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4cc98034-4b80-42dd-af77-2a51426b4503 req-3fb3b69a-da3d-4b3b-af69-1e8b5bc60d01 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.404672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:55.405924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:55.413954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:55.414788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.415927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:55.416596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.418779 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4cc98034-4b80-42dd-af77-2a51426b4503 req-3fb3b69a-da3d-4b3b-af69-1e8b5bc60d01 service nova] Creating event network-changed:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch2-master-1 Jul 30 21:02:55.432885 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4cc98034-4b80-42dd-af77-2a51426b4503 req-3fb3b69a-da3d-4b3b-af69-1e8b5bc60d01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051866 Jul 30 21:02:55.438284 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 372/690] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:55.445046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:55.445963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:55.465218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:55.465991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.469623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:55.471053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:55.698931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:55.713129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:55.716091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:55.717483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-600f98b2-2315-4b88-86d2-98ce3fa1135b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.277524 Jul 30 21:02:55.718661 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 373/691] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:55 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:55.926990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-26971696", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "a4eb712f-5b3e-4c43-b0ff-c7cce1e11e6f"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:56.001189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] validate_networks() for [('a4eb712f-5b3e-4c43-b0ff-c7cce1e11e6f', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:02:56.274372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:56.289170 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac4293a5-5bf2-4a6d-888a-bd46453becc9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.909389 Jul 30 21:02:56.290198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 319/692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:55 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:56.300934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:56.301958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:56.314989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.315712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.316597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.317061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.785383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:56.809919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:02:56.811651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:02:56.812436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:02:56.814031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:02:56.816226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:02:56.816823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-182d3ce9-023d-4068-980e-d01903241516 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.523911 Jul 30 21:02:56.821500 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 320/693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:56 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:56.829525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:56.830488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:56.845788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=49 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:56.853860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.856736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.861458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.861873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.863935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.866922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:56.867426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.872114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:56.907516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=22 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:56.971395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Getting quotas for project 0a256de385094348b6c03bcd2eab0d6f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:02:56.988778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Getting quotas for user 85f0c582040c43b1b27791cb66656e9e and project 0a256de385094348b6c03bcd2eab0d6f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:02:57.028758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:02:57.031571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:02:57.110281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48e807c4-9572-4ac8-9891-5da11662f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389411 Jul 30 21:02:57.112433 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 374/694] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:02:57.117692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.118895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:57.134976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.135542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.136447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.146071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.372830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.384672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6006fac-7456-48d4-8883-d61b41b1b108 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.270791 Jul 30 21:02:57.385510 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 375/695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:57.392497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.393460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:57.403670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.404233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.405073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.405533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.659139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.668168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.670270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.671776 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5679b5ba-cea1-43f8-b87c-3aa7de4a31ba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.284862 Jul 30 21:02:57.673467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 376/696] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:02:57.679139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fdf4b35d-130e-4dea-a20d-096a3c9552c1 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.679992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fdf4b35d-130e-4dea-a20d-096a3c9552c1 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:57.691787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.699801 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5d4bed97-ed84-4a64-aadf-94e34fafe750 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1542 microversion: 2.1 time: 0.875988 Jul 30 21:02:57.720053 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 321/697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:56 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1542 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:57.725238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.732431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:57.751516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.756564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.757654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.759907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.817306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fdf4b35d-130e-4dea-a20d-096a3c9552c1 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:57.827491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fdf4b35d-130e-4dea-a20d-096a3c9552c1 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1230 microversion: 2.1 time: 0.151192 Jul 30 21:02:57.830517 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 377/698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1230 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:57.840474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.846411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:57.863730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.864634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.866919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:57.867464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:57.982931 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37fd662b-a577-4cfd-8fdf-f9965d34e5e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150317 Jul 30 21:02:57.984619 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 378/699] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:57.990083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:57.991096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:58.008274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:58.010867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:58.013685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:58.014522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:58.448651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:58.466574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13172635-1e7e-4b90-b497-37615645d8d8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.744997 Jul 30 21:02:58.473117 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 322/700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:58.512724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:58.530195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:58.583969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:58.585200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:58.587590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:58.588815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:58.989380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:59.027461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-678ddc09-3303-43df-8ffa-807f25ae22e0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.547694 Jul 30 21:02:59.043904 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 323/701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:58 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:59.076906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f35e588e-5a37-4d45-bd3d-8b4aff24b211 req-d636c7e1-3bce-4cd6-9a90-1edcab592dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3766e564-dc7d-4328-9cf8-cd5dd04c9a41", "tag": "f6582567-866b-42b5-9909-5470ec2926cf"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:02:59.128482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f35e588e-5a37-4d45-bd3d-8b4aff24b211 req-d636c7e1-3bce-4cd6-9a90-1edcab592dc2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:59.131779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f35e588e-5a37-4d45-bd3d-8b4aff24b211 req-d636c7e1-3bce-4cd6-9a90-1edcab592dc2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:59.144920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:59.178851 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f35e588e-5a37-4d45-bd3d-8b4aff24b211 req-d636c7e1-3bce-4cd6-9a90-1edcab592dc2 service nova] Creating event network-changed:f6582567-866b-42b5-9909-5470ec2926cf for instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 on nch1-master-1 Jul 30 21:02:59.198428 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f35e588e-5a37-4d45-bd3d-8b4aff24b211 req-d636c7e1-3bce-4cd6-9a90-1edcab592dc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149809 Jul 30 21:02:59.214272 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 324/702] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:02:59.233194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:59.239926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:59.256690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:59.267732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:59.268688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:59.269244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:59.732438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:02:59.752175 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1e2d52a6-0ee2-4585-8789-1667b21d2212 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 1.764884 Jul 30 21:02:59.768366 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 379/703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:57 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:02:59.775177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:02:59.775854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:02:59.797894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:59.798854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:02:59.799704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:02:59.800158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.240101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:00.262894 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e251ff4f-4d1d-4b34-9ddd-9eb02f7be003 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1288 microversion: 2.1 time: 0.493233 Jul 30 21:03:00.269090 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 380/704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:02:59 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1288 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:00.282906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:00.288615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:00.310549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.311216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.312063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.314595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.661753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=11 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:00.895251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:00.926725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:00.928021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:00.929989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:00.931662 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70573e4e-d180-4fe2-98d1-89078055f060 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 1.715788 Jul 30 21:03:00.932867 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 325/705] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:02:59 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:00.939573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:00.940367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:00.948740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c91403b9-f3e4-4ec9-a5b8-c156485c5a5f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.674196 Jul 30 21:03:00.949152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.949707 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 381/706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:00 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:00.950594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.951958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.953030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.967214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:00.967894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:00.977005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.977486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:00.978394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:00.978863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:01.396632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:01.414442 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49e12aae-5da1-4b3e-ad66-05e78fae31f0 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.480066 Jul 30 21:03:01.416658 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 326/707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:00 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:01.424965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:01.426335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:01.435554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:01.438904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:01.440035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:01.440668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:01.607251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:01.615260 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f440a1b-ca18-4890-8dca-2f854acd1317 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1288 microversion: 2.1 time: 0.196799 Jul 30 21:03:01.623878 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 327/708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:01 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1288 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:01.634297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9f528e99-2080-46a6-b6f0-c6b6404773dc req-d14b3c90-182e-4858-83e6-02089dc14d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731ab961-17d8-4aef-af45-09a3d1d326fa", "tag": "d5641255-3be0-4f7e-a59c-045b58146116"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:01.644978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9f528e99-2080-46a6-b6f0-c6b6404773dc req-d14b3c90-182e-4858-83e6-02089dc14d3e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:01.645327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9f528e99-2080-46a6-b6f0-c6b6404773dc req-d14b3c90-182e-4858-83e6-02089dc14d3e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:01.662727 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9f528e99-2080-46a6-b6f0-c6b6404773dc req-d14b3c90-182e-4858-83e6-02089dc14d3e service nova] Creating event network-changed:d5641255-3be0-4f7e-a59c-045b58146116 for instance 731ab961-17d8-4aef-af45-09a3d1d326fa on nch2-master-1 Jul 30 21:03:01.673161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9f528e99-2080-46a6-b6f0-c6b6404773dc req-d14b3c90-182e-4858-83e6-02089dc14d3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042727 Jul 30 21:03:01.675332 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 328/709] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:01.954874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:01.961827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:01.962769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:01.979055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:01.979893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:01.982863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:01.985089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:01.985639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.002061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b52704b-5fda-46bb-afe3-d7c889319b70 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 1.038666 Jul 30 21:03:02.024527 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 382/710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:00 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:02.031137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:02.034311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:02.048924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.051874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.052924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.054679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.467619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:02.477534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:02.482184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:02.485926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:02.488629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0758b743-0dbc-4735-9055-77d90a2cd727 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.534594 Jul 30 21:03:02.490365 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 329/711] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:01 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:02.495187 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2112dc9-a9bd-4293-9abb-2456e628b7c7 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.469149 Jul 30 21:03:02.499709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-533571fb-06e5-45f4-be80-42f8f83b40c7 req-3f2c93f2-ce32-4f3d-9dc6-a8672d60fd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e09b6f-b1fe-404b-8558-2d0d13683751", "name": "network-vif-plugged", "status": "completed", "tag": "b4ba4d5d-d02b-4505-9172-7b9432faf95e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:02.511498 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 383/712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:02 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:02.519751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:02.522951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:02.526328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-533571fb-06e5-45f4-be80-42f8f83b40c7 req-3f2c93f2-ce32-4f3d-9dc6-a8672d60fd49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.526794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-533571fb-06e5-45f4-be80-42f8f83b40c7 req-3f2c93f2-ce32-4f3d-9dc6-a8672d60fd49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.540669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.542519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.543864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.547145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.557270 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-533571fb-06e5-45f4-be80-42f8f83b40c7 req-3f2c93f2-ce32-4f3d-9dc6-a8672d60fd49 service nova] Creating event network-vif-plugged:b4ba4d5d-d02b-4505-9172-7b9432faf95e for instance a0e09b6f-b1fe-404b-8558-2d0d13683751 on nch2-master-1 Jul 30 21:03:02.577836 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-533571fb-06e5-45f4-be80-42f8f83b40c7 req-3f2c93f2-ce32-4f3d-9dc6-a8672d60fd49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085535 Jul 30 21:03:02.584119 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 330/713] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:02.637136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:02.637858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:02.652284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.653032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.654002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.654856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.806638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:02.822891 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1abe80c4-9618-4529-a60b-103f62814d6e tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.309008 Jul 30 21:03:02.824591 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 384/714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:02 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:02.841780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-487e957a-90c2-4de4-8125-2ad32f030848 req-c336b4c2-bc1a-4ea0-9f64-8c9e76f4273c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:02.854710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-487e957a-90c2-4de4-8125-2ad32f030848 req-c336b4c2-bc1a-4ea0-9f64-8c9e76f4273c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:02.855481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-487e957a-90c2-4de4-8125-2ad32f030848 req-c336b4c2-bc1a-4ea0-9f64-8c9e76f4273c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:02.870698 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-487e957a-90c2-4de4-8125-2ad32f030848 req-c336b4c2-bc1a-4ea0-9f64-8c9e76f4273c service nova] Creating event network-changed:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch1-master-1 Jul 30 21:03:02.880486 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-487e957a-90c2-4de4-8125-2ad32f030848 req-c336b4c2-bc1a-4ea0-9f64-8c9e76f4273c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047993 Jul 30 21:03:02.885563 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 385/715] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:03.044827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:03.048739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:03.062123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.063149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.100710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.101815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.555102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:03.568786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-876cfb79-0fb2-4200-906b-c463d94eed88 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.936207 Jul 30 21:03:03.569872 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 331/716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:02 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:03.577229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:03.581031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:03.587801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.588786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.591796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.592734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.662480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:03.681029 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30dece30-e1d0-4600-8093-a0fefa8b5140 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.653112 Jul 30 21:03:03.684195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 386/717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:03 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:03.692998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:03.693962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:03.702416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.707829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.709102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:03.709787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:03.745994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:04.005521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.027661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.029357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.047642 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9058e7f0-8a0e-42ab-acd8-cbe4f1e1fdaf tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.472997 Jul 30 21:03:04.048347 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 332/718] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:03 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:04.060283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:04.061251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:04.088084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.088571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.089407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.089866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.299586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.314322 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5daeed80-4a91-4055-a885-5129bfa31402 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.627330 Jul 30 21:03:04.316715 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 387/719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:03 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:04.596548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:04.598560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:04.616512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.617388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.618860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.622235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.842503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.858751 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79a21868-c4a0-43f4-9317-1acf2b1f4e57 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1322 microversion: 2.1 time: 0.805532 Jul 30 21:03:04.860603 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 333/720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:04 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:04.867423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e54f8111-91a3-4ad8-8f0b-a5aec9046762 req-7874a567-6cd7-4a10-8c60-0ddd8d9439d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "name": "network-vif-plugged", "status": "completed", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:04.887977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:04.888524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e54f8111-91a3-4ad8-8f0b-a5aec9046762 req-7874a567-6cd7-4a10-8c60-0ddd8d9439d8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.889561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e54f8111-91a3-4ad8-8f0b-a5aec9046762 req-7874a567-6cd7-4a10-8c60-0ddd8d9439d8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.903616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e54f8111-91a3-4ad8-8f0b-a5aec9046762 req-7874a567-6cd7-4a10-8c60-0ddd8d9439d8 service nova] Creating event network-vif-plugged:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch2-master-1 Jul 30 21:03:04.908308 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ddcc35b7-13ba-4f87-9525-d0d146bd6c31 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.318614 Jul 30 21:03:04.911659 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e54f8111-91a3-4ad8-8f0b-a5aec9046762 req-7874a567-6cd7-4a10-8c60-0ddd8d9439d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Jul 30 21:03:04.912328 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 334/721] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:04.918110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:04.919015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:04.927900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 388/722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:04 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:04.928625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.929536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:04.930497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:04.931123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.074460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:05.076158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:05.083530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.084222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.085129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.086208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.233936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:05.243013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:05.245294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:05.246572 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d4c3f8bd-fd32-4056-9d6b-9c01e821ea6d tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.176794 Jul 30 21:03:05.247577 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 389/723] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:05 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:05.252180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8682c14c-ccc4-4d96-81bb-2d52db4d9cf6 req-a135e7f6-179a-4b40-bd19-e19ad4af6519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1d3666-6ec4-4291-82e3-63605bac7470", "tag": "3b54de7a-3c1c-46da-a126-9d3481beafd4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:05.263396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8682c14c-ccc4-4d96-81bb-2d52db4d9cf6 req-a135e7f6-179a-4b40-bd19-e19ad4af6519 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.263876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8682c14c-ccc4-4d96-81bb-2d52db4d9cf6 req-a135e7f6-179a-4b40-bd19-e19ad4af6519 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.277232 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8682c14c-ccc4-4d96-81bb-2d52db4d9cf6 req-a135e7f6-179a-4b40-bd19-e19ad4af6519 service nova] Creating event network-changed:3b54de7a-3c1c-46da-a126-9d3481beafd4 for instance cd1d3666-6ec4-4291-82e3-63605bac7470 on nch1-master-1 Jul 30 21:03:05.282833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8682c14c-ccc4-4d96-81bb-2d52db4d9cf6 req-a135e7f6-179a-4b40-bd19-e19ad4af6519 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Jul 30 21:03:05.283773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 390/724] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:05.338571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:05.340118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:05.347855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.348668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.350169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.350719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.395993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:05.409542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-25c0d08d-9b73-4928-b75a-31f6e39901e9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.495654 Jul 30 21:03:05.410606 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 335/725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:04 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:05.508381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:05.518374 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bbc0f1e1-c3b5-40b6-9cea-24577a31e1f3 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.183985 Jul 30 21:03:05.519021 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 391/726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:05 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:05.881885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:05.882506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:05.888655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.889114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.889894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.891154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.929841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:05.930446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:05.937935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.938492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:05.939379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:05.939897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.122942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.133219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd50b8c9-43bd-47f7-8d06-af44774a7c90 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.206899 Jul 30 21:03:06.135345 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 392/727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:05 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:06.212045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.230287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb65aed1-dc91-457d-ab2f-a3745aac6c69 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1471 microversion: 2.1 time: 0.352157 Jul 30 21:03:06.231936 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 336/728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:05 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:06.257881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.259757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.271298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.272273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.284363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.284833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.284988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.285769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.287064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.287833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.289199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.289674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.319099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Request method failure captured: Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751/diagnostics HTTP/1.1 Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxtKa4HfAVAVnf_o1F7_o5bl2rM-hx3SIS8VWY4a88hcJH61uOKwjJ8tDQRIr4WD_qkU8iCUule_1XwP6RAG-xXf_t7LP-E-ePuzQc8E9qONRcTjCWpGg9nML_y1cIySpTLdv1X16HJNYl1MHUp3RhM7QSQVak02w1Oy_JHvsiOUgw Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b0afe6bde6aa4c1dbe9a01c553ee801f Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:03:06.321075 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0afe6bde6aa4c1dbe9a01c553ee801f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b0afe6bde6aa4c1dbe9a01c553ee801f Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerDiagnosticsNegativeTest-1957520412-project Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e4b9f2d931d64de6a0ecdb1082102adb Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1957520412-project Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:03:06.322490 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'a0e09b6f-b1fe-404b-8558-2d0d13683751'} Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:03:06.323353 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:06.325354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:06.326735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d6d62021-e812-4e09-b464-523a5977c489 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.068733 Jul 30 21:03:06.330969 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 393/729] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:03:06 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751/diagnostics => generated 117 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:03:06.336491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.337244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.344597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.345746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.347040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.347717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.381850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:03:06.488000 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d0253b63-0d4e-4d55-b0f0-88a0bb9e2cd6 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 204 len: 0 microversion: 2.1 time: 0.154204 Jul 30 21:03:06.493755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 394/730] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:03:06 2022] DELETE /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:03:06.501868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.505869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.514774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.515356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.516128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.516586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.679995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.693842 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0621d177-eacd-4db5-a4fe-6e742033fbe2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.197575 Jul 30 21:03:06.702007 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 395/731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:06 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:06.708477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.709593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.716708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.717166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.719205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.719859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.825848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.841569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.845826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.848110 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f33800d9-1c96-4874-83b7-3f3b439b1801 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1410 microversion: 2.25 time: 0.580911 Jul 30 21:03:06.848976 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 337/732] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:06 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1410 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:06.855064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:06.855935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:06.864878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.865523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.866348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:06.866832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:06.873678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:06.882493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f13a2af2-f3b2-45c8-ae81-f2f78ffe1356 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1477 microversion: 2.1 time: 0.179340 Jul 30 21:03:06.883389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 396/733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:06 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:07.013816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:07.023053 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-519dca73-de73-44da-a409-80cff7c5831d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.172700 Jul 30 21:03:07.023678 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 338/734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:06 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:07.047422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:07.095689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] Calling method '.version_select at 0x7fbb5d4c5310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:07.143739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 25401f60-0017-45bd-a602-872b9d45711e could not be found", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:03:07.144478 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] HTTP exception thrown: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e Jul 30 21:03:07.154237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:07.154892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] Request method failure captured: Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-floating-ips/25401f60-0017-45bd-a602-872b9d45711e HTTP/1.1 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyKt65sZxbxkGAvy85QILYTP-ikK04BNFcCOjL8rVtbUJHd258HJqRQCKOxdsM6ZbEEW2xaEWW1qppQpFo_-jg2ELVACAgy3mPeKp4DzJUnAMB4B_T3P5UP1QM_29nBbIgHaZiI6eZ7mj2eJowiwA_EJvUnib2iNh-Wwg8MUHKOBqU Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 1363f5fe83df486c98932c724ad93fc2 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-393788291 Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:03:07.157299 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1363f5fe83df486c98932c724ad93fc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1363f5fe83df486c98932c724ad93fc2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1363f5fe83df486c98932c724ad93fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1363f5fe83df486c98932c724ad93fc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-393788291 Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 1363f5fe83df486c98932c724ad93fc2 Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-393788291 Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-393788291-project Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b24f7b4041c14620becd719b26e058d3 Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-393788291-project Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: exception: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e Jul 30 21:03:07.158835 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '25401f60-0017-45bd-a602-872b9d45711e'} Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:07.159805 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 25401f60-0017-45bd-a602-872b9d45711e could not be found Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1f76db6-6b05-441f-9768-c89a1a33a1dc'] Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e. Jul 30 21:03:07.161150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:07.162524 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:07.163978 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:07.163978 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e Jul 30 21:03:07.163978 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:07.163978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] Returning 404 to user: Floating IP not found for ID 25401f60-0017-45bd-a602-872b9d45711e {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:07.163978 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d56866b6-d521-4461-b202-3854824f7b6e tempest-FloatingIPDetailsNegativeTestJSON-393788291 tempest-FloatingIPDetailsNegativeTestJSON-393788291-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/25401f60-0017-45bd-a602-872b9d45711e" status: 404 len: 111 microversion: 2.1 time: 0.116123 Jul 30 21:03:07.164364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.164364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.164364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.164634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.171737 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 397/735] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:03:07 2022] GET /compute/v2.1/os-floating-ips/25401f60-0017-45bd-a602-872b9d45711e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:03:07.510621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:07.518879 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cecc96b-cdf4-4faa-80c3-7aac83ed1db4 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.368676 Jul 30 21:03:07.519681 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 339/736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:07 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:07.719131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:07.720409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:07.728509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.729287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.730159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.730838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.824843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=7 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:07.875205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:07.879178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:07.880224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:07.886887 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0b81aee-48b8-4fdd-9ddd-7159ba12c8c5 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.173153 Jul 30 21:03:07.887620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.888241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.889713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.890483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.902120 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 398/737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:07 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:07.909458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:07.910364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:07.917834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.918692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:07.919883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:07.920497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.104364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.115017 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42624653-438a-461e-b898-4ab15a0c5713 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1477 microversion: 2.1 time: 0.211367 Jul 30 21:03:08.115996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 399/738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:07 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:08.121465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:08.122192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:08.129244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.129849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.130704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.131212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.288059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.298663 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d05d073-9fdc-466a-9803-f4e402a92083 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.181298 Jul 30 21:03:08.311316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 400/739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:08 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:08.314984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.318285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-255e9375-f7ea-49bd-8fe5-74c3ca9dd579 req-eee07ae2-6d05-43d0-977f-0f39e8e4f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731ab961-17d8-4aef-af45-09a3d1d326fa", "name": "network-vif-plugged", "status": "completed", "tag": "d5641255-3be0-4f7e-a59c-045b58146116"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:08.325375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:08.328873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.331565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.332483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-255e9375-f7ea-49bd-8fe5-74c3ca9dd579 req-eee07ae2-6d05-43d0-977f-0f39e8e4f82e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.333204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-255e9375-f7ea-49bd-8fe5-74c3ca9dd579 req-eee07ae2-6d05-43d0-977f-0f39e8e4f82e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.333400 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f8e36542-d89c-4837-a6f1-e3b318a63de6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1607 microversion: 2.25 time: 0.464175 Jul 30 21:03:08.334765 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 340/740] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:07 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1607 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:08.364057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-255e9375-f7ea-49bd-8fe5-74c3ca9dd579 req-eee07ae2-6d05-43d0-977f-0f39e8e4f82e service nova] Creating event network-vif-plugged:d5641255-3be0-4f7e-a59c-045b58146116 for instance 731ab961-17d8-4aef-af45-09a3d1d326fa on nch2-master-1 Jul 30 21:03:08.367849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:08.372056 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-255e9375-f7ea-49bd-8fe5-74c3ca9dd579 req-eee07ae2-6d05-43d0-977f-0f39e8e4f82e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058808 Jul 30 21:03:08.372404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:08.373418 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 401/741] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:08.392995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.394568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.395717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.396420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.523523 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7225409b-163a-4d40-a1be-9b12205d1073 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.161339 Jul 30 21:03:08.525090 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 341/742] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:03:08 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:03:08.549915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:08.550767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:08.568719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.569181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.570077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.570542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.895602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:08.908105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:08.908978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:08.913566 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-933ad5c7-c1e5-4975-997a-004e970f158f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.376108 Jul 30 21:03:08.917999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.918448 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 402/743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:08 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:08.919100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:08.920086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:08.920684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.038993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2bfc46e0-2bae-4a81-8b55-53d7e17261a9 req-6801493d-0a5c-495a-af79-799d05cc3371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e09b6f-b1fe-404b-8558-2d0d13683751", "name": "network-vif-deleted", "tag": "b4ba4d5d-d02b-4505-9172-7b9432faf95e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:09.055471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2bfc46e0-2bae-4a81-8b55-53d7e17261a9 req-6801493d-0a5c-495a-af79-799d05cc3371 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.057496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2bfc46e0-2bae-4a81-8b55-53d7e17261a9 req-6801493d-0a5c-495a-af79-799d05cc3371 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.089852 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2bfc46e0-2bae-4a81-8b55-53d7e17261a9 req-6801493d-0a5c-495a-af79-799d05cc3371 service nova] Creating event network-vif-deleted:b4ba4d5d-d02b-4505-9172-7b9432faf95e for instance a0e09b6f-b1fe-404b-8558-2d0d13683751 on nch2-master-1 Jul 30 21:03:09.101348 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2bfc46e0-2bae-4a81-8b55-53d7e17261a9 req-6801493d-0a5c-495a-af79-799d05cc3371 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065939 Jul 30 21:03:09.102316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 403/744] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:09.148148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:09.149643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:09.159778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.166504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.167410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.167876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.314544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:09.344712 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-32f65e51-5815-48e8-abfd-fb872d0d84c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1472 microversion: 2.1 time: 0.432511 Jul 30 21:03:09.352506 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 342/745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:08 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:09.377292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:09.378211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:09.400144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.403449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.408899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.409987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.462698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b9f2d931d64de6a0ecdb1082102adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0afe6bde6aa4c1dbe9a01c553ee801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:09.504470 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3484a845-8349-42e4-8213-64f833eab123 tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 200 len: 1435 microversion: 2.1 time: 0.368490 Jul 30 21:03:09.508742 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 404/746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:09 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 1435 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:09.941519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:09.942994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:09.950517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.951330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.952369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:09.953514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:09.982828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:10.116498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:10.121184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:10.135047 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cec261a8-ff8a-4b31-bde6-32ac3beddb45 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1386 microversion: 2.1 time: 0.781193 Jul 30 21:03:10.139234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 343/747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:09 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1386 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:10.262296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:10.271689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e5d7726-aed7-40f9-b5fd-6d14494ac816 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.335096 Jul 30 21:03:10.272474 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 405/748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:09 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:10.324243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-25b7aaed-8ff1-46a5-a7c8-1204c8074a15 req-8979c2a5-b7a6-49da-8396-530a0d74b4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:10.334920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25b7aaed-8ff1-46a5-a7c8-1204c8074a15 req-8979c2a5-b7a6-49da-8396-530a0d74b4e9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:10.335662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25b7aaed-8ff1-46a5-a7c8-1204c8074a15 req-8979c2a5-b7a6-49da-8396-530a0d74b4e9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:10.349643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-25b7aaed-8ff1-46a5-a7c8-1204c8074a15 req-8979c2a5-b7a6-49da-8396-530a0d74b4e9 service nova] Creating event network-changed:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch2-master-1 Jul 30 21:03:10.354864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-25b7aaed-8ff1-46a5-a7c8-1204c8074a15 req-8979c2a5-b7a6-49da-8396-530a0d74b4e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034190 Jul 30 21:03:10.355694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 344/749] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:10.377594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:10.378400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:10.385870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:10.386710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:10.387992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:10.388676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:10.527047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:10.528052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] [instance: a0e09b6f-b1fe-404b-8558-2d0d13683751] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:10.534972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:10.535730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:10.536787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:10.537419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:10.546176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:10.559153 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e3647fe3-8867-4180-8874-5d7fb21a5541 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.186312 Jul 30 21:03:10.566667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 406/750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:10 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:10.566868 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] HTTP exception thrown: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Request method failure captured: Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 HTTP/1.1 Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxtKa4HfAVAVnf_o1F7_o5bl2rM-hx3SIS8VWY4a88hcJH61uOKwjJ8tDQRIr4WD_qkU8iCUule_1XwP6RAG-xXf_t7LP-E-ePuzQc8E9qONRcTjCWpGg9nML_y1cIySpTLdv1X16HJNYl1MHUp3RhM7QSQVak02w1Oy_JHvsiOUgw Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b0afe6bde6aa4c1dbe9a01c553ee801f Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:03:10.570606 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0afe6bde6aa4c1dbe9a01c553ee801f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0afe6bde6aa4c1dbe9a01c553ee801f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b0afe6bde6aa4c1dbe9a01c553ee801f Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1957520412 Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiagnosticsNegativeTest-1957520412-project Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e4b9f2d931d64de6a0ecdb1082102adb Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1957520412-project Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. Jul 30 21:03:10.572287 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a0e09b6f-b1fe-404b-8558-2d0d13683751'} Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:10.573212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. Jul 30 21:03:10.574685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:10.579864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] Returning 404 to user: Instance a0e09b6f-b1fe-404b-8558-2d0d13683751 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:10.579864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7695ba9-e8c5-4627-a54d-49c611246fcc tempest-ServerDiagnosticsNegativeTest-1957520412 tempest-ServerDiagnosticsNegativeTest-1957520412-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751" status: 404 len: 111 microversion: 2.1 time: 0.052727 Jul 30 21:03:10.580367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 345/751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:10 2022] GET /compute/v2.1/servers/a0e09b6f-b1fe-404b-8558-2d0d13683751 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:03:11.165305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:11.165937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:11.179178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.182134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.184362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.187998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.298923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:11.299604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:11.316066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.316797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.322977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.323710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.564492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:11.573025 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e38468a8-ae76-41d2-b20a-f141d1ea621d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1586 microversion: 2.1 time: 0.413540 Jul 30 21:03:11.595669 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 407/752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:11 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1586 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:11.601433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:11.602100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:11.620014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.620786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.621803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.622273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.663644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:11.692301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63eb5e40-43c4-4f7c-b6d5-99c663bddd2c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.402301 Jul 30 21:03:11.695103 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 346/753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:11 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:11.709833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0b78024c-5ed0-4079-aad3-cc3bdabb47a1 req-656b5f42-a50a-49bd-822e-b35f6dcd78af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1d3666-6ec4-4291-82e3-63605bac7470", "name": "network-vif-plugged", "status": "completed", "tag": "3b54de7a-3c1c-46da-a126-9d3481beafd4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:11.726393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0b78024c-5ed0-4079-aad3-cc3bdabb47a1 req-656b5f42-a50a-49bd-822e-b35f6dcd78af service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.727144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0b78024c-5ed0-4079-aad3-cc3bdabb47a1 req-656b5f42-a50a-49bd-822e-b35f6dcd78af service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.762158 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0b78024c-5ed0-4079-aad3-cc3bdabb47a1 req-656b5f42-a50a-49bd-822e-b35f6dcd78af service nova] Creating event network-vif-plugged:3b54de7a-3c1c-46da-a126-9d3481beafd4 for instance cd1d3666-6ec4-4291-82e3-63605bac7470 on nch1-master-1 Jul 30 21:03:11.769985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0b78024c-5ed0-4079-aad3-cc3bdabb47a1 req-656b5f42-a50a-49bd-822e-b35f6dcd78af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073381 Jul 30 21:03:11.771488 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 347/754] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:11.792462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:11.793675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:11.805095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.805842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:11.806824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:11.807509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:12.004804 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53b2ff70-9849-4707-b05e-d2e6fdd00b13 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231375 Jul 30 21:03:12.005541 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 348/755] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:03:11 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:12.081925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:12.091717 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17b49637-cda4-400f-875f-b2e5d86fde42 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.494800 Jul 30 21:03:12.106183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 408/756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:11 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:12.717007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:12.717636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:12.724469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:12.725147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:12.725932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:12.726606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:12.903347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:12.911902 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a20b0850-eb6c-4fa1-863e-a5e929d12af0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1330 microversion: 2.1 time: 0.199548 Jul 30 21:03:12.913109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 349/757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:12 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1330 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:13.117542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:13.119865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:13.131863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.134991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.139424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.142308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.579879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:13.604377 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14e4a65e-061b-4c88-87a8-eb201654be3f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.491883 Jul 30 21:03:13.604979 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 409/758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:13 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:13.778056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-91903c18-ec29-4b50-8be3-f99a75e1c9a0 req-230747f9-a01d-4d12-8c31-fd15d44314f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731ab961-17d8-4aef-af45-09a3d1d326fa", "tag": "d5641255-3be0-4f7e-a59c-045b58146116"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:13.783067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:13.786549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:13.810370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.811064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.813926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-91903c18-ec29-4b50-8be3-f99a75e1c9a0 req-230747f9-a01d-4d12-8c31-fd15d44314f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.814915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.815916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.820220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-91903c18-ec29-4b50-8be3-f99a75e1c9a0 req-230747f9-a01d-4d12-8c31-fd15d44314f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.863254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-91903c18-ec29-4b50-8be3-f99a75e1c9a0 req-230747f9-a01d-4d12-8c31-fd15d44314f2 service nova] Creating event network-changed:d5641255-3be0-4f7e-a59c-045b58146116 for instance 731ab961-17d8-4aef-af45-09a3d1d326fa on nch2-master-1 Jul 30 21:03:13.876018 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-91903c18-ec29-4b50-8be3-f99a75e1c9a0 req-230747f9-a01d-4d12-8c31-fd15d44314f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103005 Jul 30 21:03:13.890898 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 410/759] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:13.900909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2a6fe76a-4df2-4304-b769-68d140493cac req-b929a374-769e-4128-9c5e-54fcffc898f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:13.918303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2a6fe76a-4df2-4304-b769-68d140493cac req-b929a374-769e-4128-9c5e-54fcffc898f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:13.919366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2a6fe76a-4df2-4304-b769-68d140493cac req-b929a374-769e-4128-9c5e-54fcffc898f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:13.936107 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2a6fe76a-4df2-4304-b769-68d140493cac req-b929a374-769e-4128-9c5e-54fcffc898f2 service nova] Creating event network-vif-unplugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:03:13.955135 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2a6fe76a-4df2-4304-b769-68d140493cac req-b929a374-769e-4128-9c5e-54fcffc898f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061839 Jul 30 21:03:13.958235 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 411/760] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:13.970248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:13.971228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:14.007692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:14.008374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:14.009336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:14.009935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:14.244990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:14.257405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-349fb875-3dd0-443a-a0da-fc03ff374590 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1534 microversion: 2.1 time: 0.297556 Jul 30 21:03:14.272001 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 412/761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:13 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1534 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:14.281188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba632ad0-0658-4b27-8a2d-dbd1acc29984 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'create', calling method: .version_select at 0x7fbb5d774700>, body: {"pool": "a0034a96-be0d-4757-bce7-9e6e768c30b8"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:14.479009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:14.491272 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-598891d1-cdd9-4fb6-a56b-233c9f4692d9 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1586 microversion: 2.1 time: 0.723341 Jul 30 21:03:14.493186 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 350/762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:13 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1586 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:14.638533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:14.638533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:14.645337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:14.647334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:14.648836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:14.653744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:15.043968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:15.052046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-62144f45-3fcb-4611-b6d3-e33c787f6a30 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.430018 Jul 30 21:03:15.053274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 351/763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:14 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:15.513795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2044432280", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:15.609868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:15.610509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:15.611206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:15.611917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:15.613614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:15.632349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:15.633075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:15.634145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:15.634810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:15.657599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Getting quotas for project ae99b18c49be443e96955fd4ea16630f. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:03:15.663441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Getting quotas for user dea0b28116c64ba8ad7d6f83e63762d7 and project ae99b18c49be443e96955fd4ea16630f. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:03:15.680861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:03:15.683305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:03:15.772388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4c646a4-d394-400f-9b24-b433f49126fc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.717707 Jul 30 21:03:15.779858 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 352/764] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:03:15.787106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:15.790280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:15.797922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:15.888272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:15.897723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:15.899845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:15.919797 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4de97d16-241b-4500-9f9a-462d278a088e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "PUT /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1359 microversion: 2.75 time: 0.137543 Jul 30 21:03:15.932802 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 353/765] 10.222.0.17 () {62 vars in 1297 bytes} [Sat Jul 30 21:03:15 2022] PUT /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:15.946333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:15.947162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:16.026312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:16.049055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:16.056333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:16.070091 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1640639-1f69-4b53-908d-ca151ef92159 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1359 microversion: 2.75 time: 0.128301 Jul 30 21:03:16.074766 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 354/766] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:15 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1359 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:16.114384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0517b17f-66d6-4603-8868-9e53738542d7 req-f8ffb6ff-79b2-4870-bb20-e25a033e0ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-plugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:16.135678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0517b17f-66d6-4603-8868-9e53738542d7 req-f8ffb6ff-79b2-4870-bb20-e25a033e0ea3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:16.136352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0517b17f-66d6-4603-8868-9e53738542d7 req-f8ffb6ff-79b2-4870-bb20-e25a033e0ea3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:16.151828 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0517b17f-66d6-4603-8868-9e53738542d7 req-f8ffb6ff-79b2-4870-bb20-e25a033e0ea3 service nova] Creating event network-vif-plugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:03:16.157537 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0517b17f-66d6-4603-8868-9e53738542d7 req-f8ffb6ff-79b2-4870-bb20-e25a033e0ea3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068276 Jul 30 21:03:16.158172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 355/767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:16.163673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:16.164585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:16.171483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:16.172031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:16.172855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:16.173676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:16.437587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:16.449952 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e480306b-958a-49e7-9508-081ec606bef0 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.290223 Jul 30 21:03:16.450728 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 356/768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:16 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:16.562903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba632ad0-0658-4b27-8a2d-dbd1acc29984 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.286118 Jul 30 21:03:16.563783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 413/769] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:03:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:16.577989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: .version_select at 0x7fbb5fbf5b80>, body: {"addFloatingIp": {"address": "172.35.6.68"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:16.580894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:16.587625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:16.588105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:16.588925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:16.589465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:16.659478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Acquired lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:03:16.880532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1192764231", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:16.934195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:03:17.148692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:17.149274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:17.149969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:17.150620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:17.151200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:17.161964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.162424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.163495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.163951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.183568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Getting quotas for project 12e516b713ea41b5a6586035cc755589. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:03:17.189364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Getting quotas for user 73d81ad63c23451f9d9235f1faba50d1 and project 12e516b713ea41b5a6586035cc755589. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:03:17.201197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:03:17.204097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:03:17.251152 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c69bc5f-5605-4f4c-ac54-e88212fe6459 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496949 Jul 30 21:03:17.252436 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 414/770] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:03:17.258086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:17.258917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:17.266276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.266743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.267560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.268192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.388170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:17.399158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:17.400782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:17.408826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be299138-8ce7-4357-9e39-493c087827d8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1417 microversion: 2.75 time: 0.155162 Jul 30 21:03:17.409414 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 415/771] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:17 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1417 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:17.413972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-551712a5-282d-4840-869d-59eedfa2357f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:17.414598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-551712a5-282d-4840-869d-59eedfa2357f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:17.481779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-551712a5-282d-4840-869d-59eedfa2357f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:17.489129 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-551712a5-282d-4840-869d-59eedfa2357f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1217 microversion: 2.1 time: 0.078687 Jul 30 21:03:17.495943 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 416/772] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:17 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:17.497062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:17.498422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:17.507717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.508463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.509374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:17.509937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:17.663771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:17.674873 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1d857506-1e3a-4234-bec7-914e2eed251f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1478 microversion: 2.1 time: 0.183453 Jul 30 21:03:17.675666 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 417/773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:17 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:18.082078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:03:18.090195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b3db7c20-8c83-4ecf-8752-e72e5082ec54 req-5ed5d098-b6f1-41e4-b4b4-0537a5b79a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1d3666-6ec4-4291-82e3-63605bac7470", "tag": "3b54de7a-3c1c-46da-a126-9d3481beafd4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:18.102078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b3db7c20-8c83-4ecf-8752-e72e5082ec54 req-5ed5d098-b6f1-41e4-b4b4-0537a5b79a56 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.102857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b3db7c20-8c83-4ecf-8752-e72e5082ec54 req-5ed5d098-b6f1-41e4-b4b4-0537a5b79a56 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.121818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b3db7c20-8c83-4ecf-8752-e72e5082ec54 req-5ed5d098-b6f1-41e4-b4b4-0537a5b79a56 service nova] Creating event network-changed:3b54de7a-3c1c-46da-a126-9d3481beafd4 for instance cd1d3666-6ec4-4291-82e3-63605bac7470 on nch1-master-1 Jul 30 21:03:18.127842 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b3db7c20-8c83-4ecf-8752-e72e5082ec54 req-5ed5d098-b6f1-41e4-b4b4-0537a5b79a56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041196 Jul 30 21:03:18.129090 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 418/774] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:18.436217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:18.437230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:18.445916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.446642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.447649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.448287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.527746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:18.540947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:18.543998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:18.551202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6bc3008-f831-4512-b314-c2c98b6c9527 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1417 microversion: 2.75 time: 0.120612 Jul 30 21:03:18.552315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 419/775] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:18 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1417 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:18.557094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:18.557992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:18.564467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.565202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.566206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.566868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.633448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:18.640956 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-305841d5-1b62-40bc-a948-8faa5cd721b3 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1213 microversion: 2.1 time: 0.087504 Jul 30 21:03:18.641537 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 420/776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:18 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:18.696650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:18.697419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:18.704158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.704630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.705413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.705862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.890516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:18.901363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-74c19c61-cede-437e-8926-5370552e47bc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1464 microversion: 2.1 time: 0.208429 Jul 30 21:03:18.902515 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 421/777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:18 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:18.923812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:18.927455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:18.934837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.935420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:18.936301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:18.937072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.043448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Updating instance_info_cache with network_info: [{"id": "3b54de7a-3c1c-46da-a126-9d3481beafd4", "address": "fa:16:3e:63:0a:a1", "network": {"id": "a4eb712f-5b3e-4c43-b0ff-c7cce1e11e6f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-381207969-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0a256de385094348b6c03bcd2eab0d6f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3b54de7a-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:03:19.059895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Releasing lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:03:19.061291 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa97b521-304c-45ab-8a0e-aadb7eb6d919 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 202 len: 0 microversion: 2.1 time: 2.488826 Jul 30 21:03:19.063128 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 357/778] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:16 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 0 bytes in 2491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 30 21:03:19.072194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7906206-3a11-4322-b0dc-e83298a9f473 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'create', calling method: .version_select at 0x7fbb5dad8160>, body: {"pool": "a0034a96-be0d-4757-bce7-9e6e768c30b8"} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:19.099266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.108949 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df550e83-ef66-4f72-b51e-c01c46239734 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1464 microversion: 2.1 time: 0.189357 Jul 30 21:03:19.109667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 422/779] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:18 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:19.132551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:19.136652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:19.144731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.145523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.146577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.147224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.230573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:19.231259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:19.231794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:19.232221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:19.232652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:19.302320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:19.309247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.309918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.310754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.311231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.340599 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a21df991-62ad-4cb7-9ed8-b3b549c9255d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 1068 microversion: 2.1 time: 0.212001 Jul 30 21:03:19.343621 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 423/780] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:19 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 1068 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 30 21:03:19.359947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:19.360617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:19.367154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.367667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.368465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.368919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.519021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.521804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:19.529029 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be13ee72-c4c3-4e05-b120-ef9d667322f2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.173527 Jul 30 21:03:19.529705 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 424/781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:19 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:19.579534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:19.581194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:19.596953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.598232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.599472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.600152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.681403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.690424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.692017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.697342 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d06497f-0ac9-49a3-915f-ec758ee36fdd tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1417 microversion: 2.75 time: 0.124634 Jul 30 21:03:19.698228 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 425/782] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:19 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1417 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:19.706412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:19.707046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:19.713363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.713874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.714958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:19.719897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:19.795118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:19.806727 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a9c4bff-ad14-4751-b146-74c58846ee20 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1287 microversion: 2.1 time: 0.104138 Jul 30 21:03:19.807434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 426/783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:19 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:20.553815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:20.554555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:20.562960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.563590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.564540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.565002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.707256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:20.714792 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5568102c-7f2f-46c6-b97c-484481a6d695 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.167027 Jul 30 21:03:20.715397 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 427/784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:20 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:20.724382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:20.725192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:20.732018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.732488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.733285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.733744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.803129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:20.812680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:20.814436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:20.819887 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-babf81d1-7ee2-47b7-8954-13c42e0865a8 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1438 microversion: 2.75 time: 0.099677 Jul 30 21:03:20.820609 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 428/785] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:20 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:20.834398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:20.835122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:20.842598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.843377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.844344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.844872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.910421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:20.920253 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91b7e8a9-1f49-495c-921c-f7dc46657452 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1275 microversion: 2.1 time: 0.089758 Jul 30 21:03:20.921683 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 429/786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:20 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:20.927020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:20.929975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:20.937296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.937778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:20.938687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:20.939181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.022731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:21.023450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:21.023946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:21.024375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:21.024804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:21.095122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:21.101717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.102189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.103249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.103541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.171351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.174862 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7906206-3a11-4322-b0dc-e83298a9f473 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.107508 Jul 30 21:03:21.176160 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 358/787] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:03:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:21.183745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.186192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.192644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.174"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:21.192992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a19334df-4568-485b-a409-6f7b242c4ee0 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "POST /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64/action" status: 202 len: 1495 microversion: 2.75 time: 0.269920 Jul 30 21:03:21.193836 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 430/788] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:03:20 2022] POST /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64/action => generated 1495 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 30 21:03:21.195336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:21.207638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.208341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.209339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.209802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.219409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:21.220276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:21.228411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.228666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.229532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.229991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.237067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Acquired lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:03:21.302217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.313034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.314630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.319826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a62c1bf2-86ed-4ab6-a241-595e9ff9ed64 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.106165 Jul 30 21:03:21.320588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 431/789] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:21 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:21.737053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:21.737784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:21.745583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.746048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.746846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.747313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.844318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8.", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:03:21.844982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Releasing lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:03:21.845790 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.845790 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Request method failure captured: Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action HTTP/1.1 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 46 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zx_GDM4p78IebeNirLE0lWSzA8zpjjW1QkvbDm6B6HPXpSZzlAh3IGs1PXQi-sg5Nt34T99HsYgQTtK2NLNYQOhreRGv_p7TpAGWTnkjb3RYmuKBDU9U0xBU8iwdcOJHQowMWs2miwVT2hMGh7rSwlUohoKki5CE-naQl2UtD9OVU4 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:03:21.850551 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a256de385094348b6c03bcd2eab0d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 85f0c582040c43b1b27791cb66656e9e Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: {"addFloatingIp": {"address": "172.35.6.174"}} Jul 30 21:03:21.853033 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'cd1d3666-6ec4-4291-82e3-63605bac7470', 'body': {'addFloatingIp': {'address': '172.35.6.174'}}} Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.853984 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:03:21.859046 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.860232 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.861331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Returning 400 to user: Cannot associate floating IP 172.35.6.174 (92fe85c9-cfff-4070-b4d9-3477125f65d3) with port 3b54de7a-3c1c-46da-a126-9d3481beafd4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network a0034a96-be0d-4757-bce7-9e6e768c30b8. Jul 30 21:03:21.862584 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-66483484-c6c1-4bc8-be53-a2a4e72aafba'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:21.863397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3eaa9db1-a373-4c67-98e6-c9bd00814eea tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 400 len: 382 microversion: 2.1 time: 0.668142 Jul 30 21:03:21.863397 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 359/790] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:21 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 382 bytes in 670 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:03:21.871006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ea64453-e986-49f4-9650-a4d10c01e226 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '.version_select at 0x7fbb5d32d790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:21.900700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:21.909168 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe0630f7-aef1-44a2-9dfe-6dc40830fcee tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.176744 Jul 30 21:03:21.909808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 432/791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:21 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:21.941652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:21.942401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:21.948625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.949152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:21.950013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:21.950464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:22.084718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:22.093145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d6e20f95-5e8e-47c9-86ed-5178e39cfb1f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.155414 Jul 30 21:03:22.093724 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 433/792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:21 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:22.345228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:22.345889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:22.348830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:22.352777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:22.353251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:22.354051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:22.354511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:22.427361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:22.435659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:22.437793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:22.442806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a292a023-5419-454b-a87d-34777feeffe7 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.101545 Jul 30 21:03:22.443344 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 434/793] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:22 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:22.854142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5839f0cd-5208-4432-a600-fe890af989b7 req-ccaba57f-45d8-41fb-8d45-5b861aaa9f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:22.865981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5839f0cd-5208-4432-a600-fe890af989b7 req-ccaba57f-45d8-41fb-8d45-5b861aaa9f8e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:22.866529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5839f0cd-5208-4432-a600-fe890af989b7 req-ccaba57f-45d8-41fb-8d45-5b861aaa9f8e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:22.878032 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5839f0cd-5208-4432-a600-fe890af989b7 req-ccaba57f-45d8-41fb-8d45-5b861aaa9f8e service nova] Creating event network-changed:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:03:22.882724 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5839f0cd-5208-4432-a600-fe890af989b7 req-ccaba57f-45d8-41fb-8d45-5b861aaa9f8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032350 Jul 30 21:03:22.883353 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 435/794] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:22.930832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:22.931614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:22.938670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:22.939135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:22.939959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:22.940412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.086365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:23.095620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2af83e2-8524-4dd5-b3af-dd8178eac928 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.169063 Jul 30 21:03:23.111237 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 436/795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:22 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:23.116442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:23.117076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:23.123891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.124355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.125139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.125588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.193787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ea64453-e986-49f4-9650-a4d10c01e226 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/92fe85c9-cfff-4070-b4d9-3477125f65d3" status: 202 len: 0 microversion: 2.1 time: 1.333466 Jul 30 21:03:23.195538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 360/796] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:03:21 2022] DELETE /compute/v2.1/os-floating-ips/92fe85c9-cfff-4070-b4d9-3477125f65d3 => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:03:23.204199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: .version_select at 0x7fbb5fbf5a60>, body: {"removeFloatingIp": {"address": "172.35.6.68"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:23.258063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:23.267059 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec3363ab-5bd1-4cb1-b150-a60360718520 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.154378 Jul 30 21:03:23.267865 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 437/797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:23 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:23.417346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:23.424049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.424618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.425489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.426049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.467214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:23.468649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:23.474750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.475211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.476039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:23.476487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:23.543444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:23.552060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:23.553585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:23.558650 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2adeaccc-653d-4e64-9023-3f179d6d99aa tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.095314 Jul 30 21:03:23.559438 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 438/798] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:23 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:23.660435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Acquired lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:03:24.119013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:24.121576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:24.131347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.131816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.132653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.133106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.272048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:24.274385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:24.281130 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8905edde-91a9-4e99-a23b-56819b499ffc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.166123 Jul 30 21:03:24.281729 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 439/799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:24 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:24.289600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:24.290255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:24.297661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.298127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.298911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.299391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.435506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:24.443137 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b87b405e-d9db-4fa3-9cfd-96009e323474 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.158512 Jul 30 21:03:24.443750 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 440/800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:24 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:24.532659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:03:24.584343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:24.584991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:24.591160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.591676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.592984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.593546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.666550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:24.676130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:24.677674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:24.699637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94971cda-6ecf-47e4-9a9e-d649ef16954f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.119403 Jul 30 21:03:24.700525 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 441/801] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:24 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:24.903331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0fa766bf-edce-4861-a0d2-65c035feae0b req-b65b6b60-4167-4d75-8083-24dea0448604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1d3666-6ec4-4291-82e3-63605bac7470", "tag": "3b54de7a-3c1c-46da-a126-9d3481beafd4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:24.913467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0fa766bf-edce-4861-a0d2-65c035feae0b req-b65b6b60-4167-4d75-8083-24dea0448604 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:24.913866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0fa766bf-edce-4861-a0d2-65c035feae0b req-b65b6b60-4167-4d75-8083-24dea0448604 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:24.926517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0fa766bf-edce-4861-a0d2-65c035feae0b req-b65b6b60-4167-4d75-8083-24dea0448604 service nova] Creating event network-changed:3b54de7a-3c1c-46da-a126-9d3481beafd4 for instance cd1d3666-6ec4-4291-82e3-63605bac7470 on nch1-master-1 Jul 30 21:03:24.936185 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0fa766bf-edce-4861-a0d2-65c035feae0b req-b65b6b60-4167-4d75-8083-24dea0448604 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036385 Jul 30 21:03:24.937138 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 442/802] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:25.303578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:25.304838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:25.313396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.313866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.314653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.315276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.445686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Updating instance_info_cache with network_info: [{"id": "3b54de7a-3c1c-46da-a126-9d3481beafd4", "address": "fa:16:3e:63:0a:a1", "network": {"id": "a4eb712f-5b3e-4c43-b0ff-c7cce1e11e6f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-381207969-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0a256de385094348b6c03bcd2eab0d6f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3b54de7a-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:03:25.462329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Releasing lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:03:25.463515 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41dbdbeb-ef55-481b-98b0-5af7b6137b4f tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 202 len: 0 microversion: 2.1 time: 2.264010 Jul 30 21:03:25.464616 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 361/803] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:23 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 0 bytes in 2266 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 30 21:03:25.469603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:25.470457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:25.473681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:25.482206 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac82bd72-985c-401a-abe0-3051fc0d266d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.183326 Jul 30 21:03:25.482984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 443/804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:25 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:25.496901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.496901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.496901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.496901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.507671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd040710-5f70-46d9-b957-a7e7d93ee5a0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '.version_select at 0x7fbb5d078280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:25.647235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:25.818771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:25.844655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2c08503-eb17-4428-87d6-568f2aea16fc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.378759 Jul 30 21:03:25.856657 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 362/805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:25 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:25.863444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:25.864378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:25.871476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.871935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.872970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:25.874313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:25.995834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:26.005566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:26.007091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:26.012156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-44a98aaa-72e1-4a4a-802b-c842a288484b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.154202 Jul 30 21:03:26.012724 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 363/806] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:25 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:26.303177 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd040710-5f70-46d9-b957-a7e7d93ee5a0 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/00d45df0-4a23-4fd8-96fb-866953d35306" status: 202 len: 0 microversion: 2.1 time: 0.799238 Jul 30 21:03:26.303811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 444/807] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:03:25 2022] DELETE /compute/v2.1/os-floating-ips/00d45df0-4a23-4fd8-96fb-866953d35306 => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:03:26.313746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc08f39e-3091-41c0-9cd2-f80c9294e926 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc08f39e-3091-41c0-9cd2-f80c9294e926 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Request method failure captured: Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action HTTP/1.1 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 34 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zx_GDM4p78IebeNirLE0lWSzA8zpjjW1QkvbDm6B6HPXpSZzlAh3IGs1PXQi-sg5Nt34T99HsYgQTtK2NLNYQOhreRGv_p7TpAGWTnkjb3RYmuKBDU9U0xBU8iwdcOJHQowMWs2miwVT2hMGh7rSwlUohoKki5CE-naQl2UtD9OVU4 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:03:26.317595 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a256de385094348b6c03bcd2eab0d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 85f0c582040c43b1b27791cb66656e9e Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: {"addFloatingIp": {"address": ""}} Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:03:26.319223 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'cd1d3666-6ec4-4291-82e3-63605bac7470', 'body': {'addFloatingIp': {'address': ''}}} Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '' Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:26.320285 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:03:26.321799 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:03:26.322973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 30 21:03:26.322973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.322973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc08f39e-3091-41c0-9cd2-f80c9294e926 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:26.322973 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc08f39e-3091-41c0-9cd2-f80c9294e926 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 400 len: 142 microversion: 2.1 time: 0.009834 Jul 30 21:03:26.322973 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 364/808] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:26 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:03:26.329523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: .version_select at 0x7fbb5fbdf280>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:26.331997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:26.338937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.339426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.340253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.340707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.405046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Acquired lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:03:26.501785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:26.506364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:26.507058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:26.514861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.515441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.516299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.516816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.536548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Releasing lock "refresh_cache-cd1d3666-6ec4-4291-82e3-63605bac7470" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:03:26.537139 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] HTTP exception thrown: floating IP not found Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Request method failure captured: Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action HTTP/1.1 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 41 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zx_GDM4p78IebeNirLE0lWSzA8zpjjW1QkvbDm6B6HPXpSZzlAh3IGs1PXQi-sg5Nt34T99HsYgQTtK2NLNYQOhreRGv_p7TpAGWTnkjb3RYmuKBDU9U0xBU8iwdcOJHQowMWs2miwVT2hMGh7rSwlUohoKki5CE-naQl2UtD9OVU4 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:03:26.538885 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a256de385094348b6c03bcd2eab0d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 85f0c582040c43b1b27791cb66656e9e Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: exception: floating IP not found Jul 30 21:03:26.540461 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'cd1d3666-6ec4-4291-82e3-63605bac7470', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:26.541569 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 30 21:03:26.542959 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.545479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Returning 404 to user: floating IP not found {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:26.547037 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c074e779-12a1-474a-8c81-ec26b5519a6d tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 404 len: 67 microversion: 2.1 time: 0.222312 Jul 30 21:03:26.548040 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 445/809] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:26 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 67 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:03:26.558008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9889aa4-5698-47ea-9a97-a49588b1205c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Action: 'action', calling method: .version_select at 0x7fbb5fbdf310>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:26.603224 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d9889aa4-5698-47ea-9a97-a49588b1205c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9889aa4-5698-47ea-9a97-a49588b1205c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Request method failure captured: Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action HTTP/1.1 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 44 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zx_GDM4p78IebeNirLE0lWSzA8zpjjW1QkvbDm6B6HPXpSZzlAh3IGs1PXQi-sg5Nt34T99HsYgQTtK2NLNYQOhreRGv_p7TpAGWTnkjb3RYmuKBDU9U0xBU8iwdcOJHQowMWs2miwVT2hMGh7rSwlUohoKki5CE-naQl2UtD9OVU4 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:03:26.604847 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a256de385094348b6c03bcd2eab0d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 85f0c582040c43b1b27791cb66656e9e Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:03:26.606377 ncdv-master-1 devstack@n-api.service[130984]: exception: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'cd1d3666-6ec4-4291-82e3-63605bac7470', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:26.607311 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 30 21:03:26.609166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:26.610503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9889aa4-5698-47ea-9a97-a49588b1205c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:26.610503 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9889aa4-5698-47ea-9a97-a49588b1205c tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action" status: 404 len: 88 microversion: 2.1 time: 0.053465 Jul 30 21:03:26.610503 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 446/810] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:26 2022] POST /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470/action => generated 88 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:03:26.616317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:26.620088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:26.626330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.627044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.627946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.628404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.653927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:03:26.671948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:26.680025 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87e912d6-396f-4515-9e7d-a9f1bf662527 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.178933 Jul 30 21:03:26.680685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 365/811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:26 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:26.734581 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44067fd6-b0f8-4ba2-8971-61a0fdf9c360 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 204 len: 0 microversion: 2.1 time: 0.121016 Jul 30 21:03:26.735771 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 447/812] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:03:26 2022] DELETE /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:03:26.744697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:26.745279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:26.752119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.752625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.753586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.754133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.866175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:26.866882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:26.873536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.874028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.874796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:26.875242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:26.882713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:26.890343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5820330-ec0e-494b-982c-994e7895bbfe tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1540 microversion: 2.1 time: 0.150491 Jul 30 21:03:26.891131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 366/813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:26 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1540 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:27.006690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:27.014174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0ebb706-48f0-478f-9d60-7c5165a14bb8 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.152187 Jul 30 21:03:27.015246 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 448/814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:26 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:27.037267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:27.037921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:27.044109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.044572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:27.045346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.045826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:27.110918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:27.114341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:27.120056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:27.121570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:27.127133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f93ab55-418c-4cae-bc52-5ab4c5672d3b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.093843 Jul 30 21:03:27.127724 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 367/815] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:27 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:27.700798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:27.701422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:27.703422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:27.705042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:27.711161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.711647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:27.712421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.712866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:27.841311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:27.848792 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-202de562-3ff0-4fb3-afed-38456ddda194 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.151845 Jul 30 21:03:27.849352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 449/816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:27 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:27.911735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:27.912358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:27.919460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.919925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:27.921181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:27.921635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.036319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:28.036956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:28.044321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.045310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.046645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.047093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.064597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:28.072435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-86dcbe6a-6cc9-4bf4-b8dc-05aeba58b601 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1540 microversion: 2.1 time: 0.165124 Jul 30 21:03:28.073130 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 368/817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:27 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1540 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:28.152541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:28.153445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:28.162347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.163323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.163829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.164339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.192010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:28.200410 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27c629cd-d17d-4ab4-afb7-a3fd9b000b92 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.168135 Jul 30 21:03:28.201582 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 450/818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:28 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:28.206635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-42f4e3d9-b099-4859-b6a7-3d5896f6577e req-b6a2ed21-3b90-40e8-8873-edc04fdb78f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-plugged", "status": "completed", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:28.218579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-42f4e3d9-b099-4859-b6a7-3d5896f6577e req-b6a2ed21-3b90-40e8-8873-edc04fdb78f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.219267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-42f4e3d9-b099-4859-b6a7-3d5896f6577e req-b6a2ed21-3b90-40e8-8873-edc04fdb78f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.231168 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-42f4e3d9-b099-4859-b6a7-3d5896f6577e req-b6a2ed21-3b90-40e8-8873-edc04fdb78f2 service nova] Creating event network-vif-plugged:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:03:28.236708 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-42f4e3d9-b099-4859-b6a7-3d5896f6577e req-b6a2ed21-3b90-40e8-8873-edc04fdb78f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033543 Jul 30 21:03:28.237331 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 451/819] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:28.246981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:28.256324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:28.257794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:28.268002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-def53a80-ad18-480d-8dae-9fbf75ef97d5 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.114591 Jul 30 21:03:28.269347 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 369/820] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:28 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:28.872655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:28.874178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:28.884539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-95d3e6b6-e0f3-471a-87a7-fda88811f2a1 req-213079fa-8da8-4460-9992-495a390b939c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1d3666-6ec4-4291-82e3-63605bac7470", "name": "network-vif-deleted", "tag": "3b54de7a-3c1c-46da-a126-9d3481beafd4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:28.888841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.889933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.890971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.891519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.896179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-95d3e6b6-e0f3-471a-87a7-fda88811f2a1 req-213079fa-8da8-4460-9992-495a390b939c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:28.896841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-95d3e6b6-e0f3-471a-87a7-fda88811f2a1 req-213079fa-8da8-4460-9992-495a390b939c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:28.910744 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-95d3e6b6-e0f3-471a-87a7-fda88811f2a1 req-213079fa-8da8-4460-9992-495a390b939c service nova] Creating event network-vif-deleted:3b54de7a-3c1c-46da-a126-9d3481beafd4 for instance cd1d3666-6ec4-4291-82e3-63605bac7470 on nch1-master-1 Jul 30 21:03:28.917875 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-95d3e6b6-e0f3-471a-87a7-fda88811f2a1 req-213079fa-8da8-4460-9992-495a390b939c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037878 Jul 30 21:03:28.918798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 370/821] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:29.052338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.060049 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-687fcc6e-dce3-4962-bd63-2a52dc06cfdf tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.193520 Jul 30 21:03:29.060620 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 452/822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:28 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:29.096487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:29.097352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:29.105513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.105979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.106773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.107224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.138071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.138539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.138996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lazy-loading 'fault' on Instance uuid cd1d3666-6ec4-4291-82e3-63605bac7470 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:29.180768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f0c582040c43b1b27791cb66656e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a256de385094348b6c03bcd2eab0d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.189044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1f3fd24-fadb-4032-a8cb-770a55dba23e tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 200 len: 1320 microversion: 2.1 time: 0.098800 Jul 30 21:03:29.189613 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 371/823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:29 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 1320 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:29.221621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:29.222265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:29.228392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.228856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.229639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.230097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.294050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:29.294875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:29.301783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.302332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.303184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:29.303619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:29.376869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.377048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.385609 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4e5e216-5c8b-4fcd-a89f-ac07b559bd67 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1317 microversion: 2.1 time: 0.167777 Jul 30 21:03:29.386692 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 453/824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:29 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:29.387002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.388884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:29.394099 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41a26aaf-db07-4e56-ab4a-3a1b4c3dbb77 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.104031 Jul 30 21:03:29.394687 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 372/825] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:29 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:30.082082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:30.082700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:30.089595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.090056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.090825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.091270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.209865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:30.210478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] [instance: cd1d3666-6ec4-4291-82e3-63605bac7470] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:30.217010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.218029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.218802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.219274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.222249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:30.229893 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c0e9ab5-fa9f-4242-b8b6-aa051522852f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.151687 Jul 30 21:03:30.230562 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 454/826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:30 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:30.232657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] HTTP exception thrown: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Request method failure captured: Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 HTTP/1.1 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zx_GDM4p78IebeNirLE0lWSzA8zpjjW1QkvbDm6B6HPXpSZzlAh3IGs1PXQi-sg5Nt34T99HsYgQTtK2NLNYQOhreRGv_p7TpAGWTnkjb3RYmuKBDU9U0xBU8iwdcOJHQowMWs2miwVT2hMGh7rSwlUohoKki5CE-naQl2UtD9OVU4 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:03:30.234323 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a256de385094348b6c03bcd2eab0d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a256de385094348b6c03bcd2eab0d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0a256de385094348b6c03bcd2eab0d6f Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960 Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 85f0c582040c43b1b27791cb66656e9e Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. Jul 30 21:03:30.235920 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'cd1d3666-6ec4-4291-82e3-63605bac7470'} Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:30.236807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. Jul 30 21:03:30.238340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:30.239725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] Returning 404 to user: Instance cd1d3666-6ec4-4291-82e3-63605bac7470 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:30.239725 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f48a6d49-9ace-4169-aa8b-262388d04290 tempest-FloatingIPsAssociationNegativeTestJSON-808257960 tempest-FloatingIPsAssociationNegativeTestJSON-808257960-project] 10.222.0.17 "GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470" status: 404 len: 111 microversion: 2.1 time: 0.029682 Jul 30 21:03:30.239725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 373/827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:30 2022] GET /compute/v2.1/servers/cd1d3666-6ec4-4291-82e3-63605bac7470 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:03:30.408210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:30.408848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:30.415171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.415688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.416479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.416935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.419865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:30.420513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:30.426892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.427416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.428189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.428631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.504705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:30.513200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:30.514838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:30.520371 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67c89429-7bad-4e66-9689-43ac63396b96 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.104527 Jul 30 21:03:30.526536 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 374/828] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:30 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:30.558789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:30.566354 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cae8f6a-8662-453b-8fde-d7eb534d99c2 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1467 microversion: 2.1 time: 0.162195 Jul 30 21:03:30.566929 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 455/829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:30 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:30.587096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1967039922", "metadata": {"image_type": "test"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:30.589599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:30.596311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.596781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.597575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:30.598028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:30.637586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Getting quotas for project 12e516b713ea41b5a6586035cc755589. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:03:30.641656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Getting quotas for user 73d81ad63c23451f9d9235f1faba50d1 and project 12e516b713ea41b5a6586035cc755589. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:03:30.841971 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b90a5dc4-50db-4dc7-abbf-054252d92dfb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "POST /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619/action" status: 202 len: 0 microversion: 2.1 time: 0.258644 Jul 30 21:03:30.843667 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 375/830] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:30 2022] POST /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:03:30.854231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba32b926-37ca-4500-acae-be36d276ffad tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cfdd310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:30.911327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba32b926-37ca-4500-acae-be36d276ffad tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.060961 Jul 30 21:03:30.911916 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 456/831] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:30 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:31.252027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:31.252834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:31.260736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:31.261255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:31.262327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:31.263366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:31.522555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:31.531379 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f4c6e07-c5aa-45b2-bcf2-8d64ee5651a2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.284524 Jul 30 21:03:31.531967 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 376/832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:31 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:31.546286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:31.546947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:31.554754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:31.555375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:31.556285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:31.556856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:31.627331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:31.636981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:31.638492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:31.643584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2c758c1-c696-45ca-bcfa-4da3a4f5e1bb tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.102047 Jul 30 21:03:31.655507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 457/833] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:31 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:31.926644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b5d869b-8002-455a-ae92-0e43186c1e0a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d2d8e50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:31.981116 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b5d869b-8002-455a-ae92-0e43186c1e0a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.058210 Jul 30 21:03:31.986303 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 377/834] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:31 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:32.555970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:32.557189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:32.565892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:32.566664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:32.567806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:32.568471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:32.673229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:32.674570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:32.689532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:32.690675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:32.691734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:32.692928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:32.745429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:32.753872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd46476a-6302-4146-b48f-0da4d96eed4f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.204654 Jul 30 21:03:32.768137 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 458/835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:32 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:32.806308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:32.816017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:32.817503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:32.822833 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56845c88-69ef-480e-b3d7-30ef2ea0ee1f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.157682 Jul 30 21:03:32.835313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 378/836] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:32 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:32.997461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cd7da0a-54d2-494a-a680-23abf508646d tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d08e820>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:33.077397 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cd7da0a-54d2-494a-a680-23abf508646d tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.085096 Jul 30 21:03:33.077990 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 459/837] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:32 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:33.777270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:33.777902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:33.790746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:33.791231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:33.792308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:33.792925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:33.851862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:33.852495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:33.859484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:33.859961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:33.860752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:33.861211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:33.879610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:33.939887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:33.948235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:33.949772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:33.955375 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2df28fbf-5365-47ac-91f1-3bff0414558b tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.109007 Jul 30 21:03:33.955964 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 460/838] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:33 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:33.986955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:33.995061 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8209ad75-5900-4f97-9186-ab6a26541077 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.222278 Jul 30 21:03:33.996021 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 379/839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:33 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:34.093530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5effbc0f-8298-4fe2-a284-5d8a34bf8146 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cfabb80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:34.138791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5effbc0f-8298-4fe2-a284-5d8a34bf8146 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.049527 Jul 30 21:03:34.139481 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 461/840] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:34 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:34.225341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b14e292-b0ad-49a1-ba5a-6437832e1a7b"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:34.228211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:34.235704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:34.237004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:34.237203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:34.237662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:34.764697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-181798df-d061-4e31-a1f8-1d0b52a43fda tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "POST /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542204 Jul 30 21:03:34.774028 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 380/841] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:03:34 2022] POST /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:34.990179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:34.993323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:35.003058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:35.003931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:35.006666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:35.008061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:35.020989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:35.022378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:35.047194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:35.047939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:35.048936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:35.049562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:35.131315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:35.142573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:35.144895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:35.163462 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-277d670d-2eda-4e26-90a5-1c3a5dc8ced4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.183378 Jul 30 21:03:35.164047 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 462/842] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:34 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:35.186827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-516aeb0f-9e55-456e-bbad-9d39f98889ef tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cff9d30>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:35.261153 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-516aeb0f-9e55-456e-bbad-9d39f98889ef tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.094188 Jul 30 21:03:35.269660 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 463/843] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:35 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:35.320771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:35.330995 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfb2506f-6844-43ae-a691-807bb6d34812 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.317267 Jul 30 21:03:35.332238 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 381/844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:35 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:36.198463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:36.201606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:36.226685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:36.227680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:36.229484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:36.230124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:36.279879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d50a793d-f857-421c-811f-205674d8fe3a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1ec3a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:36.370251 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d50a793d-f857-421c-811f-205674d8fe3a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.097256 Jul 30 21:03:36.379837 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 382/845] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:36 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:36.386648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:36.387676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:36.396255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:36.410807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:36.413444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:36.417310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:36.418960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:36.419701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:36.423150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:36.432487 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47ac9628-a56b-483c-bbb6-f74476aa64f9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.243528 Jul 30 21:03:36.434455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 464/846] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:36 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:36.623082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-69f6b8f7-0be2-4531-946b-09f2d62e6475 req-13dd4fcf-b6b0-4719-b09d-aa53671bba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-plugged", "status": "completed", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:36.646425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-69f6b8f7-0be2-4531-946b-09f2d62e6475 req-13dd4fcf-b6b0-4719-b09d-aa53671bba7e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:36.647521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-69f6b8f7-0be2-4531-946b-09f2d62e6475 req-13dd4fcf-b6b0-4719-b09d-aa53671bba7e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:36.688344 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-69f6b8f7-0be2-4531-946b-09f2d62e6475 req-13dd4fcf-b6b0-4719-b09d-aa53671bba7e service nova] Creating event network-vif-plugged:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:03:36.703116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-69f6b8f7-0be2-4531-946b-09f2d62e6475 req-13dd4fcf-b6b0-4719-b09d-aa53671bba7e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080861 Jul 30 21:03:36.703958 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 465/847] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:36.797229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:36.806009 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e09a42d5-04dd-4645-8158-c422e1063d5f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.424502 Jul 30 21:03:36.807178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 383/848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:36 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:37.386592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0ecb7de-ec48-4f14-ae48-dd34b444d5a4 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d774700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:37.456300 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0ecb7de-ec48-4f14-ae48-dd34b444d5a4 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.075250 Jul 30 21:03:37.462685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:37.463983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:37.478870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 466/849] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:37 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:37.483863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:37.484519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:37.485546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:37.486152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:37.491330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:37.582872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:37.594509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:37.597265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:37.604617 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f439612a-11a6-4bb0-85c5-abb86bb15605 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.146372 Jul 30 21:03:37.605508 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 384/850] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:37 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:37.832903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:37.833744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:37.851117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:37.851709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:37.855721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:37.856345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:38.488472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f88e425-3108-40bd-b66d-729804bd7b5f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1a55e0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:38.502607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:38.530922 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f51c86f7-3e4f-4837-8e83-09681c498eba tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.701923 Jul 30 21:03:38.532249 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 467/851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:37 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:38.608944 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f88e425-3108-40bd-b66d-729804bd7b5f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.126133 Jul 30 21:03:38.610643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 385/852] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:38 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:38.637264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:38.637907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:38.654027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:38.655244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:38.657152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:38.657975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:38.781273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:38.796512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:38.799025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:38.808278 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0328b7ae-45a2-4d56-9334-01c46cb9f85f tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.180510 Jul 30 21:03:38.826281 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 468/853] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:38 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:39.556868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:39.557507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:39.581650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.582916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:39.584426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.585188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:39.633851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-001f11d8-d494-4007-b03c-7cde3fa41d18 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d025a60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:39.761263 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-001f11d8-d494-4007-b03c-7cde3fa41d18 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.139020 Jul 30 21:03:39.761976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 469/854] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:39 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:39.786834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:39.796043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:39.823191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.833326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:39.834586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.835942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:39.965275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:39.974133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b2ccdb2-5bfc-4d72-984b-ee0681d88280 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.425569 Jul 30 21:03:39.975346 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 386/855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:39 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:39.980325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:39.981277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:39.988876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.989696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:39.991017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:39.991732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:40.081093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:40.095209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:40.097879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:40.104918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-498c1275-fb84-44be-acb4-7d9af1278eaf tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.127901 Jul 30 21:03:40.106344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 387/856] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:39 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:40.177748 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed3270ac-7db6-4dc8-842a-11f5768ea7a0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1812 microversion: 2.1 time: 0.413782 Jul 30 21:03:40.180102 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 470/857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:39 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1812 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:40.201894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:40.209478 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:03:40.209478 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:03:40.214201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:40.216233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:40.222297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:40.222923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:40.267070 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b9b750e3-4ebe-4cc9-bbcf-b5704c8cbbe8 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068971 Jul 30 21:03:40.269070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 388/858] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:03:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:40.776538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22051f53-8e34-4947-a0be-9dbc0d439e79 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1bf040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:40.863730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b0104aa3-db19-42d3-8732-aff95cd3eb96"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:40.867184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:40.885117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22051f53-8e34-4947-a0be-9dbc0d439e79 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.112736 Jul 30 21:03:40.889744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 389/859] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:40 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:40.894135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:40.897354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:40.903726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:40.904316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.002633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:41.002737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:41.018312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:41.024837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.027830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.031466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.038310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.275865 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] HTTP exception thrown: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Request method failure captured: Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments/1b14e292-b0ad-49a1-ba5a-6437832e1a7b HTTP/1.1 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 74 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZxkZoZXtFWU2lThbkMEQ7JbRvYGvgKK6cK_vMGcMwLYLSlncBym9b0k8x_Q-MzwgIgu6_FA_ZekvhjvZy4IFzf3DLBtEoGvdyHObvxh0-BHyE127zoFAnxi3uvmMLe4JO6qN49q_uZogzbyRPXwh9tfJ4mcKZRoFwkijUl31nlwquk Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6ed49ee4eca649a4a75640c7a5b12026 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:03:41.280092 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ed49ee4eca649a4a75640c7a5b12026", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6ed49ee4eca649a4a75640c7a5b12026 Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesAdminNegativeTest-740510895-project-admin Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e486b81cb41f4535bbe9e89ebffdaa04 Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesAdminNegativeTest-740510895-project-admin Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: {"volumeAttachment": {"volumeId": "b0104aa3-db19-42d3-8732-aff95cd3eb96"}} Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:03:41.281761 ncdv-master-1 devstack@n-api.service[130984]: exception: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': '3766e564-dc7d-4328-9cf8-cd5dd04c9a41', 'id': '1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'body': {'volumeAttachment': {'volumeId': 'b0104aa3-db19-42d3-8732-aff95cd3eb96'}}} Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:03:41.282942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. (HTTP 404) (Request-ID: req-be9af832-4c1a-409d-9b9e-4b6810e1b3be) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:03:41.284239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:41.285702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. Jul 30 21:03:41.287035 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:03:41.289772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Returning 400 to user: Volume b0104aa3-db19-42d3-8732-aff95cd3eb96 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:41.291404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c251d00-4a25-4e0d-bb3d-c6f34ab49c08 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments/1b14e292-b0ad-49a1-ba5a-6437832e1a7b" status: 400 len: 107 microversion: 2.1 time: 0.861846 Jul 30 21:03:41.292456 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 471/860] 10.222.0.17 () {60 vars in 1433 bytes} [Sat Jul 30 21:03:40 2022] PUT /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments/1b14e292-b0ad-49a1-ba5a-6437832e1a7b => generated 107 bytes in 863 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:03:41.305681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:41.307555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:41.322823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:41.327827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.329181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.330585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.331319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.333512 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6095e55d-c04d-4ff6-a970-8728c5c71453 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.337828 Jul 30 21:03:41.334104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 390/861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:40 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:41.444432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:41.445260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:41.453186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.453874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.454816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:41.455444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:41.562720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:41.580834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:41.610568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:41.652362 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9489f82-d4db-49d8-b6ce-241754bc35d9 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.358542 Jul 30 21:03:41.656259 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 472/862] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:41 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:41.744454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lazy-loading 'services' on Instance uuid 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:41.907867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23bbbbf0-ffd3-431a-a41a-f2dc29140505 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf39700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:41.956078 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments/1b14e292-b0ad-49a1-ba5a-6437832e1a7b" status: 202 len: 0 microversion: 2.1 time: 0.511118 Jul 30 21:03:41.960413 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 391/863] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:03:41 2022] DELETE /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments/1b14e292-b0ad-49a1-ba5a-6437832e1a7b => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:03:41.978425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:41.999318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:42.032590 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23bbbbf0-ffd3-431a-a41a-f2dc29140505 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.130618 Jul 30 21:03:42.036577 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 473/864] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:41 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:42.043273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.047076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:42.060299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.064267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:42.166590 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a17c09eb-8cb6-4c4a-8d49-55021688c417 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199788 Jul 30 21:03:42.167456 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 392/865] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:03:41 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:42.354482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:42.355465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:42.373137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.374102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:42.375075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.375714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:42.598621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1834535819", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "0ad1dccc-1f18-4d8d-a178-5d43d230baa8"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:42.635988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:42.648172 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d589bd80-eedd-4106-8cae-37dc60a69f14 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.297969 Jul 30 21:03:42.648758 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 474/866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:42 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:42.666864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86ac0138-c1aa-493c-88f1-f53c793d7a32", "device": "/dev/xvdb"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:42.674291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:42.680991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.681558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:42.682333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:42.683468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] validate_networks() for [('0ad1dccc-1f18-4d8d-a178-5d43d230baa8', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:03:42.688412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.122207 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469386 Jul 30 21:03:43.125278 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 475/867] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:03:42 2022] POST /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:43.149081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:43.150031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:43.176965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.180200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.181607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.182932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.332815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:43.334114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:43.334770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:43.335785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:43.336533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:43.362698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:43.373188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:43.374431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.374922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.376613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:43.382651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.387079 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27875c19-bac2-432c-a10f-458119fad326 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.248207 Jul 30 21:03:43.395343 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 476/868] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:43 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:43.396215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.398939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00028391-7f5b-4612-a1fa-213b35cb7b7c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf3c790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:43.450246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:03:43.469337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00028391-7f5b-4612-a1fa-213b35cb7b7c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.075428 Jul 30 21:03:43.476535 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 477/869] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:43 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:43.476719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for user 8379e04d2b30488387b3eefab6669768 and project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:03:43.480147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:43.482452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:43.500400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.500400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.500716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.500953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.505430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:03:43.507980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:03:43.584915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a151082-da74-48c3-99e8-99996d5f00d3 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113763 Jul 30 21:03:43.587159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd519036-51e7-4da0-820e-dfbb836ae9ab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069002 Jul 30 21:03:43.594139 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 478/870] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:03:43 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:03:43.600025 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 393/871] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:03:43.602542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-345000d9-eb06-4d2a-b3f2-045da5c3c9a2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:43.603175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-345000d9-eb06-4d2a-b3f2-045da5c3c9a2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:43.670181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:43.670810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:43.691994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.691994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.691994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:43.691994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:43.721979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-345000d9-eb06-4d2a-b3f2-045da5c3c9a2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:43.730151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-345000d9-eb06-4d2a-b3f2-045da5c3c9a2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1208 microversion: 2.1 time: 0.132389 Jul 30 21:03:43.735282 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 479/872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:43 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1208 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:43.900975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-460055437", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "958fb119-4aee-4de6-9af0-281e0123ec69"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:43.926720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:44.057685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] validate_networks() for [('958fb119-4aee-4de6-9af0-281e0123ec69', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:03:44.205479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:44.342740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb68ee91-d20d-487b-9b16-3bde85960daa tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.676369 Jul 30 21:03:44.360363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 394/873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:43 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:44.428000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:44.428821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:44.437837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.439489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:44.440555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.442945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:44.527228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:44.540561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:44.542714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:44.549653 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4a92840-c963-4400-8463-d0b1fec0b4bc tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.126815 Jul 30 21:03:44.550750 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 395/874] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:44 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:44.556130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09da3e0d-6972-48d6-b131-aa9e224f7283 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1620d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:44.629122 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09da3e0d-6972-48d6-b131-aa9e224f7283 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.076774 Jul 30 21:03:44.636364 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 396/875] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:44 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:44.762149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:44.763173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:44.777736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.782743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:44.784999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.785695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:44.897984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:44.909741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87e0e755-cc70-405e-8793-c8c93640c4a3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1212 microversion: 2.1 time: 0.153989 Jul 30 21:03:44.912204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 397/876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:44 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1212 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:44.949161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:44.950362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:44.951567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:44.952151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:44.952744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:44.975981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.976739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:44.977724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:44.978339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.000499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:03:45.005007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Getting quotas for user f8b35ab211584884a72057fa31184836 and project cfc4b787c95143c0b9d6f53832e324f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:03:45.025150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:03:45.027953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:03:45.087908 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52e783d8-6645-4602-a7ff-79b171bcc732 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192427 Jul 30 21:03:45.089312 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 480/877] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:03:45.100365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6859e21f-d1d8-4cd1-9677-eda8c7d18428 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:45.101269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6859e21f-d1d8-4cd1-9677-eda8c7d18428 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:45.178126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6859e21f-d1d8-4cd1-9677-eda8c7d18428 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:45.188681 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6859e21f-d1d8-4cd1-9677-eda8c7d18428 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1217 microversion: 2.1 time: 0.092065 Jul 30 21:03:45.199682 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 398/878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:45 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:45.366775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:45.367445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:45.377089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.377561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.378360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.378811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.563757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:45.576799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:45.577618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:45.578067 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c9c4ed1-73b1-4fcd-829e-9027b2269462 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1473 microversion: 2.1 time: 0.214767 Jul 30 21:03:45.579026 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 481/879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:45 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:45.586352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.586828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.587710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.588177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.643796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3842ed82-c6b8-4cb3-ab89-f06108ba5bd7 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cee3550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:45.740011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:45.750498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:45.752099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:45.758815 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ccfb08a-6807-41cb-ad3a-ab34f81acd92 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.186512 Jul 30 21:03:45.760187 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 399/880] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:45 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:45.761094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3842ed82-c6b8-4cb3-ab89-f06108ba5bd7 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.120835 Jul 30 21:03:45.764599 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 482/881] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:45 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:45.932928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:45.933572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:45.942388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.942901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:45.943784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:45.944236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.105544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:46.124249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-195785a2-bded-40f3-b7b8-d5311c79ff9c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1204 microversion: 2.1 time: 0.194779 Jul 30 21:03:46.125141 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 400/882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:45 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1204 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:46.211996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:46.212910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:46.241603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.242382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.243487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.252723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.334590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:46.343769 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9d236d7-1d67-45ba-b24f-0c19f24063b2 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1213 microversion: 2.1 time: 0.137516 Jul 30 21:03:46.359941 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 483/883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:46 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:46.600412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:46.602056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:46.609891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.610478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.615861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.616415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.780919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa33b9f8-3058-431a-b674-375895dccb41 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cee3670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:46.863262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:46.875128 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ecfd402-33db-45f5-94a0-a4b2aa32d524 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.277539 Jul 30 21:03:46.877977 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 401/884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:46 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:46.899022 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa33b9f8-3058-431a-b674-375895dccb41 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.123417 Jul 30 21:03:46.900507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 484/885] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:46 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:46.911546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:46.912241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:46.919222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.920197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:46.921544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:46.922805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.003560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:47.016993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:47.018843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:47.025791 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c3a99737-76ac-4a9f-86ec-60af729b61ac tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.146429 Jul 30 21:03:47.026615 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 402/886] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:46 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:47.146629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:47.147559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:47.158867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.159881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.160884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.161495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.254563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:47.262979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b018de8-2ffe-4ceb-a788-493120905eb4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1268 microversion: 2.1 time: 0.120721 Jul 30 21:03:47.267540 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 485/887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:47 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1268 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:47.369155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:47.369740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:47.385181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.385708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.386515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.386960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.478415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:47.486918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-32d8987b-c19f-48d4-9c6e-6e9783705222 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1277 microversion: 2.1 time: 0.122598 Jul 30 21:03:47.487538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 403/888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:47 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:47.900534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:47.901359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:47.914148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6cad1c46-b3c7-4c4f-b7e6-d8ef1703e56f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1623a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:47.924055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.924825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.926206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:47.926822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:47.956711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:47.983617 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6cad1c46-b3c7-4c4f-b7e6-d8ef1703e56f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.073346 Jul 30 21:03:47.984444 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 404/889] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:47 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:48.057762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:48.058768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:48.072637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.073481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.074529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.075279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.140113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.154102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28b1dce8-56e2-490a-8c1d-66557e1c17c6 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.256190 Jul 30 21:03:48.158864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 486/890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:47 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:48.294169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:48.296559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:48.317600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.319582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.322099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.326850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.464035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.474551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.491223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.500492 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4ea13fe-83ce-41dc-a5e2-43166f7f174c tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1447 microversion: 2.75 time: 0.447229 Jul 30 21:03:48.504422 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 405/891] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:48 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1447 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:03:48.518411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:48.519774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:48.546120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.546929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.555582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.556308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.561854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.576352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2ca6a936-68d6-4548-9d82-9dbe0ef6c094 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1278 microversion: 2.1 time: 0.283661 Jul 30 21:03:48.578058 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 487/892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:48 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:48.615901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:48.703023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:48.726116 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-860e12e6-b114-4420-9893-5ac1b2bce24a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1287 microversion: 2.1 time: 0.217987 Jul 30 21:03:48.729415 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 406/893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:48 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1287 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:48.816092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:48.817214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:48.832058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.832058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:48.833565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:48.834149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.001173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e51f3cf-5e74-4db8-9cf0-0bfc635f253a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1b2160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:49.068622 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e51f3cf-5e74-4db8-9cf0-0bfc635f253a tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1424 microversion: 2.1 time: 0.072284 Jul 30 21:03:49.074036 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 407/894] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:48 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:49.180062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:49.180700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:49.188362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.188835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.189632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.190091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.193959 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f2db9710-0c15-4343-8da4-7d4c154702ee tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1858 microversion: 2.1 time: 0.382348 Jul 30 21:03:49.198700 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 488/895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:48 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1858 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:49.215948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:49.219747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:49.227406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.229153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.230361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.231029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.262717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lazy-loading 'flavor' on Instance uuid 9f1f5803-c208-4680-a8cd-11e41ddd0935 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:49.281172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Going to try to live migrate instance to nch2-master-1 {{(pid=130984) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:03:49.902297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:49.928387 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5de1f054-c115-4ae1-9c84-7ee592b7754a tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.752100 Jul 30 21:03:49.939315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 408/896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:49 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:49.945514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:49.946735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:49.970391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.971158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:49.972200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:49.972808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:50.221764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:50.238519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:50.244531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:50.270568 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ccfdb3d8-912f-49bf-9d05-464035e04c5e tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1453 microversion: 2.75 time: 0.339797 Jul 30 21:03:50.277656 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 409/897] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:49 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1453 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:50.295243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:50.298048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:50.314226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:50.316405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:50.319449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:50.321288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:50.856514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:50.868782 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-303122fb-0b3f-4a4f-b6ac-4bef81a96ea0 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.588826 Jul 30 21:03:50.873220 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 410/898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:50 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:50.880364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:50.883939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:50.901901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:50.904944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:50.905915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:50.906552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.479239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:51.487768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34bf2bd4-16d8-450c-badd-88303c184333 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.613126 Jul 30 21:03:51.499311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 411/899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:50 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:51.499311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-85ef3f86-20b1-48b2-9685-ab2c2f3483d9 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d0a2af0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:51.562854 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-85ef3f86-20b1-48b2-9685-ab2c2f3483d9 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1433 microversion: 2.1 time: 0.073046 Jul 30 21:03:51.563492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 412/900] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:51 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1433 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:51.577615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-97999e56-a12c-4a78-a086-8c2fc0e090e0 req-388a8332-0600-46da-ae96-8b8d5bcaceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:51.589691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-97999e56-a12c-4a78-a086-8c2fc0e090e0 req-388a8332-0600-46da-ae96-8b8d5bcaceea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.590065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-97999e56-a12c-4a78-a086-8c2fc0e090e0 req-388a8332-0600-46da-ae96-8b8d5bcaceea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.602462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-97999e56-a12c-4a78-a086-8c2fc0e090e0 req-388a8332-0600-46da-ae96-8b8d5bcaceea service nova] Creating event network-vif-unplugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:03:51.608474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-97999e56-a12c-4a78-a086-8c2fc0e090e0 req-388a8332-0600-46da-ae96-8b8d5bcaceea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035386 Jul 30 21:03:51.609310 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 413/901] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:51.616679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:51.617617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:51.629228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.629935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.633273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.634243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.925791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:51.934811 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef44a759-d74b-4ee0-91d9-3e285798edf2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.324007 Jul 30 21:03:51.935743 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 414/902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:51 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:51.940298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f58c7412-c513-49dc-84c7-bda67717ca98 req-e0c04c03-d591-4469-8870-d9cf8bd2c825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983acaf3-8025-4357-a90e-fa1c74ccc477", "tag": "678a3e08-5991-471a-8092-88b834148102"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:51.951441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f58c7412-c513-49dc-84c7-bda67717ca98 req-e0c04c03-d591-4469-8870-d9cf8bd2c825 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.952103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f58c7412-c513-49dc-84c7-bda67717ca98 req-e0c04c03-d591-4469-8870-d9cf8bd2c825 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.965409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f58c7412-c513-49dc-84c7-bda67717ca98 req-e0c04c03-d591-4469-8870-d9cf8bd2c825 service nova] Creating event network-changed:678a3e08-5991-471a-8092-88b834148102 for instance 983acaf3-8025-4357-a90e-fa1c74ccc477 on nch1-master-1 Jul 30 21:03:51.971843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f58c7412-c513-49dc-84c7-bda67717ca98 req-e0c04c03-d591-4469-8870-d9cf8bd2c825 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034907 Jul 30 21:03:51.972513 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 415/903] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:51.978881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:51.979806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:51.986881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.987633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:51.988501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:51.989083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.086657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.095749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.097311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.103800 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ea5a411-7a4f-4b04-bae6-3f9296617ba6 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1438 microversion: 2.75 time: 0.129890 Jul 30 21:03:52.104379 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 416/904] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:51 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:52.109201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b60f25e0-2bc5-4402-9bed-fd5dc46c2f03 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d162f70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.159216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b60f25e0-2bc5-4402-9bed-fd5dc46c2f03 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 200 len: 1433 microversion: 2.1 time: 0.053528 Jul 30 21:03:52.160275 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 417/905] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 1433 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:52.165039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1a721e6a-bd69-421d-8b59-a8203e842eb9 req-5faa637e-a754-4351-ba71-c6a56f19433e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5741921-0325-43c0-842e-3f07d2b09e74", "tag": "042ec646-e05c-4662-83fb-a34cd88e48de"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:52.176263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1a721e6a-bd69-421d-8b59-a8203e842eb9 req-5faa637e-a754-4351-ba71-c6a56f19433e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.176796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1a721e6a-bd69-421d-8b59-a8203e842eb9 req-5faa637e-a754-4351-ba71-c6a56f19433e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.188552 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1a721e6a-bd69-421d-8b59-a8203e842eb9 req-5faa637e-a754-4351-ba71-c6a56f19433e service nova] Creating event network-changed:042ec646-e05c-4662-83fb-a34cd88e48de for instance c5741921-0325-43c0-842e-3f07d2b09e74 on nch1-master-1 Jul 30 21:03:52.193496 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1a721e6a-bd69-421d-8b59-a8203e842eb9 req-5faa637e-a754-4351-ba71-c6a56f19433e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Jul 30 21:03:52.194101 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 418/906] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:52.199743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.201326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.208402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.208878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.209669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.210111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.253092 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2efe2e0-b61d-404a-9484-8daf76a2d465 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/action" status: 202 len: 0 microversion: 2.1 time: 3.040793 Jul 30 21:03:52.254719 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 489/907] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:49 2022] POST /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/action => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:03:52.358112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.366958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:52.367907 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b607555-a7d9-4638-bf82-ce03495412c7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.172642 Jul 30 21:03:52.368497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 419/908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:52.370728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.373933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.374551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.378182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.378606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.379443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.380178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.381063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.381568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.382357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.382802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.460184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:03:52.460618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:03:52.461132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:03:52.461553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:03:52.462003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:03:52.524950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.532004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.538521 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1750a3c8-7275-46f4-b3b7-5116665c170b tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1467 microversion: 2.1 time: 0.168371 Jul 30 21:03:52.539100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.539828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.539940 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 420/909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1467 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:52.540402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.540852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.548675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.549841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.561041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.561892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.563342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.564177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.679556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:52.702846 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d144db89-239e-4f03-aeff-dc96322b056e tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64/action" status: 202 len: 1942 microversion: 2.75 time: 0.446768 Jul 30 21:03:52.716669 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 490/910] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:03:52 2022] POST /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64/action => generated 1942 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 30 21:03:52.731437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.732979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.745216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.746123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.747263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.748553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.798260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:52.807075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbda57b9-f553-45c1-ac57-091def9465bd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.266018 Jul 30 21:03:52.807701 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 421/911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:52.812822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-00c1370d-e68a-4556-8566-db379193aa19 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d1b2d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.870986 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-00c1370d-e68a-4556-8566-db379193aa19 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd" status: 200 len: 784 microversion: 2.1 time: 0.061997 Jul 30 21:03:52.871840 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 422/912] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd => generated 784 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:52.878999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:52.879655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:52.893949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.894611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:52.895465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:52.896230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.009063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:53.037500 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b41ef0eb-58bf-4e22-9be1-6ecdd0630a8a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.319564 Jul 30 21:03:53.038148 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 491/913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:53.047945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f95ff1ba-856e-4e77-a8ff-0ae5266a2d6d tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.058268 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f95ff1ba-856e-4e77-a8ff-0ae5266a2d6d tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015633 Jul 30 21:03:53.059257 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 492/914] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:03:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:53.063834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.064797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:53.070505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.070979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.071803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.072263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.147271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:53.170303 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8042fd07-b092-4b70-8506-a45ccc1cf1ad tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.296721 Jul 30 21:03:53.183867 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 423/915] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:52 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:53.194399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8d605f8-111d-4a45-8a10-1184b5ce2130 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d162940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.365867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:53.380653 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c79c7fd6-9f37-4a18-b4c9-0c8a94681afc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.320304 Jul 30 21:03:53.381249 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 493/916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:53 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:53.389876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.390733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:53.397051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.398333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.399477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.399949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.423757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:53.631373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:53.646442 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8cfedb40-b2d4-4cab-a701-41993f436515 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.260170 Jul 30 21:03:53.647910 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 494/917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:53 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:53.656189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1ecd8b5b-0148-486b-acb8-e0a9668cca1f req-1e02b94c-fb54-442f-a84b-4362180d1eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-plugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:53.672354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ecd8b5b-0148-486b-acb8-e0a9668cca1f req-1e02b94c-fb54-442f-a84b-4362180d1eb4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.673040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ecd8b5b-0148-486b-acb8-e0a9668cca1f req-1e02b94c-fb54-442f-a84b-4362180d1eb4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.687413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1ecd8b5b-0148-486b-acb8-e0a9668cca1f req-1e02b94c-fb54-442f-a84b-4362180d1eb4 service nova] Creating event network-vif-plugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:03:53.693689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1ecd8b5b-0148-486b-acb8-e0a9668cca1f req-1e02b94c-fb54-442f-a84b-4362180d1eb4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043293 Jul 30 21:03:53.694869 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 495/918] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:53.862450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.866265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:53.882257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.882923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.884526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:53.885141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:53.953278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8d605f8-111d-4a45-8a10-1184b5ce2130 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "DELETE /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 204 len: 0 microversion: 2.1 time: 0.766524 Jul 30 21:03:53.953971 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 424/919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:53 2022] DELETE /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:03:53.962262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e44a136-8c4e-4c7c-99f1-d8d0a01538dd tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d162820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:53.985701 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9e44a136-8c4e-4c7c-99f1-d8d0a01538dd tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] HTTP exception thrown: Image not found. Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e44a136-8c4e-4c7c-99f1-d8d0a01538dd tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Request method failure captured: Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 HTTP/1.1 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyUN4R_vJFUPI6BJ-yC_8CSJxScomtKnkP1dIfcq9TnBWHbambHFopFDUYXAprzvMQVicu2RHIPzpJ6jpS8uo_Zzi3yzkeHNi19wmBFX6f4o4Y-3m7q-AXoCrX20JtK87EfndYpLz2eY88Xk05lDhgTD68spHm-MoICpWvsmPn5ylo Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:03:53.998320 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/12e516b713ea41b5a6586035cc755589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_12e516b713ea41b5a6586035cc755589", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 73d81ad63c23451f9d9235f1faba50d1 Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '46007d10-9652-4f9a-863c-fe80d1422759'} Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:03:54.000140 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46007d10-9652-4f9a-863c-fe80d1422759 Jul 30 21:03:54.001899 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:03:54.003399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46007d10-9652-4f9a-863c-fe80d1422759 could not be found. Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:03:54.004925 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:03:54.006428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:03:54.010131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e44a136-8c4e-4c7c-99f1-d8d0a01538dd tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:03:54.011337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9e44a136-8c4e-4c7c-99f1-d8d0a01538dd tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 404 len: 62 microversion: 2.1 time: 0.053278 Jul 30 21:03:54.013208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 425/920] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:53 2022] GET /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:03:54.026131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1822205017"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:54.030618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.037933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.038292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.039176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.039911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.057049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:54.067963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1623b261-972b-474d-bd24-148f73d59c22 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.237284 Jul 30 21:03:54.068912 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 496/921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:53 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:54.084099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.085157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.092228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.092680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.093623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.094398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.242127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:54.242602 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c290c96e-679a-4d94-9732-ef566e4bdbc0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "POST /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619/action" status: 202 len: 0 microversion: 2.1 time: 0.222924 Jul 30 21:03:54.247513 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 426/922] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:54 2022] POST /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:03:54.254645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.255516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.264636 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf68dab0-0331-4af5-8c41-48f3ad6a19d5 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.186023 Jul 30 21:03:54.265474 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 497/923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:54.265766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.266410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.267317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.268019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.271145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-723f4330-ca7a-4839-821d-985b031bddf6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf43c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.363859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-723f4330-ca7a-4839-821d-985b031bddf6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.096040 Jul 30 21:03:54.364543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:54.364816 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 498/924] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:54.383034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b569cc1-bda8-4abc-b68b-d610181d4806 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.133423 Jul 30 21:03:54.390782 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 427/925] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:54.403424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.404404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.413809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.414282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.415094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.415586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.559878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:54.568273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2c60b3db-1d2d-4df1-95d5-a1060e3a55fc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.169370 Jul 30 21:03:54.568847 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 499/926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:54.668991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.669957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.677379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.678074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.679023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.679629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.822540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:54.831021 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aca59065-acf5-46a1-b5f6-118b0f33579f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.166296 Jul 30 21:03:54.831717 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 428/927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:54.980094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:54.980721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:54.986985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.987492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:54.988268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:54.988715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.003753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.020061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.090402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.090995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:55.098138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.098602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.099417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.099875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.104271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.117391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:55.119868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.137680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0273aefe-36ef-4333-98bb-9ca5d26930ea tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 2345 microversion: 2.25 time: 0.161662 Jul 30 21:03:55.139144 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 500/928] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:54 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 2345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:55.160427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.163372 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:03:55.163372 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:03:55.165037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.165613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.166653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.167142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.184587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.199108 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee953428-a733-4173-abbb-891f6ce413d7 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042458 Jul 30 21:03:55.199760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 501/929] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:03:55.257634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:55.270535 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df790f3a-de45-42c5-b061-fbb8baa25592 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.184156 Jul 30 21:03:55.271578 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 429/930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:55.286972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.287232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:55.293687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.294194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.295169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.295801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.382280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c146e91-a1a3-43bb-aa98-eec4bd60abb0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d0a2040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.449227 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c146e91-a1a3-43bb-aa98-eec4bd60abb0 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.072809 Jul 30 21:03:55.457060 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 430/931] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:55.460271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:55.462354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.462974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:55.469081 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6bb6537c-1b0b-48a0-98b4-f66aa27c3b98 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.186907 Jul 30 21:03:55.469255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.469601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.470319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 502/932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:55.479932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.480534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.562200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:55.591688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.592539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:55.599336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.600000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.601224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.601445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-06eea19e-ba77-4273-b6df-641957f486f7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.143048 Jul 30 21:03:55.602013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.613365 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 431/933] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:55.752216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:55.765425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c909f18a-f6a2-4962-b656-7cf60625e44f tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1479 microversion: 2.1 time: 0.180456 Jul 30 21:03:55.766771 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 503/934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1479 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:55.852905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:55.853415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:55.856429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:55.860501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.860947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.861727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:55.862175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:55.999084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:56.006719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d80ea85d-7662-46ad-8680-425ca877c856 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.157743 Jul 30 21:03:56.007388 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 432/935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:55 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:56.294655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-277c5ae8-6280-47e5-ad9e-9d6f86400acb req-44357756-139d-415a-a21e-0142a2ebd30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-unplugged", "status": "completed", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:56.297140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:56.297821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.304946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-277c5ae8-6280-47e5-ad9e-9d6f86400acb req-44357756-139d-415a-a21e-0142a2ebd30c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.305604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-277c5ae8-6280-47e5-ad9e-9d6f86400acb req-44357756-139d-415a-a21e-0142a2ebd30c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.305877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.306120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.306977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.307462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.319615 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-277c5ae8-6280-47e5-ad9e-9d6f86400acb req-44357756-139d-415a-a21e-0142a2ebd30c service nova] Creating event network-vif-unplugged:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:03:56.324962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-277c5ae8-6280-47e5-ad9e-9d6f86400acb req-44357756-139d-415a-a21e-0142a2ebd30c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035009 Jul 30 21:03:56.325631 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 504/936] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:56.444174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:56.453120 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbe87366-c1a6-4b3b-a4ec-8abe6c45bdb3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.160718 Jul 30 21:03:56.453702 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 433/937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:56 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:56.464870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e645d03-239b-480b-a911-915c1530f9a6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf43b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:56.492658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:56.493295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.501205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.501205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.501986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.502440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.514713 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e645d03-239b-480b-a911-915c1530f9a6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.054039 Jul 30 21:03:56.515722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 505/938] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:56 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:56.627563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:56.628765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.635683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.636155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.636983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.637441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.650510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:56.658565 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d6b67817-a7b7-4ea9-ae9e-cd755192d248 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.169971 Jul 30 21:03:56.659141 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 434/939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:56 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:56.664046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef5d39c0-6fcc-4989-9a8e-f153d1d721ae", "device": "/dev/xvdb"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:56.666968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.673688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.674161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.674947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.675434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.715497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:56.734869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed57a544-4eba-414f-8020-bcb1f2c5d357 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.111145 Jul 30 21:03:56.735930 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 506/940] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:56 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:56.788346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:56.789200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.796660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.797135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.797932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.798392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.939994 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-202d5fe8-e664-4052-83b7-c172a6897a05 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.279492 Jul 30 21:03:56.940636 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 435/941] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Jul 30 21:03:56 2022] POST /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:03:56.944309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:56.953032 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-633f4c8b-6fda-4133-8add-cd1f0d398bb2 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1464 microversion: 2.1 time: 0.169376 Jul 30 21:03:56.953607 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 507/942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:56 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:56.986755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:56.989249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:56.996118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.996587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:56.997428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:56.997877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.029390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.030463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.036605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.037076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.037851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.038305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.073384 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41066e92-fa83-4d27-b354-bd6a3f2f2c83 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 0 microversion: 2.1 time: 0.096165 Jul 30 21:03:57.074191 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 436/943] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:56 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:03:57.082347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.083060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.089266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.089898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.090688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.091820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.124232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.124772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.125233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lazy-loading 'fault' on Instance uuid e22ad54e-f15a-40e3-aa8b-d60574d444e8 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:57.183207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:57.191327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f59967dd-307a-44a3-9e98-0ffc404d1eab tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.166737 Jul 30 21:03:57.200019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 508/944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:57.249493 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed8977fa-e592-459d-9ab5-aee7fa3a65d7 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1598 microversion: 2.1 time: 0.170598 Jul 30 21:03:57.250394 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 437/945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:57.269688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:57.272094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.278253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.279276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.280247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.280697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.360358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5666f0f-05b3-4f4f-8fb9-cb2e609be5b8 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action" status: 202 len: 0 microversion: 2.1 time: 0.094367 Jul 30 21:03:57.364166 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 509/946] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:03:57 2022] POST /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:03:57.369245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.369981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.377936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.378396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.379174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.379673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.474242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.475160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.481746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.482210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.483187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.483680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.514536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bde8e86b-81d3-4917-b00b-f2906db0e178 tempest-ServersAdminTestJSON-1384954889 tempest-ServersAdminTestJSON-1384954889-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1615 microversion: 2.1 time: 0.149200 Jul 30 21:03:57.515270 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 438/947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:57.538320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e52e1ecd-71b8-401f-8caf-2082ca1f9f78 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d929940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.585526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e52e1ecd-71b8-401f-8caf-2082ca1f9f78 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.051052 Jul 30 21:03:57.586208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 439/948] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:57.591536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.592279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.599494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.600813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.602325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.603005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.631932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:03:57.641074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:57.649300 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1dc5d132-b3ae-4edd-9e35-e59f084cca3c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.179152 Jul 30 21:03:57.649870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 510/949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:57.681833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.682571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.689512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.690045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.690898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.691530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.719388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e70eacd4-693e-4e09-88f9-8f477a54eedc tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 204 len: 0 microversion: 2.1 time: 0.130812 Jul 30 21:03:57.728033 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 440/950] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:03:57 2022] DELETE /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:03:57.734750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.735636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.741929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.742467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.743383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.744246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.842907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:57.850475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad82f791-7389-40cb-b4da-2cd9fcadf51d tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.173332 Jul 30 21:03:57.851256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 511/951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:57.866623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:57.867372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:57.874752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.875322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.876168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:57.876686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:57.890010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:57.898787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e6b4846-c0d9-41e2-8113-495aaea3643e tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1470 microversion: 2.1 time: 0.169032 Jul 30 21:03:57.899883 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 441/952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:57.950293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:57.971591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e1c46d8-7952-4cb2-b454-8e461431256b tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.118780 Jul 30 21:03:57.971591 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 512/953] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:57 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:58.213066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.213915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.220339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.220802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.221582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.222086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.353422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:58.355809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:58.362904 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-842126bd-4664-449e-bec3-092a3708b26b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.153848 Jul 30 21:03:58.363514 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 442/954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:58.527588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f36e3c1b-9c4e-49d6-bc85-40858a68d4e7 req-fd62dec5-845b-4372-b841-72de38a779f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983acaf3-8025-4357-a90e-fa1c74ccc477", "name": "network-vif-plugged", "status": "completed", "tag": "678a3e08-5991-471a-8092-88b834148102"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:58.538646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f36e3c1b-9c4e-49d6-bc85-40858a68d4e7 req-fd62dec5-845b-4372-b841-72de38a779f9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.539094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f36e3c1b-9c4e-49d6-bc85-40858a68d4e7 req-fd62dec5-845b-4372-b841-72de38a779f9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.539927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.540987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.558642 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f36e3c1b-9c4e-49d6-bc85-40858a68d4e7 req-fd62dec5-845b-4372-b841-72de38a779f9 service nova] Creating event network-vif-plugged:678a3e08-5991-471a-8092-88b834148102 for instance 983acaf3-8025-4357-a90e-fa1c74ccc477 on nch1-master-1 Jul 30 21:03:58.561463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.562009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.562855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.563628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.565009 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f36e3c1b-9c4e-49d6-bc85-40858a68d4e7 req-fd62dec5-845b-4372-b841-72de38a779f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041212 Jul 30 21:03:58.565618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 513/955] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:03:58.591097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:03:58.601283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-345b4cde-251f-4030-b006-8cb9a6bd1b8f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5ce2eca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.653970 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-345b4cde-251f-4030-b006-8cb9a6bd1b8f tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.057148 Jul 30 21:03:58.673735 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 514/956] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:58.677285 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92ef63ec-5bda-45b1-8bae-cd1e5d2cdeff tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 204 len: 0 microversion: 2.1 time: 0.142373 Jul 30 21:03:58.678069 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 443/957] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:03:58 2022] DELETE /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:03:58.681178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.681994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.687079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.687829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.689213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.689675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.690448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.691046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.693956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.694425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.695545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.696006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.877929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:58.889253 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f72a6079-af7e-4764-89b3-cc95bbd5f62a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.214205 Jul 30 21:03:58.889858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 515/958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:58.894480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:58.894895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.896653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.902607 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92473ff4-157f-42c5-8119-5b5d6c25fdd2 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1710 microversion: 2.1 time: 0.220127 Jul 30 21:03:58.905435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.906027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.906900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.907517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.916160 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 444/959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:03:58.923802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:58.924421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:58.934766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.935642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:58.936052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:58.936502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.094962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:59.103855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:59.105312 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-287d6a16-4141-478f-bb4f-6d37e011ba2a tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.214147 Jul 30 21:03:59.106218 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 516/960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:59.111872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:59.112644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:59.119199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.119868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.120706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.121257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.127098 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29e8355e-a941-45f0-b99d-27a66b760f9c tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1470 microversion: 2.1 time: 0.210056 Jul 30 21:03:59.127806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 445/961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:58 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:59.194232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:03:59.214579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9af0ca26-6abd-4764-9f54-fe35add9ec2f tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.106401 Jul 30 21:03:59.219646 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 517/962] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:03:59 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:03:59.384641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:59.385451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:59.392648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.393227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.394122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.394688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.585004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:03:59.592599 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd92ff9b-016e-4d89-a8f6-673ba2948fa1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1308 microversion: 2.1 time: 0.211997 Jul 30 21:03:59.593358 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 446/963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:59 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:59.668817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19d05dea-d916-4261-8666-659c767cd712 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cee9430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:59.741635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7a64ac64-b2bd-4f36-b6bd-65ce70803e42 req-9b5a0cd5-290e-45a6-b794-039f190ccd00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f650875c-acea-4ada-bf93-9e8f03540c5a", "name": "network-vif-deleted", "tag": "d8a45442-0149-496e-90cb-ce280ddcbcec"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:03:59.743339 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19d05dea-d916-4261-8666-659c767cd712 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.078275 Jul 30 21:03:59.744345 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 518/964] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:03:59 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:03:59.753348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7a64ac64-b2bd-4f36-b6bd-65ce70803e42 req-9b5a0cd5-290e-45a6-b794-039f190ccd00 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.754163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7a64ac64-b2bd-4f36-b6bd-65ce70803e42 req-9b5a0cd5-290e-45a6-b794-039f190ccd00 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.767670 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7a64ac64-b2bd-4f36-b6bd-65ce70803e42 req-9b5a0cd5-290e-45a6-b794-039f190ccd00 service nova] Creating event network-vif-deleted:d8a45442-0149-496e-90cb-ce280ddcbcec for instance f650875c-acea-4ada-bf93-9e8f03540c5a on nch1-master-1 Jul 30 21:03:59.773031 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7a64ac64-b2bd-4f36-b6bd-65ce70803e42 req-9b5a0cd5-290e-45a6-b794-039f190ccd00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Jul 30 21:03:59.777648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 447/965] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:03:59.912061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:59.912810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:59.920122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.920669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.921564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.922082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.929132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:03:59.930219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:03:59.937304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.938059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:03:59.938986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:03:59.939534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.101278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:00.115697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:00.121310 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e28082c9-8232-47d1-a762-fe27f0101875 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.213240 Jul 30 21:04:00.121935 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 519/966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:59 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:00.124745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:00.135107 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f589287-cd6e-42a0-9ff7-383f2c3e534c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1710 microversion: 2.1 time: 0.210719 Jul 30 21:04:00.136903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.137848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.138659 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 448/967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:03:59 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1710 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:00.146325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.147036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.148037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.148632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.158296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.159046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.165996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.166772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.167791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.173007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.244296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.245189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.249322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lazy-loading 'fault' on Instance uuid f650875c-acea-4ada-bf93-9e8f03540c5a {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:00.324122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:00.335087 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b667c2c-3eec-4fea-a178-af9077156f2d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 200 len: 1304 microversion: 2.1 time: 0.183586 Jul 30 21:04:00.335710 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 449/968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:00.354453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.355012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.361944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.362506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.364625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.365742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.463009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:00.472760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:00.486028 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cab954c9-276a-4390-8940-966e0a364182 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.137152 Jul 30 21:04:00.486636 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 450/969] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:00.487925 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1032b5f1-a765-4b05-882c-d5048f5f8237 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.361125 Jul 30 21:04:00.501777 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 520/970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:00.580646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e7fc6e7c-3f85-42ab-a639-07e89fe2df18 req-b1c2c12b-0ced-49cd-824d-d0a2acc58a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5741921-0325-43c0-842e-3f07d2b09e74", "name": "network-vif-plugged", "status": "completed", "tag": "042ec646-e05c-4662-83fb-a34cd88e48de"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:00.591451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e7fc6e7c-3f85-42ab-a639-07e89fe2df18 req-b1c2c12b-0ced-49cd-824d-d0a2acc58a73 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.592055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e7fc6e7c-3f85-42ab-a639-07e89fe2df18 req-b1c2c12b-0ced-49cd-824d-d0a2acc58a73 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.603258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e7fc6e7c-3f85-42ab-a639-07e89fe2df18 req-b1c2c12b-0ced-49cd-824d-d0a2acc58a73 service nova] Creating event network-vif-plugged:042ec646-e05c-4662-83fb-a34cd88e48de for instance c5741921-0325-43c0-842e-3f07d2b09e74 on nch1-master-1 Jul 30 21:04:00.609260 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e7fc6e7c-3f85-42ab-a639-07e89fe2df18 req-b1c2c12b-0ced-49cd-824d-d0a2acc58a73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Jul 30 21:04:00.609910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 451/971] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:00.614418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.615576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.618654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:00.623252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.623811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.624995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.625518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.759880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4aa997a-1a40-48fd-ab8b-4dd534d90bd6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d031c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.808344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4aa997a-1a40-48fd-ab8b-4dd534d90bd6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.052634 Jul 30 21:04:00.808917 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 452/972] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:00.833294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:00.841709 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6786ba14-7187-47c3-927c-5a1f79fb551d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1487 microversion: 2.1 time: 0.231135 Jul 30 21:04:00.842279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 521/973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1487 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:00.861870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:00.862474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.869228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.869688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.870468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.870918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.935026 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d057870e-7565-43cc-9674-8c01e1254d7e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477/action" status: 202 len: 0 microversion: 2.1 time: 0.076902 Jul 30 21:04:00.938617 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 453/974] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:04:00 2022] POST /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:00.943907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:00.944550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:00.951136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.951631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:00.952414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:00.952869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.097248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:01.104891 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-696cbdc8-51af-4803-a8aa-4888ea516612 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1492 microversion: 2.1 time: 0.164858 Jul 30 21:04:01.105455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 522/975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:00 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1492 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:01.148857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.149486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.156030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.156489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.157260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.157702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.160289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.160992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.167008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.167532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.168297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.168748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.302773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:01.316236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-789c8c0b-b362-41a1-a541-07cb396bbabd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.171536 Jul 30 21:04:01.317010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 454/976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:01.355219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:01.360772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.361623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: f650875c-acea-4ada-bf93-9e8f03540c5a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.363430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d997556-de42-4635-b8f5-9dcc2207f7c4 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1710 microversion: 2.1 time: 0.207044 Jul 30 21:04:01.364008 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 523/977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:01.367792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.368265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.369285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.369728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.384527 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] HTTP exception thrown: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Request method failure captured: Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a HTTP/1.1 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxFIxZ4OOWraw6XZHLq0LMRWBYkKi_DjxVrQsLHR-Hq9UrkBf_p4zvmqnTBoJfoTCceIfMlaaeQ5pdIc4OEMGk0TNdJDRQt5mrheBlfjkJ0brkRiekrfgghBAk2BgFb5yEE9XTvZMK2_1wBYkD_KoewIjS7GgjmgwYptOsf050FD20 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:01.386170 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f71035a2ae04a76a9e82b6ccd3759cc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 794f1a4f424d4b71a23649a4d178df28 Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. Jul 30 21:04:01.388024 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f650875c-acea-4ada-bf93-9e8f03540c5a'} Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:01.389002 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. Jul 30 21:04:01.390344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:01.391580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Returning 404 to user: Instance f650875c-acea-4ada-bf93-9e8f03540c5a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:01.391580 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8643c59-cb6a-452c-b845-d2ef9714c1bb tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a" status: 404 len: 111 microversion: 2.1 time: 0.031051 Jul 30 21:04:01.391580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 455/978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/f650875c-acea-4ada-bf93-9e8f03540c5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:04:01.397137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.397654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.403855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.404258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.405075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.405530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.434912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:01.509046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.509672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.513627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad578d1c-5009-40e0-ab07-7c1dd8b8cb54 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 204 len: 0 microversion: 2.1 time: 0.120038 Jul 30 21:04:01.514385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 524/979] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:01 2022] DELETE /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:01.515670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.516124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.517262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.517474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.519988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.520735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.526604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.527080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.527903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.528358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.606892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:01.629985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f0b36d0-5685-4fa2-b572-9b8f40390e92 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.114127 Jul 30 21:04:01.630743 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 525/980] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:01.636359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.637104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:01.643444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.644133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.644922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:01.645544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:01.697490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:01.705885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69b7debb-d37e-425e-ad54-e0e6ffb15af1 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1317 microversion: 2.1 time: 0.200815 Jul 30 21:04:01.706591 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 456/981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:01.781914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:01.789636 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea8bec40-95e7-4287-99f3-ddb689bb9881 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1469 microversion: 2.1 time: 0.157812 Jul 30 21:04:01.790253 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 526/982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:01.823155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4493b42-25e3-4a4b-9372-60e9b18aaebc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cfa1c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:01.871161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4493b42-25e3-4a4b-9372-60e9b18aaebc tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.051753 Jul 30 21:04:01.874519 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 457/983] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:01 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.125828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.126477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.132664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.133135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.133918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.134377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.263274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:02.270994 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d3d1b35-a973-448b-bcd4-687d2ff48434 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 200 len: 1472 microversion: 2.1 time: 0.149176 Jul 30 21:04:02.271600 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 527/984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.292385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-52031731"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:02.294751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.301600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.302069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.302857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.303334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.338123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.338757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.346072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.346725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.347573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.348170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.496457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:02.506718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:02.511406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99214bb0-ba32-4525-a489-e6a56846ee0f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477/action" status: 202 len: 0 microversion: 2.1 time: 0.223436 Jul 30 21:04:02.512053 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 458/985] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:04:02 2022] POST /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:04:02.518484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.519200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.526541 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8eb279ac-63f1-4bc7-aa97-b4e82d2d12c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.192562 Jul 30 21:04:02.531644 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 528/986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:02.531830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.531830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.531830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.532081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.535057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a35b025a-7ec2-4cf6-a2fe-9830d5a35588 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cf43b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.583011 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a35b025a-7ec2-4cf6-a2fe-9830d5a35588 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1410 microversion: 2.1 time: 0.054471 Jul 30 21:04:02.583858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 529/987] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.624681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-51781adf-4dba-4f8e-89c7-c41f075592fb req-09099d92-5f3e-4ab6-a12b-7b6f382e0a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-plugged", "status": "completed", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:02.634844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-51781adf-4dba-4f8e-89c7-c41f075592fb req-09099d92-5f3e-4ab6-a12b-7b6f382e0a24 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.635321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-51781adf-4dba-4f8e-89c7-c41f075592fb req-09099d92-5f3e-4ab6-a12b-7b6f382e0a24 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.647738 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-51781adf-4dba-4f8e-89c7-c41f075592fb req-09099d92-5f3e-4ab6-a12b-7b6f382e0a24 service nova] Creating event network-vif-plugged:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:04:02.653165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-51781adf-4dba-4f8e-89c7-c41f075592fb req-09099d92-5f3e-4ab6-a12b-7b6f382e0a24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Jul 30 21:04:02.654194 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 530/988] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:02.660348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.661055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.667688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.668156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.668975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.669422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.685408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:02.695022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29e9c4d9-e849-453b-9aa7-d53fe6dfb539 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1710 microversion: 2.1 time: 0.180521 Jul 30 21:04:02.696074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 459/989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.726811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.727499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.733532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.733993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.734775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.735226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.749478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:02.766764 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fdbd1eb7-d370-41dc-b8f2-15c2a9432405 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.110967 Jul 30 21:04:02.767383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 531/990] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:02.811818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.812436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:02.818577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.819039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.819840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:02.820288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:02.874263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:02.882643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-259d4e96-b6f0-47b8-bf1c-9d36db44d464 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1508 microversion: 2.1 time: 0.159885 Jul 30 21:04:02.883223 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 460/991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.888593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed3693f5-2728-41bb-bf1a-668996e6b75e tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5d0afdc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:02.932649 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed3693f5-2728-41bb-bf1a-668996e6b75e tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.048359 Jul 30 21:04:02.940679 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 461/992] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:02.954004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:02.961582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f9bfb389-d4a5-4444-8ea5-7516e427f382 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1469 microversion: 2.1 time: 0.154275 Jul 30 21:04:02.962155 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 532/993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:02 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:03.561249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:03.562303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:03.573710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.574368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.575757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.576493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.597992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb0274fc-a5b0-4e54-8e14-6711525eae27 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ce42af0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:03.662448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb0274fc-a5b0-4e54-8e14-6711525eae27 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1410 microversion: 2.1 time: 0.068352 Jul 30 21:04:03.663467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 533/994] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:03 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:03.715360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d6f83e53-8d26-460f-b0ff-04350af40184 req-cc33f293-6854-41df-be9e-4578259171bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "name": "network-vif-unplugged", "status": "completed", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:03.732681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6f83e53-8d26-460f-b0ff-04350af40184 req-cc33f293-6854-41df-be9e-4578259171bc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.733238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6f83e53-8d26-460f-b0ff-04350af40184 req-cc33f293-6854-41df-be9e-4578259171bc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.750333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d6f83e53-8d26-460f-b0ff-04350af40184 req-cc33f293-6854-41df-be9e-4578259171bc service nova] Creating event network-vif-unplugged:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch1-master-1 Jul 30 21:04:03.756685 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d6f83e53-8d26-460f-b0ff-04350af40184 req-cc33f293-6854-41df-be9e-4578259171bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047940 Jul 30 21:04:03.757501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 534/995] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:03.763616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:03.764446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:03.773040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.773699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.774505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.774959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.860087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:03.870287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed6a863a-69d1-40e6-8fa3-5bf8679f2593 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1644 microversion: 2.1 time: 0.111398 Jul 30 21:04:03.876581 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 535/996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:03 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:03.883423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:03.884675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:03.897115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.897805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:03.899187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:03.899997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.012065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:04.023123 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95d8e881-1cc4-435f-90e5-52dee0982d49 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.479028 Jul 30 21:04:04.027215 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 462/997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:03 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:04.034841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95037ff2-ac05-4f13-bcfd-fcd666fb2343 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cffed30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:04.080223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:04.123494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b782899-2d04-4a26-8300-c5f8fb66e6da tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.244705 Jul 30 21:04:04.124672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 536/998] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:03 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:04.129769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:04.130402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:04.143668 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95037ff2-ac05-4f13-bcfd-fcd666fb2343 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.115058 Jul 30 21:04:04.146445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 463/999] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:04 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:04.151090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.151801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.152836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.153688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.164179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:04.271885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:04.274481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:04.281673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.282292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.283245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.283947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.387138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] HTTP exception thrown: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Request method failure captured: Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74/os-volume_attachments/fc2b10f4-6ef4-4835-b005-3c846aaa8a04 HTTP/1.1 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 74 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxkZoZXtFWU2lThbkMEQ7JbRvYGvgKK6cK_vMGcMwLYLSlncBym9b0k8x_Q-MzwgIgu6_FA_ZekvhjvZy4IFzf3DLBtEoGvdyHObvxh0-BHyE127zoFAnxi3uvmMLe4JO6qN49q_uZogzbyRPXwh9tfJ4mcKZRoFwkijUl31nlwquk Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6ed49ee4eca649a4a75640c7a5b12026 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:04:04.392242 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ed49ee4eca649a4a75640c7a5b12026", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ed49ee4eca649a4a75640c7a5b12026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6ed49ee4eca649a4a75640c7a5b12026 Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-740510895 Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesAdminNegativeTest-740510895-project-admin Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e486b81cb41f4535bbe9e89ebffdaa04 Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesAdminNegativeTest-740510895-project-admin Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: {"volumeAttachment": {"volumeId": "0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758"}} Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:04.393886 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': 'c5741921-0325-43c0-842e-3f07d2b09e74', 'id': 'fc2b10f4-6ef4-4835-b005-3c846aaa8a04', 'body': {'volumeAttachment': {'volumeId': '0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758'}}} Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:04:04.394862 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. (HTTP 404) (Request-ID: req-971ecc75-d8ea-4075-854d-e8a6ba60aae2) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:04:04.396157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:04.397515 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. Jul 30 21:04:04.398890 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:04.404434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] Returning 404 to user: Volume fc2b10f4-6ef4-4835-b005-3c846aaa8a04 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:04.404434 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd4d6d2d-c4d7-4561-9d11-86718fd2d6d8 tempest-VolumesAdminNegativeTest-740510895 tempest-VolumesAdminNegativeTest-740510895-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74/os-volume_attachments/fc2b10f4-6ef4-4835-b005-3c846aaa8a04" status: 404 len: 109 microversion: 2.1 time: 0.134763 Jul 30 21:04:04.404669 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 464/1000] 10.222.0.17 () {60 vars in 1433 bytes} [Sat Jul 30 21:04:04 2022] PUT /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74/os-volume_attachments/fc2b10f4-6ef4-4835-b005-3c846aaa8a04 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:04:04.682987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-801f5efe-85d6-4573-8306-4d2d363b1670 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cffeb80>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:04.736999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:04.753755 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37b1ac31-4fbd-4e7d-a8e0-8b969f9d1388 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1469 microversion: 2.1 time: 0.626242 Jul 30 21:04:04.756516 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 537/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:04 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1469 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:04.814508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ebc6f4ce-cdda-401a-91fd-f4eb890df074 req-54fb102e-0511-4090-ba90-0baa69faba04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731ab961-17d8-4aef-af45-09a3d1d326fa", "name": "network-vif-deleted", "tag": "d5641255-3be0-4f7e-a59c-045b58146116"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:04.841282 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-801f5efe-85d6-4573-8306-4d2d363b1670 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1410 microversion: 2.1 time: 0.167304 Jul 30 21:04:04.842593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 465/1002] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:04 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1410 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:04.852233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ebc6f4ce-cdda-401a-91fd-f4eb890df074 req-54fb102e-0511-4090-ba90-0baa69faba04 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.852665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ebc6f4ce-cdda-401a-91fd-f4eb890df074 req-54fb102e-0511-4090-ba90-0baa69faba04 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.879869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:04.880624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:04.893582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.894058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.894869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.895364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.908777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ebc6f4ce-cdda-401a-91fd-f4eb890df074 req-54fb102e-0511-4090-ba90-0baa69faba04 service nova] Creating event network-vif-deleted:d5641255-3be0-4f7e-a59c-045b58146116 for instance 731ab961-17d8-4aef-af45-09a3d1d326fa on nch2-master-1 Jul 30 21:04:04.927249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ebc6f4ce-cdda-401a-91fd-f4eb890df074 req-54fb102e-0511-4090-ba90-0baa69faba04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118205 Jul 30 21:04:04.929864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 538/1003] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:04.953405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:04.959072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:04.987518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.989548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:04.992816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:04.996419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:05.174702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:05.281965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:05.334418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b76f31e8-4114-43fb-9c2b-86ab8ea417f6 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 2423 microversion: 2.25 time: 0.459958 Jul 30 21:04:05.351001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 466/1004] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:04 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 2423 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:05.354596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:05.357433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:05.392362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:05.393153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:05.394174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:05.394898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:05.726002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:05.739771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79548d32-e7e3-4e85-bd7c-d339a3a3d190 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.389107 Jul 30 21:04:05.740359 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 467/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:05 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:05.758585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:05.759221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:05.785729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:05.792914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:05.797834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:05.798512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:05.906730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:05.930044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b00cf8b2-3e39-4482-9648-348d0ce6afb7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.188426 Jul 30 21:04:05.931234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 468/1006] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:05 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:05.936705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61b29f24-b1cc-4229-9e90-4210382a9eec tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cfb1940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:06.112048 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61b29f24-b1cc-4229-9e90-4210382a9eec tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1429 microversion: 2.1 time: 0.178952 Jul 30 21:04:06.112672 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 469/1007] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:05 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1429 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:06.126423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:06.129355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:06.150498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.151846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.155447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.156116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.175382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a05aa5d80844848bf57f6ca093e582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d2ad29eb484886bae680d1d1a82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:06.188062 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb483c45-dabc-447a-93dc-25cb2fa7a689 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 200 len: 1347 microversion: 2.1 time: 1.255569 Jul 30 21:04:06.203807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 539/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:04 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 1347 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:06.211039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:06.229870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:06.261277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.261756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.262628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.270261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.285633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'flavor' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:06.350976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Going to try to live migrate instance to nch1-master-1 {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:04:06.391411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:06.664055 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e3a57cfb-230b-489b-9114-15e35c3c1f71 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 204 len: 0 microversion: 2.1 time: 0.458715 Jul 30 21:04:06.676301 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 540/1009] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:06 2022] DELETE /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:06.687656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-61a1d095-6652-433d-8e61-7f487de01864 req-a336605d-27dd-48e2-8c45-2b62f640d0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:06.727549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-61a1d095-6652-433d-8e61-7f487de01864 req-a336605d-27dd-48e2-8c45-2b62f640d0f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.732456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-61a1d095-6652-433d-8e61-7f487de01864 req-a336605d-27dd-48e2-8c45-2b62f640d0f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.776340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-61a1d095-6652-433d-8e61-7f487de01864 req-a336605d-27dd-48e2-8c45-2b62f640d0f8 service nova] Creating event network-changed:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch1-master-1 Jul 30 21:04:06.784882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-61a1d095-6652-433d-8e61-7f487de01864 req-a336605d-27dd-48e2-8c45-2b62f640d0f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103032 Jul 30 21:04:06.787726 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 541/1010] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:06.794932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:06.798517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:06.811836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.813148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.815407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.816799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.864743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:06.865649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:06.866608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lazy-loading 'fault' on Instance uuid a93785e3-3220-43c5-9b10-a2283a0d475c {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:07.018234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:07.026936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33968246-87f5-442c-888c-35002428363b tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 200 len: 1303 microversion: 2.1 time: 0.237286 Jul 30 21:04:07.030082 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 542/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:06 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:07.049528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd0008e8-66cf-48fa-b193-c14048099fdc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ce2d310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:09.267474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/action" status: 202 len: 0 microversion: 2.25 time: 3.151720 Jul 30 21:04:09.268921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 470/1012] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:04:06 2022] POST /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/action => generated 0 bytes in 3154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:09.274327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:09.275201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:09.321644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:09.323996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:09.330434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:09.336823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:09.860779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:09.874584 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55bf2fe1-90de-457f-842d-15f768f8dede tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 200 len: 1472 microversion: 2.1 time: 0.604343 Jul 30 21:04:09.883561 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 471/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:09 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 1472 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:09.889284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:09.900786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:09.908080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:09.909788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:09.916419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:09.917092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:10.150877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:10.160822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dea5d277-fbcb-41f6-91a2-aa04300bc9cd tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1717 microversion: 2.1 time: 0.275808 Jul 30 21:04:10.187818 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 472/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:09 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1717 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:10.220238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:10.222384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:10.309774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:10.313765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:10.333101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:10.333938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:10.510859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:10.544355 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0053762-0e6c-46b8-a7ac-e81ff776caa7 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.352166 Jul 30 21:04:10.556170 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 473/1015] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:10 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:10.565467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d9226cf2-2e2c-4a0a-9823-659aa7e70504 req-858a99a2-7743-4292-acfc-44d96d27921b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93785e3-3220-43c5-9b10-a2283a0d475c", "name": "network-vif-deleted", "tag": "5977521f-81ef-4036-bcbc-0f538bede8d3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:10.586129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d9226cf2-2e2c-4a0a-9823-659aa7e70504 req-858a99a2-7743-4292-acfc-44d96d27921b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:10.586693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d9226cf2-2e2c-4a0a-9823-659aa7e70504 req-858a99a2-7743-4292-acfc-44d96d27921b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:10.623993 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d9226cf2-2e2c-4a0a-9823-659aa7e70504 req-858a99a2-7743-4292-acfc-44d96d27921b service nova] Creating event network-vif-deleted:5977521f-81ef-4036-bcbc-0f538bede8d3 for instance a93785e3-3220-43c5-9b10-a2283a0d475c on nch2-master-1 Jul 30 21:04:10.629839 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d9226cf2-2e2c-4a0a-9823-659aa7e70504 req-858a99a2-7743-4292-acfc-44d96d27921b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072385 Jul 30 21:04:10.630753 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 474/1016] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:10.639041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ab1f11e1-6900-4c90-aea0-b29ca33066de tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf27dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:16.864407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:17.026614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:18.447270 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd0008e8-66cf-48fa-b193-c14048099fdc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1410 microversion: 2.1 time: 11.415914 Jul 30 21:04:18.448265 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 543/1017] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:07 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1410 bytes in 11417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:18.456809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.458027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.469530 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ab1f11e1-6900-4c90-aea0-b29ca33066de tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1438 microversion: 2.1 time: 7.837316 Jul 30 21:04:18.471086 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 475/1018] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:10 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1438 bytes in 7839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:18.480141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.482370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.482867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.483768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.484984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: a93785e3-3220-43c5-9b10-a2283a0d475c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.485259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.498062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.498802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.502552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.504154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.509041 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa HTTP/1.1 Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:04:18.511018 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:18.512738 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '731ab961-17d8-4aef-af45-09a3d1d326fa'} Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:18.513768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:18.515443 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.518301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:18.519803 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b45f226-0873-4b66-988f-bd3da53e52f8 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 404 len: 111 microversion: 2.1 time: 0.067016 Jul 30 21:04:18.523997 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 544/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:18.530021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.530872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.531694 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] HTTP exception thrown: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Request method failure captured: Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c HTTP/1.1 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxFIxZ4OOWraw6XZHLq0LMRWBYkKi_DjxVrQsLHR-Hq9UrkBf_p4zvmqnTBoJfoTCceIfMlaaeQ5pdIc4OEMGk0TNdJDRQt5mrheBlfjkJ0brkRiekrfgghBAk2BgFb5yEE9XTvZMK2_1wBYkD_KoewIjS7GgjmgwYptOsf050FD20 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:18.534362 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f71035a2ae04a76a9e82b6ccd3759cc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 794f1a4f424d4b71a23649a4d178df28 Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. Jul 30 21:04:18.536020 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a93785e3-3220-43c5-9b10-a2283a0d475c'} Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:18.536910 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. Jul 30 21:04:18.538455 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.539881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.539881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.539881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.539881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.540576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Returning 404 to user: Instance a93785e3-3220-43c5-9b10-a2283a0d475c could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:18.541437 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67e4dd82-e7f3-43ec-bb80-520187c373f3 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c" status: 404 len: 111 microversion: 2.1 time: 0.069343 Jul 30 21:04:18.542289 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 476/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/a93785e3-3220-43c5-9b10-a2283a0d475c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:18.551889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0ec4dd31-0351-4851-b587-e7e06de96d7f req-1b73be5b-3432-4503-bdeb-79e526b99c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5741921-0325-43c0-842e-3f07d2b09e74", "name": "network-vif-deleted", "tag": "042ec646-e05c-4662-83fb-a34cd88e48de"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:18.570076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0ec4dd31-0351-4851-b587-e7e06de96d7f req-1b73be5b-3432-4503-bdeb-79e526b99c59 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.571101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0ec4dd31-0351-4851-b587-e7e06de96d7f req-1b73be5b-3432-4503-bdeb-79e526b99c59 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.589258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0ec4dd31-0351-4851-b587-e7e06de96d7f req-1b73be5b-3432-4503-bdeb-79e526b99c59 service nova] Creating event network-vif-deleted:042ec646-e05c-4662-83fb-a34cd88e48de for instance c5741921-0325-43c0-842e-3f07d2b09e74 on nch1-master-1 Jul 30 21:04:18.595796 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0ec4dd31-0351-4851-b587-e7e06de96d7f req-1b73be5b-3432-4503-bdeb-79e526b99c59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052071 Jul 30 21:04:18.596835 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 477/1021] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:18.607874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4ae645a0-0af8-4a94-9f4b-336a778a74d3 req-9655b23d-e878-4823-97fd-55d5946c86bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983acaf3-8025-4357-a90e-fa1c74ccc477", "name": "network-vif-plugged", "status": "completed", "tag": "678a3e08-5991-471a-8092-88b834148102"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:18.616455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:18.625670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4ae645a0-0af8-4a94-9f4b-336a778a74d3 req-9655b23d-e878-4823-97fd-55d5946c86bf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.626428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4ae645a0-0af8-4a94-9f4b-336a778a74d3 req-9655b23d-e878-4823-97fd-55d5946c86bf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.640402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4ae645a0-0af8-4a94-9f4b-336a778a74d3 req-9655b23d-e878-4823-97fd-55d5946c86bf service nova] Creating event network-vif-plugged:678a3e08-5991-471a-8092-88b834148102 for instance 983acaf3-8025-4357-a90e-fa1c74ccc477 on nch1-master-1 Jul 30 21:04:18.646381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4ae645a0-0af8-4a94-9f4b-336a778a74d3 req-9655b23d-e878-4823-97fd-55d5946c86bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047750 Jul 30 21:04:18.648102 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 478/1022] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:18.655608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.656622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: c5741921-0325-43c0-842e-3f07d2b09e74] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.664197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.664910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.665948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.666568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.688495 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] HTTP exception thrown: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Request method failure captured: Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 HTTP/1.1 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxXMarROYeuS0GyHqn_VUh0oq5UmzPTsSDEx5S6NA1yHb6Ar65wr_AoDeXWnH1ncUFz-UJsPuEB-15Gor-otR4PY-GP7Wpry9zj5WnEjMrj9P7-pF0Wlb0e0PfZcZYl4pkikbVDKGSDSI3IyrPvlpSAhkcbsmbxtj-ICLKhIgnVP6M Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cfc4b787c95143c0b9d6f53832e324f1 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:18.690172 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc4b787c95143c0b9d6f53832e324f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cfc4b787c95143c0b9d6f53832e324f1 Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesAdminNegativeTest-632897816-project Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f8b35ab211584884a72057fa31184836 Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesAdminNegativeTest-632897816-project Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. Jul 30 21:04:18.691712 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c5741921-0325-43c0-842e-3f07d2b09e74'} Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:18.692588 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. Jul 30 21:04:18.694054 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:18.695420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Returning 404 to user: Instance c5741921-0325-43c0-842e-3f07d2b09e74 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:18.695420 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c1e338fc-9cfc-4526-9521-2b7372f60027 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74" status: 404 len: 111 microversion: 2.1 time: 0.042172 Jul 30 21:04:18.695420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 479/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/c5741921-0325-43c0-842e-3f07d2b09e74 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:18.708725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.709360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.717698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.718832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.720457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.721143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.760932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:18.779402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:18.781382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:18.782901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f66e7c5d-14e2-4422-a07d-c96f37849509 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.257714 Jul 30 21:04:18.785290 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 545/1024] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:18.793336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:18.797404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:18.837275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.837840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.845001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:18.845901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:18.970231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:18.976781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:18.981711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5450f45f-e339-49f6-a2cb-287d6296224c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1707 microversion: 2.1 time: 0.288023 Jul 30 21:04:18.983557 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 480/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1707 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:18.989779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b15e8740-a020-42ef-9b7a-28bf2749788c req-6d9e0c39-5f5b-40a7-acb4-eab0420e8e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "name": "network-vif-unplugged", "status": "completed", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:19.002298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b15e8740-a020-42ef-9b7a-28bf2749788c req-6d9e0c39-5f5b-40a7-acb4-eab0420e8e0b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.002837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b15e8740-a020-42ef-9b7a-28bf2749788c req-6d9e0c39-5f5b-40a7-acb4-eab0420e8e0b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.005987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:19.018447 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b15e8740-a020-42ef-9b7a-28bf2749788c req-6d9e0c39-5f5b-40a7-acb4-eab0420e8e0b service nova] Creating event network-vif-unplugged:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch2-master-1 Jul 30 21:04:19.024124 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b15e8740-a020-42ef-9b7a-28bf2749788c req-6d9e0c39-5f5b-40a7-acb4-eab0420e8e0b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038759 Jul 30 21:04:19.024865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 481/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:19.025092 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d1b447b-8ff8-4d70-a8e8-b81e201de869 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1929 microversion: 2.75 time: 0.238064 Jul 30 21:04:19.035507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 546/1027] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:18 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1929 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:19.040280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.040810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.045377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90bbefcc-cd34-4a49-8e35-7c52e5ffd6ae tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf15550>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.051652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.052363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.056351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.057153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.075567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 HTTP/1.1 Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:04:19.077065 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.078670 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e64c39d9-ba7b-4de4-b129-e17f43a0cb67'} Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:19.079638 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.081243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.082727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:19.082727 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c230c65-c0b6-4bbb-93e9-0c8de6636de5 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 404 len: 111 microversion: 2.1 time: 0.051439 Jul 30 21:04:19.082727 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 547/1028] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:19 2022] DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:19.084246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.084772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.092795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.093508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.094488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.095096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.101916 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90bbefcc-cd34-4a49-8e35-7c52e5ffd6ae tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 200 len: 1438 microversion: 2.1 time: 0.065044 Jul 30 21:04:19.102715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 482/1029] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.107474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c509b764-847a-4848-984c-01a25a3f89e4 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '.version_select at 0x7fbb5d090dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.112101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c509b764-847a-4848-984c-01a25a3f89e4 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.112825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c509b764-847a-4848-984c-01a25a3f89e4 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.125883 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c509b764-847a-4848-984c-01a25a3f89e4 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.021900 Jul 30 21:04:19.128186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:19.131477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 483/1030] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.138667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.139899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.146702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.147177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.148096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.148557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.165078 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 HTTP/1.1 Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:19.166757 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.168297 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e64c39d9-ba7b-4de4-b129-e17f43a0cb67'} Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:19.169184 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:19.170968 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:19.172295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:19.172295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9209563f-53be-4713-b620-897f78d4cf3f tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 404 len: 111 microversion: 2.1 time: 0.035376 Jul 30 21:04:19.172295 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 484/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:19.173597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.174010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.180893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.181422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.182385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.182902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.227190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-78ae3406-b7c4-4e3f-8bc8-a1f4e9361128 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 204 len: 0 microversion: 2.1 time: 0.146610 Jul 30 21:04:19.231505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 548/1032] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:19 2022] DELETE /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:19.237952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.238684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.245847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.246839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.247669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.248123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.340491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:19.348923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5f1abc0-7810-4613-9ddb-e47c4c0f2735 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1480 microversion: 2.1 time: 0.179055 Jul 30 21:04:19.362913 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 485/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1480 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.367960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c4b7195-377b-4fd4-9845-53106544a471 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '.version_select at 0x7fbb5cf84e50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.393521 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c4b7195-377b-4fd4-9845-53106544a471 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101770249" status: 202 len: 0 microversion: 2.1 time: 0.029353 Jul 30 21:04:19.395619 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 486/1034] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101770249 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:19.397485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4caac6a-f36b-4192-95df-de3f6270b131 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1858 microversion: 2.1 time: 0.164125 Jul 30 21:04:19.403352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 549/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1858 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.403520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.403520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.409775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.410244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.411044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.411598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.421379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.422421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.430925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.431433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.432773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.433229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.578583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7500e805-b86d-4f1f-b57e-ac0b111b1100 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1858 microversion: 2.1 time: 0.161972 Jul 30 21:04:19.579450 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 550/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1858 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:19.585715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e46be13a-15b7-4e5f-8e3f-850ac51162ae tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cdeb670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.642374 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e46be13a-15b7-4e5f-8e3f-850ac51162ae tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1419 microversion: 2.1 time: 0.061781 Jul 30 21:04:19.643561 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 551/1037] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1419 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.647172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:19.659173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7dfd5075-40ae-4617-bb00-1f39ab85103b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ce2daf0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.667895 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fbf6fd91-b124-4ac6-bf38-c1c72b9a3d94 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1470 microversion: 2.1 time: 0.270835 Jul 30 21:04:19.668837 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 487/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.674202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.675048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.683821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.684648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.686111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.686724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.734703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7dfd5075-40ae-4617-bb00-1f39ab85103b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 200 len: 1419 microversion: 2.1 time: 0.079426 Jul 30 21:04:19.735596 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 552/1039] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 1419 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:19.755648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e120a5fb-3b5c-4851-91b6-9ee81bb29423 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cdeb040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.802752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lazy-loading 'services' on Instance uuid 9f1f5803-c208-4680-a8cd-11e41ddd0935 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:19.885714 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bdf6679e-d926-48ff-886d-93107f232e44 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments/86ac0138-c1aa-493c-88f1-f53c793d7a32" status: 202 len: 0 microversion: 2.1 time: 0.215475 Jul 30 21:04:19.886819 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 488/1040] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:04:19 2022] DELETE /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments/86ac0138-c1aa-493c-88f1-f53c793d7a32 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:19.893090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:19.893895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:19.929888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.930619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:19.932038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:19.932491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.134135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.152053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.154123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.155763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e8ee42f-0ce0-46e5-897e-b0d6d712ab74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.266902 Jul 30 21:04:20.156937 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 489/1041] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:19 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:20.162057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.164524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.172543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.173013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.174088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.174611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.208901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30dd14a7-17a7-4b71-a843-f8dfc9be3822 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050376 Jul 30 21:04:20.214586 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 490/1042] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:20.220801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.221319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.227951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.228417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.229400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.229965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.264178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:20.322058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e120a5fb-3b5c-4851-91b6-9ee81bb29423 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 204 len: 0 microversion: 2.1 time: 0.573394 Jul 30 21:04:20.322639 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 553/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:19 2022] DELETE /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:20.328886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.329522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.336163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.336572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.337369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.337825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.359074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d7d5835-07d1-4e2a-9f88-0aafa0ad3447 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 204 len: 0 microversion: 2.1 time: 0.142564 Jul 30 21:04:20.360013 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 491/1044] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:20 2022] DELETE /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:20.365421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0909fdc9-c301-4daa-90a5-982fc51e452f tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.366251 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:20.366251 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:04:20.384061 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0909fdc9-c301-4daa-90a5-982fc51e452f tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1053981702" status: 202 len: 0 microversion: 2.1 time: 0.022963 Jul 30 21:04:20.384834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 492/1045] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:04:20 2022] DELETE /compute/v2.1/flavors/1053981702 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:20.392212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.392988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.399168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.399672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.400473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.400932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.413606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:20.428650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:20.431318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e85f391c-dea2-48ba-bb40-018c00c27eb3 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1935 microversion: 2.75 time: 0.106196 Jul 30 21:04:20.432203 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 554/1046] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1935 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:20.437748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.438452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.444550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.445090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.446106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.446828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.506919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1b93a9f-5212-4214-8084-7659c66ccb86 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 204 len: 0 microversion: 2.1 time: 0.118293 Jul 30 21:04:20.507556 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 493/1047] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:20 2022] DELETE /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:20.513605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.514463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.520824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.521360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.522203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.522721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.613055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.622674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f057c0e-ef10-41e4-8689-dce9e73d8ad8 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1680 microversion: 2.1 time: 0.189075 Jul 30 21:04:20.623469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 555/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:20.641057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cafab0fd-9c1e-477f-afe1-560fe2c00c8d tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.666223 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cafab0fd-9c1e-477f-afe1-560fe2c00c8d tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.041247 Jul 30 21:04:20.666973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 556/1049] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:20.672164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1877920942", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "0ad1dccc-1f18-4d8d-a178-5d43d230baa8"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:20.675355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.684860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-583491a9-110c-47ff-a99f-a516578556f6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1467 microversion: 2.1 time: 0.176141 Jul 30 21:04:20.685433 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 494/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1467 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:20.691263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c252124b-2601-406e-9821-6e9b94d809bc tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.692484 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:20.692484 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:04:20.712536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c252124b-2601-406e-9821-6e9b94d809bc tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/246069507" status: 202 len: 0 microversion: 2.1 time: 0.025977 Jul 30 21:04:20.713119 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 495/1051] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:04:20 2022] DELETE /compute/v2.1/flavors/246069507 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:20.718821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:20.719473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:20.725647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.725943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] validate_networks() for [('0ad1dccc-1f18-4d8d-a178-5d43d230baa8', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:04:20.726128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.726891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:20.727356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:20.858436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:20.866201 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2af469e-0503-4bb7-b1b4-76b57e804a29 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1470 microversion: 2.1 time: 0.151590 Jul 30 21:04:20.866864 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 496/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:20 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:20.872574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4619d13-4c4c-49f0-abd6-339621c0a752 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf15310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.108626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:04:21.109212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:04:21.109709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:04:21.110138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:04:21.110569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:04:21.120178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.120648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.121475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.121970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.140298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:04:21.144511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for user 8379e04d2b30488387b3eefab6669768 and project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:04:21.157824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:04:21.160918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:04:21.220709 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-973be931-ec02-4c50-8848-267569fc01f4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552491 Jul 30 21:04:21.221647 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 557/1053] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:04:21.226043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e725c32c-23be-4ffb-934e-79ca2299584e tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.248353 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e725c32c-23be-4ffb-934e-79ca2299584e tempest-ServersWithSpecificFlavorTestJSON-150487790 tempest-ServersWithSpecificFlavorTestJSON-150487790-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025569 Jul 30 21:04:21.250581 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 558/1054] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:21.256541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-942a8539-dcf9-49fb-b800-1efe1513364f req-f85ba893-9f1a-4f06-a841-58ec9194a0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:21.267198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-942a8539-dcf9-49fb-b800-1efe1513364f req-f85ba893-9f1a-4f06-a841-58ec9194a0f1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.267896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-942a8539-dcf9-49fb-b800-1efe1513364f req-f85ba893-9f1a-4f06-a841-58ec9194a0f1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.280688 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-942a8539-dcf9-49fb-b800-1efe1513364f req-f85ba893-9f1a-4f06-a841-58ec9194a0f1 service nova] Creating event network-changed:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch2-master-1 Jul 30 21:04:21.286028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-942a8539-dcf9-49fb-b800-1efe1513364f req-f85ba893-9f1a-4f06-a841-58ec9194a0f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033952 Jul 30 21:04:21.286625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 559/1055] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:21.293244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.294083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.302880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.303365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.304169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.304615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.338946 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4619d13-4c4c-49f0-abd6-339621c0a752 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "DELETE /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e" status: 204 len: 0 microversion: 2.1 time: 0.470226 Jul 30 21:04:21.339712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 497/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:20 2022] DELETE /compute/v2.1/images/99a708f0-9601-464f-9323-1943dd53390e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:21.351456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.354943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.361524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.362150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.363392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.363862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.396985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6bd8b203-b5ff-4c4a-b548-aa3ca82e0031 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056278 Jul 30 21:04:21.397887 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 498/1057] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:21.402833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7baa29b-d8e1-4892-abab-a0e10221aca7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.403366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7baa29b-d8e1-4892-abab-a0e10221aca7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.465920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f7baa29b-d8e1-4892-abab-a0e10221aca7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:21.473265 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7baa29b-d8e1-4892-abab-a0e10221aca7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1208 microversion: 2.1 time: 0.074548 Jul 30 21:04:21.473866 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 499/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1208 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:21.478551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.479061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.486913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.487482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.488310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.488769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.504117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa HTTP/1.1 Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:21.505835 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.507376 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '731ab961-17d8-4aef-af45-09a3d1d326fa'} Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:21.508145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.509340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.513766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:21.513766 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-caa0533d-40d9-45cd-9cab-1d5b57f05c72 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 404 len: 111 microversion: 2.1 time: 0.032383 Jul 30 21:04:21.513766 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 500/1059] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:21 2022] DELETE /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:21.515443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afee9a22-e181-4c05-a26e-6063caff55d6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '.version_select at 0x7fbb5cf2fee0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.578805 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-afee9a22-e181-4c05-a26e-6063caff55d6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] HTTP exception thrown: Image not found. Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afee9a22-e181-4c05-a26e-6063caff55d6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Request method failure captured: Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 HTTP/1.1 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyUN4R_vJFUPI6BJ-yC_8CSJxScomtKnkP1dIfcq9TnBWHbambHFopFDUYXAprzvMQVicu2RHIPzpJ6jpS8uo_Zzi3yzkeHNi19wmBFX6f4o4Y-3m7q-AXoCrX20JtK87EfndYpLz2eY88Xk05lDhgTD68spHm-MoICpWvsmPn5ylo Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:21.580884 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/12e516b713ea41b5a6586035cc755589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_12e516b713ea41b5a6586035cc755589", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 73d81ad63c23451f9d9235f1faba50d1 Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '46007d10-9652-4f9a-863c-fe80d1422759'} Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:21.582256 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 46007d10-9652-4f9a-863c-fe80d1422759 to delete Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.583146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46007d10-9652-4f9a-863c-fe80d1422759 could not be found. Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:21.584388 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:04:21.585586 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.588368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afee9a22-e181-4c05-a26e-6063caff55d6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:21.589490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-afee9a22-e181-4c05-a26e-6063caff55d6 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "DELETE /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759" status: 404 len: 62 microversion: 2.1 time: 0.080251 Jul 30 21:04:21.590696 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 501/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:21 2022] DELETE /compute/v2.1/images/46007d10-9652-4f9a-863c-fe80d1422759 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:04:21.596487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.597418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.605608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.606896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.608735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.609571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.711419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:21.739015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-745f5b98-43ee-4c6f-ae40-242e921e66e0 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1935 microversion: 2.75 time: 0.146294 Jul 30 21:04:21.740108 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 502/1061] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1935 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:21.750180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.751035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: 731ab961-17d8-4aef-af45-09a3d1d326fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.764509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.765137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.766593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.767304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.790023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:21.792151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa HTTP/1.1 Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:21.794965 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.796419 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '731ab961-17d8-4aef-af45-09a3d1d326fa'} Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:21.797159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. Jul 30 21:04:21.799146 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.802012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance 731ab961-17d8-4aef-af45-09a3d1d326fa could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:21.803460 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d90258b-69ee-4cee-8902-9a5493331a8c tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa" status: 404 len: 111 microversion: 2.1 time: 0.060926 Jul 30 21:04:21.804753 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 503/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/731ab961-17d8-4aef-af45-09a3d1d326fa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:21.813606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.814441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.823761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.824546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.825570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.826023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.857519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:21.884338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:21.893070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:21.894732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:21.896072 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2df4ad46-e037-40a1-a388-ad1f892c08d5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.607698 Jul 30 21:04:21.896603 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 560/1063] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:21.901069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.901685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.907856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.908322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.909102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.909723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.946641 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a470d36-c720-4559-b2ac-ba9d5bf20567 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 204 len: 0 microversion: 2.1 time: 0.140337 Jul 30 21:04:21.947441 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 504/1064] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:21 2022] DELETE /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:21.952519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.953127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.959002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.959517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.960333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.960765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.974383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 HTTP/1.1 Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:21.976130 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:21.977737 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e64c39d9-ba7b-4de4-b129-e17f43a0cb67'} Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:21.978549 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:21.980036 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:21.982022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:21.982022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82128c94-984c-4746-b132-2ddb4c567f4d tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 404 len: 111 microversion: 2.1 time: 0.029008 Jul 30 21:04:21.982022 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 505/1065] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:04:21 2022] DELETE /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:21.986481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:21.987126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:21.994546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.995058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:21.996111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:21.997283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.150347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:22.158486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7cb5b3ac-f142-4a3b-91ea-92b9e8fd491d tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1470 microversion: 2.1 time: 0.175778 Jul 30 21:04:22.159054 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 506/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:22.164126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.164740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.171556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.172076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.172799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.173246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.178594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:22.187134 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-84df2bff-fd96-4641-a7fb-410e78659d9f tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1680 microversion: 2.1 time: 0.289420 Jul 30 21:04:22.187866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 561/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:21 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:22.205208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.206102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] [instance: e64c39d9-ba7b-4de4-b129-e17f43a0cb67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.212686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.213220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.214082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.215420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.229425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] HTTP exception thrown: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Request method failure captured: Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 HTTP/1.1 Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwxqxZ7sP9L5QKm9tnWpodoLMbZaLk_aIxWWswXRmkbyMH5Zrs8A8C1_vo5mx65IqUneFqWAs3pUIL970Oe0x1oqnhYGeclyWQeXGFpe6EzEsO3BKHsRH9159QFTWesdNWEOwWsmAujwRX6gkVLf8cOpBXT58oh79-j6S6vadfkSJI Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:04:22.231783 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8413d2ad29eb484886bae680d1d1a82b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8413d2ad29eb484886bae680d1d1a82b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8413d2ad29eb484886bae680d1d1a82b Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288 Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b2a05aa5d80844848bf57f6ca093e582 Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676756288-project Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:22.233289 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e64c39d9-ba7b-4de4-b129-e17f43a0cb67'} Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:22.234156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. Jul 30 21:04:22.235702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:04:22.236976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] Returning 404 to user: Instance e64c39d9-ba7b-4de4-b129-e17f43a0cb67 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:22.236976 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1d1cd8ed-60ca-4258-bec4-620bb79ba431 tempest-ServersWithSpecificFlavorTestJSON-676756288 tempest-ServersWithSpecificFlavorTestJSON-676756288-project] 10.222.0.17 "GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67" status: 404 len: 111 microversion: 2.1 time: 0.033832 Jul 30 21:04:22.236976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 562/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/e64c39d9-ba7b-4de4-b129-e17f43a0cb67 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:22.312609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:22.320418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de2f72e4-b037-49b1-801a-a7e5001cc271 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1473 microversion: 2.1 time: 0.160092 Jul 30 21:04:22.321002 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 507/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1473 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:22.410000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.412226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.419434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.419906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.420696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.421145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.450863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5e0d920-398b-46eb-90f8-4e1a9f270bcf tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044950 Jul 30 21:04:22.451456 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 563/1070] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:04:22.494328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.495187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.502668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.503248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.504192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.504761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.569105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:22.577677 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8851451-e430-40a3-8f2c-ec707cb1151b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1212 microversion: 2.1 time: 0.087448 Jul 30 21:04:22.582778 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 508/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:22.755738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5fd3bf3a-4319-42b9-aef2-9be01407be47 req-899fb182-c1aa-4407-83eb-74548b041c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983acaf3-8025-4357-a90e-fa1c74ccc477", "name": "network-vif-unplugged", "status": "completed", "tag": "678a3e08-5991-471a-8092-88b834148102"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:22.769476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.770510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.771184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5fd3bf3a-4319-42b9-aef2-9be01407be47 req-899fb182-c1aa-4407-83eb-74548b041c16 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.771882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5fd3bf3a-4319-42b9-aef2-9be01407be47 req-899fb182-c1aa-4407-83eb-74548b041c16 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.785081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.786333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.787255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.788641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5fd3bf3a-4319-42b9-aef2-9be01407be47 req-899fb182-c1aa-4407-83eb-74548b041c16 service nova] Creating event network-vif-unplugged:678a3e08-5991-471a-8092-88b834148102 for instance 983acaf3-8025-4357-a90e-fa1c74ccc477 on nch1-master-1 Jul 30 21:04:22.789243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.794818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5fd3bf3a-4319-42b9-aef2-9be01407be47 req-899fb182-c1aa-4407-83eb-74548b041c16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042684 Jul 30 21:04:22.795651 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 564/1072] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:22.874460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:22.892039 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6873519c-c92a-4c07-bbe2-9f2a21e50110 tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1935 microversion: 2.75 time: 0.127313 Jul 30 21:04:22.892632 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 509/1073] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1935 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:22.923112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:22.924448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:22.930815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.931278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:22.932262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:22.932708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.182736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:23.183713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:23.194754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.195615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.196835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.199014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.225538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.238018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.240473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.244496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9a5f472-b22e-49b4-bc07-86844ff439e2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.325730 Jul 30 21:04:23.247812 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 565/1074] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:22 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:23.260887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:23.262836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:23.269910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.270598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.272714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.273641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.382441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.398210 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d11fc918-33ae-4a9c-8e7b-43255dd4ad45 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1470 microversion: 2.1 time: 0.218995 Jul 30 21:04:23.403419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 510/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:23 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:23.409571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:23.410537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:23.420655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.421758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.422975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.428044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.780062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.803878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.806123 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87865a8f-2381-475e-a13d-56945732c96c tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1473 microversion: 2.1 time: 0.405399 Jul 30 21:04:23.821174 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 511/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:23 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1473 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:23.830149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:23.831782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:23.833611 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-815ccfc5-6309-4b75-8869-b41e9ee62343 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1680 microversion: 2.1 time: 0.579849 Jul 30 21:04:23.836151 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 566/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:23 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1680 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:23.853830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.854744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.855876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.856480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.922474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:23.923413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:23.939691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.941069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.941905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:23.942362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:23.948179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:23.958325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:23.970187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a4780fa-dfae-4003-9c3a-f01e3095029c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1260 microversion: 2.1 time: 0.146968 Jul 30 21:04:23.970827 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 512/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:23 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:24.273197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:24.274291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:24.289596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.290448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:24.292768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.294000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:24.393673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:24.414141 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d03f61d8-c826-4de7-8cf8-64302d7923cb tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1935 microversion: 2.75 time: 0.498982 Jul 30 21:04:24.414985 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 567/1079] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:23 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1935 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:24.423306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:24.424091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:24.435571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.436554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:24.438104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.443592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:24.716933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:24.727640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:24.733258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:24.747719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5e3a5eb-9106-4872-807f-0790dcea9046 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.467125 Jul 30 21:04:24.748765 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 513/1080] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:24 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:24.834695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:24.835525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:24.841795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:24.851952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.854791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:24.856989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:24.857848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.159246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d81ad63c23451f9d9235f1faba50d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e516b713ea41b5a6586035cc755589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:25.172641 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e316088f-c166-48f4-a7a6-3bf96cbc2f38 tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 200 len: 1473 microversion: 2.1 time: 0.343112 Jul 30 21:04:25.173257 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 514/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:24 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:25.197699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b90e7c1e-ba54-4338-b7e2-9fab8ef9186e req-357d0dee-1a0f-4c4a-994d-fd41a705b512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-unplugged", "status": "completed", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:25.225312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b90e7c1e-ba54-4338-b7e2-9fab8ef9186e req-357d0dee-1a0f-4c4a-994d-fd41a705b512 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.225772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b90e7c1e-ba54-4338-b7e2-9fab8ef9186e req-357d0dee-1a0f-4c4a-994d-fd41a705b512 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.255843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b90e7c1e-ba54-4338-b7e2-9fab8ef9186e req-357d0dee-1a0f-4c4a-994d-fd41a705b512 service nova] Creating event network-vif-unplugged:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:04:25.268550 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b90e7c1e-ba54-4338-b7e2-9fab8ef9186e req-357d0dee-1a0f-4c4a-994d-fd41a705b512 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092951 Jul 30 21:04:25.272791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 515/1082] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:25.282629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:25.283929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:25.301979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.303128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.304158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.304913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.517965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b35ab211584884a72057fa31184836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc4b787c95143c0b9d6f53832e324f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:25.532575 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9da66a93-cb16-4403-a983-5bebb0b40502 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 200 len: 1613 microversion: 2.1 time: 0.256420 Jul 30 21:04:25.536254 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 516/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:25 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 1613 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:25.553366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:25.554304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:25.585666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.587753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.590056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.597390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.826015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:25.839567 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31a32aa3-3f08-4953-a6ac-275c8155e0e7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1266 microversion: 2.1 time: 0.301747 Jul 30 21:04:25.843969 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 517/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:25 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:25.874413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:25.875895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:25.906419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.906899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:25.909762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:25.912805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.083513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] Lazy-loading 'services' on Instance uuid c677f178-cd12-4eeb-82e0-1e4c27c44f64 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:26.110785 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c26700ae-3057-4143-9acd-9c690eb59acf tempest-ServersAdmin275Test-1752610132 tempest-ServersAdmin275Test-1752610132-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1920 microversion: 2.75 time: 0.248075 Jul 30 21:04:26.112337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 518/1085] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:25 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1920 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:26.118772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6e9b2ef4-1ff9-4789-a074-caeb1fbe7896 req-bd2c4621-9d78-4811-970a-3ecdf3190274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6190a159-5485-46fe-8cf2-fd377b2f6619", "name": "network-vif-deleted", "tag": "fa632cc0-47f1-4991-9dcf-3408b373b090"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:26.149795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6e9b2ef4-1ff9-4789-a074-caeb1fbe7896 req-bd2c4621-9d78-4811-970a-3ecdf3190274 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.151901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6e9b2ef4-1ff9-4789-a074-caeb1fbe7896 req-bd2c4621-9d78-4811-970a-3ecdf3190274 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.170973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:26.181362 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-918c420f-e32a-467d-908e-a9e9fd3dced9 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1470 microversion: 2.1 time: 1.763952 Jul 30 21:04:26.187326 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6e9b2ef4-1ff9-4789-a074-caeb1fbe7896 req-bd2c4621-9d78-4811-970a-3ecdf3190274 service nova] Creating event network-vif-deleted:fa632cc0-47f1-4991-9dcf-3408b373b090 for instance 6190a159-5485-46fe-8cf2-fd377b2f6619 on nch2-master-1 Jul 30 21:04:26.198900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 568/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:24 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1470 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:26.201681 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6e9b2ef4-1ff9-4789-a074-caeb1fbe7896 req-bd2c4621-9d78-4811-970a-3ecdf3190274 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087790 Jul 30 21:04:26.208738 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 519/1087] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:26.217325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.219585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.220762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.221377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.229829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.230635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.232181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.232922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.245188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.245953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.246971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.247702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.253011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:26.280173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:04:26.426979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d742e690-918a-41c0-aa9b-dcdd8f406500 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 204 len: 0 microversion: 2.75 time: 0.215640 Jul 30 21:04:26.431351 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 520/1088] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:04:26 2022] DELETE /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:04:26.442992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.443775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] [instance: 6190a159-5485-46fe-8cf2-fd377b2f6619] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.459601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.460593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.461658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.462331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.481632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] HTTP exception thrown: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Request method failure captured: Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 HTTP/1.1 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyUN4R_vJFUPI6BJ-yC_8CSJxScomtKnkP1dIfcq9TnBWHbambHFopFDUYXAprzvMQVicu2RHIPzpJ6jpS8uo_Zzi3yzkeHNi19wmBFX6f4o4Y-3m7q-AXoCrX20JtK87EfndYpLz2eY88Xk05lDhgTD68spHm-MoICpWvsmPn5ylo Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:26.484372 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/12e516b713ea41b5a6586035cc755589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_12e516b713ea41b5a6586035cc755589", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/12e516b713ea41b5a6586035cc755589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 12e516b713ea41b5a6586035cc755589 Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1938010635 Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 73d81ad63c23451f9d9235f1faba50d1 Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerTestJSON-1938010635-project Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. Jul 30 21:04:26.485721 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6190a159-5485-46fe-8cf2-fd377b2f6619'} Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:26.486463 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. Jul 30 21:04:26.487675 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.494154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] Returning 404 to user: Instance 6190a159-5485-46fe-8cf2-fd377b2f6619 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:26.496907 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-015e9ddb-dbb3-457b-9b44-b7ebd88b7fcb tempest-ImagesOneServerTestJSON-1938010635 tempest-ImagesOneServerTestJSON-1938010635-project] 10.222.0.17 "GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619" status: 404 len: 111 microversion: 2.1 time: 0.062628 Jul 30 21:04:26.500421 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 521/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:26 2022] GET /compute/v2.1/servers/6190a159-5485-46fe-8cf2-fd377b2f6619 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:26.507023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.507805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.517569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.518036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.518889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.519321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.803253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:26.815212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:26.819108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:26.832075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9f13f011-0f60-4f0f-af13-dd858846ebec tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1444 microversion: 2.75 time: 0.332220 Jul 30 21:04:26.834580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 522/1090] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:26 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1444 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:26.851280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.854659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] [instance: 3766e564-dc7d-4328-9cf8-cd5dd04c9a41] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.867136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.867555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.868362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.869067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.934777 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] HTTP exception thrown: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Request method failure captured: Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 HTTP/1.1 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxXMarROYeuS0GyHqn_VUh0oq5UmzPTsSDEx5S6NA1yHb6Ar65wr_AoDeXWnH1ncUFz-UJsPuEB-15Gor-otR4PY-GP7Wpry9zj5WnEjMrj9P7-pF0Wlb0e0PfZcZYl4pkikbVDKGSDSI3IyrPvlpSAhkcbsmbxtj-ICLKhIgnVP6M Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cfc4b787c95143c0b9d6f53832e324f1 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:26.938001 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc4b787c95143c0b9d6f53832e324f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc4b787c95143c0b9d6f53832e324f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cfc4b787c95143c0b9d6f53832e324f1 Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-632897816 Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesAdminNegativeTest-632897816-project Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f8b35ab211584884a72057fa31184836 Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesAdminNegativeTest-632897816-project Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. Jul 30 21:04:26.939786 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '3766e564-dc7d-4328-9cf8-cd5dd04c9a41'} Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:26.940714 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. Jul 30 21:04:26.942265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:26.944791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Returning 404 to user: Instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:26.946390 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83b712a3-9663-4d61-a96b-bf9fbf88f188 tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41" status: 404 len: 111 microversion: 2.1 time: 0.110060 Jul 30 21:04:26.947526 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 523/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:26 2022] GET /compute/v2.1/servers/3766e564-dc7d-4328-9cf8-cd5dd04c9a41 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:26.954399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:26.955681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:26.964118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.964603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:26.966347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:26.966824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.019947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:27.037704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:27.039225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:27.041385 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3f9d494-ef3f-461f-8e76-bacb1d2ade77 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.837997 Jul 30 21:04:27.055538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:27.056332 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 569/1092] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:26 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:27.064330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7a79e10c-2f90-477c-a69e-a0deba487aed tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] Calling method '.version_select at 0x7fbb5cdf74c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:27.066735 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddc5f83b-1849-4fd7-b7f2-3e3cc2331dcf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1266 microversion: 2.1 time: 0.117411 Jul 30 21:04:27.067450 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 524/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:26 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:27.095317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7a79e10c-2f90-477c-a69e-a0deba487aed tempest-VolumesAdminNegativeTest-632897816 tempest-VolumesAdminNegativeTest-632897816-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119317742" status: 202 len: 0 microversion: 2.1 time: 0.037074 Jul 30 21:04:27.099229 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 570/1094] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119317742 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:27.209611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:27.211062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:27.222418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.227037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.230058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.230807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.360210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1f88f622-cdb4-477a-8de5-b051f80908ab req-24bfb258-1fb7-486f-afe7-b32873e8e584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:27.381122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1f88f622-cdb4-477a-8de5-b051f80908ab req-24bfb258-1fb7-486f-afe7-b32873e8e584 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.393462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1f88f622-cdb4-477a-8de5-b051f80908ab req-24bfb258-1fb7-486f-afe7-b32873e8e584 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.432275 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1f88f622-cdb4-477a-8de5-b051f80908ab req-24bfb258-1fb7-486f-afe7-b32873e8e584 service nova] Creating event network-vif-unplugged:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:04:27.445635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '794f1a4f424d4b71a23649a4d178df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f71035a2ae04a76a9e82b6ccd3759cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:27.451712 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1f88f622-cdb4-477a-8de5-b051f80908ab req-24bfb258-1fb7-486f-afe7-b32873e8e584 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095085 Jul 30 21:04:27.462311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee437228-904e-4d72-ab60-3c07c578ff07 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 200 len: 1428 microversion: 2.1 time: 0.256505 Jul 30 21:04:27.463240 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 571/1095] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:27.468756 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 525/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:27 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 1428 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:27.477230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d1c5ad78-908d-4f4d-a652-caa0edc5510a req-3e2a1e54-b05b-4c09-be82-79ef6dee1cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ad54e-f15a-40e3-aa8b-d60574d444e8", "name": "network-vif-deleted", "tag": "f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:27.497989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d1c5ad78-908d-4f4d-a652-caa0edc5510a req-3e2a1e54-b05b-4c09-be82-79ef6dee1cf1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.500727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d1c5ad78-908d-4f4d-a652-caa0edc5510a req-3e2a1e54-b05b-4c09-be82-79ef6dee1cf1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.520700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d1c5ad78-908d-4f4d-a652-caa0edc5510a req-3e2a1e54-b05b-4c09-be82-79ef6dee1cf1 service nova] Creating event network-vif-deleted:f2f31deb-a4c6-4d28-bd43-b2bb5dfb3eb0 for instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 on nch1-master-1 Jul 30 21:04:27.553617 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d1c5ad78-908d-4f4d-a652-caa0edc5510a req-3e2a1e54-b05b-4c09-be82-79ef6dee1cf1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079924 Jul 30 21:04:27.553617 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 572/1097] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:27.862305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:27.863098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:27.874703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.876257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:27.878168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:27.878888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.068480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:28.069302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:28.087670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.090579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.092029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.094354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.114571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.127145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.128996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea0b28116c64ba8ad7d6f83e63762d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae99b18c49be443e96955fd4ea16630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.151456 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc723001-d87e-4655-9a12-3252c003235d tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 200 len: 1444 microversion: 2.75 time: 0.294364 Jul 30 21:04:28.170648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 526/1098] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:27 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 1444 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:28.170648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:28.170648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:28.198065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.198531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.203943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.204415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.682107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.694732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0943effb-d891-490e-83a3-be8c2f357aff tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1266 microversion: 2.1 time: 0.536297 Jul 30 21:04:28.696024 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 527/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:28 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1266 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:28.705989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5e6f9039-7a0f-4f38-a219-a83f9c16f405 req-c089d91f-5a62-4374-9b7e-6669f731edc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766e564-dc7d-4328-9cf8-cd5dd04c9a41", "name": "network-vif-deleted", "tag": "f6582567-866b-42b5-9909-5470ec2926cf"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:28.726553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5e6f9039-7a0f-4f38-a219-a83f9c16f405 req-c089d91f-5a62-4374-9b7e-6669f731edc7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.727103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5e6f9039-7a0f-4f38-a219-a83f9c16f405 req-c089d91f-5a62-4374-9b7e-6669f731edc7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.758389 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5e6f9039-7a0f-4f38-a219-a83f9c16f405 req-c089d91f-5a62-4374-9b7e-6669f731edc7 service nova] Creating event network-vif-deleted:f6582567-866b-42b5-9909-5470ec2926cf for instance 3766e564-dc7d-4328-9cf8-cd5dd04c9a41 on nch1-master-1 Jul 30 21:04:28.764259 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5e6f9039-7a0f-4f38-a219-a83f9c16f405 req-c089d91f-5a62-4374-9b7e-6669f731edc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064705 Jul 30 21:04:28.769177 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 528/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:28.780634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:28.781844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] [instance: e22ad54e-f15a-40e3-aa8b-d60574d444e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:28.803157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.804256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.804784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:28.805236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:28.833281 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] HTTP exception thrown: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Request method failure captured: Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 HTTP/1.1 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZxFIxZ4OOWraw6XZHLq0LMRWBYkKi_DjxVrQsLHR-Hq9UrkBf_p4zvmqnTBoJfoTCceIfMlaaeQ5pdIc4OEMGk0TNdJDRQt5mrheBlfjkJ0brkRiekrfgghBAk2BgFb5yEE9XTvZMK2_1wBYkD_KoewIjS7GgjmgwYptOsf050FD20 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:28.843908 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f71035a2ae04a76a9e82b6ccd3759cc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f71035a2ae04a76a9e82b6ccd3759cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 7f71035a2ae04a76a9e82b6ccd3759cc Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminTestJSON-1328134992 Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 794f1a4f424d4b71a23649a4d178df28 Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminTestJSON-1328134992-project Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. Jul 30 21:04:28.845409 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e22ad54e-f15a-40e3-aa8b-d60574d444e8'} Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:28.846200 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. Jul 30 21:04:28.847630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:28.849926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] Returning 404 to user: Instance e22ad54e-f15a-40e3-aa8b-d60574d444e8 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:28.849926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-609e35f9-cb5c-44dc-9ac6-8df32a224f59 tempest-ServersAdminTestJSON-1328134992 tempest-ServersAdminTestJSON-1328134992-project] 10.222.0.17 "GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8" status: 404 len: 111 microversion: 2.1 time: 0.075178 Jul 30 21:04:28.849926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 529/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:28 2022] GET /compute/v2.1/servers/e22ad54e-f15a-40e3-aa8b-d60574d444e8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:04:28.893994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.906532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.911612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:28.913901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d512997-b03d-4c8e-9a71-daa71de0ab68 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.851056 Jul 30 21:04:28.938280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 573/1102] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:28 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:04:29.181424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:29.182044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] [instance: c677f178-cd12-4eeb-82e0-1e4c27c44f64] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:29.191751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.192217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.193005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.193455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.246271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] HTTP exception thrown: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Request method failure captured: Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 HTTP/1.1 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyR9Vb52UAOqdquDtidCW4ss2WfX5_kL91pxkIW0ooerXGBSJRqC_dtz0023yvxc3L1FRFwr-GejLEsVrBM_vjKTTem0FomhDbFDu6BuDub5t7ueIpSbMZjQIl82klEXGIFoacUBHGhKDXfPH2Ci1AYJrCpGN8mG42v3-xz3ZsOyLM Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.75 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: ae99b18c49be443e96955fd4ea16630f Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdmin275Test-1368116716 Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:04:29.250050 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae99b18c49be443e96955fd4ea16630f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae99b18c49be443e96955fd4ea16630f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae99b18c49be443e96955fd4ea16630f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae99b18c49be443e96955fd4ea16630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdmin275Test-1368116716 Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: ae99b18c49be443e96955fd4ea16630f Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdmin275Test-1368116716 Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdmin275Test-1368116716-project Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: dea0b28116c64ba8ad7d6f83e63762d7 Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdmin275Test-1368116716-project Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. Jul 30 21:04:29.251716 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c677f178-cd12-4eeb-82e0-1e4c27c44f64'} Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:04:29.252636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. Jul 30 21:04:29.253859 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:04:29.261237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] Returning 404 to user: Instance c677f178-cd12-4eeb-82e0-1e4c27c44f64 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:04:29.263948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b2635a56-81c7-4566-a02c-0e774d1b5ce4 tempest-ServersAdmin275Test-1368116716 tempest-ServersAdmin275Test-1368116716-project] 10.222.0.17 "GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64" status: 404 len: 111 microversion: 2.75 time: 0.086367 Jul 30 21:04:29.269138 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 530/1103] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:29 2022] GET /compute/v2.1/servers/c677f178-cd12-4eeb-82e0-1e4c27c44f64 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:04:29.718765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:29.720229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:29.741636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.742111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.745028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.745667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.780003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bd53252d-6644-4329-8e38-cec286643718 req-52f57d75-ca6e-49af-8b50-823f8303e66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983acaf3-8025-4357-a90e-fa1c74ccc477", "name": "network-vif-deleted", "tag": "678a3e08-5991-471a-8092-88b834148102"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:29.806170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd53252d-6644-4329-8e38-cec286643718 req-52f57d75-ca6e-49af-8b50-823f8303e66d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.809147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd53252d-6644-4329-8e38-cec286643718 req-52f57d75-ca6e-49af-8b50-823f8303e66d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.845361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bd53252d-6644-4329-8e38-cec286643718 req-52f57d75-ca6e-49af-8b50-823f8303e66d service nova] Creating event network-vif-deleted:678a3e08-5991-471a-8092-88b834148102 for instance 983acaf3-8025-4357-a90e-fa1c74ccc477 on nch1-master-1 Jul 30 21:04:29.861092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bd53252d-6644-4329-8e38-cec286643718 req-52f57d75-ca6e-49af-8b50-823f8303e66d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084253 Jul 30 21:04:29.863132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 531/1104] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:29.973959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:29.974856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:29.984431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.985597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:29.987553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:29.991417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:30.441339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:30.482966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:30.502236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:30.509680 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-505723b2-0a20-4dc4-9f86-a37cd8566ac5 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.544061 Jul 30 21:04:30.523880 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 532/1105] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:29 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:30.984302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:31.003906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-768d488c-03b5-4fbe-a0b7-a171085b9cf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 1.289212 Jul 30 21:04:31.006382 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 574/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:29 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:31.566570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:31.570158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:31.581583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:31.609407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:31.610751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:31.616293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:31.616940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:32.032146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:32.033048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:32.045365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:32.048862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:32.069381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:32.090237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:32.092767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:32.093917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:32.097607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:32.099873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:32.102279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:32.105210 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30bada25-aba0-413b-b5f4-8b1e468617dc tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1814 microversion: 2.25 time: 0.554201 Jul 30 21:04:32.130776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 533/1107] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:31 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1814 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:32.462638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d830f7fe-a7b8-497d-93c7-eed7562d9fa0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cedfe50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:32.536505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d830f7fe-a7b8-497d-93c7-eed7562d9fa0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681" status: 200 len: 662 microversion: 2.1 time: 0.080693 Jul 30 21:04:32.537573 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 534/1108] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:32 2022] GET /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:32.595429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e0103a0-f37a-440d-a2ed-3fca21fd5242 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0afca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:32.659871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e0103a0-f37a-440d-a2ed-3fca21fd5242 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681" status: 200 len: 662 microversion: 2.1 time: 0.096503 Jul 30 21:04:32.663925 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 535/1109] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:32 2022] GET /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681 => generated 662 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:32.865970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:32.877458 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48f09095-60b0-4967-8f71-08cd675087fc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 0.854104 Jul 30 21:04:32.878066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 575/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:32 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:33.134018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:33.139564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:33.154076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.159510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.160570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.161198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.428378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b01079f9-b4cd-495c-9c97-5fb91edc5e5d req-0c8c841d-9cf3-4c59-b6a8-951f73106d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f98840b-782b-41a6-8bf2-5f3e4722d087", "tag": "60cd5c3a-0d14-4901-9c83-6f01d820a646"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:33.444897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b01079f9-b4cd-495c-9c97-5fb91edc5e5d req-0c8c841d-9cf3-4c59-b6a8-951f73106d8f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.445298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b01079f9-b4cd-495c-9c97-5fb91edc5e5d req-0c8c841d-9cf3-4c59-b6a8-951f73106d8f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.477076 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b01079f9-b4cd-495c-9c97-5fb91edc5e5d req-0c8c841d-9cf3-4c59-b6a8-951f73106d8f service nova] Creating event network-changed:60cd5c3a-0d14-4901-9c83-6f01d820a646 for instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 on nch1-master-1 Jul 30 21:04:33.493174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b01079f9-b4cd-495c-9c97-5fb91edc5e5d req-0c8c841d-9cf3-4c59-b6a8-951f73106d8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068361 Jul 30 21:04:33.494057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 576/1111] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:33.808176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:33.826721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:33.828676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:33.830130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d6c2ba2-a049-43e0-88a4-71cb852ebd74 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1804 microversion: 2.25 time: 0.700883 Jul 30 21:04:33.852420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 536/1112] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:33 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1804 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:33.864063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41406046-ad8d-410f-97e7-63d60ba18c69 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '.version_select at 0x7fbb5ce4d670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:33.868431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41406046-ad8d-410f-97e7-63d60ba18c69 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.870888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41406046-ad8d-410f-97e7-63d60ba18c69 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.905431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:33.906427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:33.916343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.917690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.918719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:33.928044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:33.928868 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41406046-ad8d-410f-97e7-63d60ba18c69 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.059933 Jul 30 21:04:33.943638 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 577/1113] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 30 21:04:33 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:33.955946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:33.956961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:34.016047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:34.016528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:34.017346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:34.017811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:34.516296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:34.530316 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-135e179c-cf9a-44d8-b649-45a6f6ecd8e8 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 0.627522 Jul 30 21:04:34.538434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 537/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:33 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:34.677421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:34.715557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cfde1bd-a990-4199-a124-014c5ef3ee4a tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 2423 microversion: 2.25 time: 0.770468 Jul 30 21:04:34.718142 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 578/1115] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:33 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 2423 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:34.748197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:34.749047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:34.768954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:34.769421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:34.770258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:34.770719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:35.215707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96a815e4-3f0f-4844-8a45-13d86a27a302 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ced8700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:35.326982 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96a815e4-3f0f-4844-8a45-13d86a27a302 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1" status: 200 len: 661 microversion: 2.1 time: 0.128124 Jul 30 21:04:35.327905 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 579/1116] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:35 2022] GET /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1 => generated 661 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:35.343263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfc13b87-5dda-4d94-b2a4-876a49872473 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cdf3a60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:35.430831 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfc13b87-5dda-4d94-b2a4-876a49872473 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1" status: 200 len: 661 microversion: 2.1 time: 0.093378 Jul 30 21:04:35.432401 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 580/1117] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:35 2022] GET /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1 => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:35.559988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:35.562036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:35.573826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:35.578720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:35.583473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:35.585231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:35.815014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:35.841159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-668d105e-ad79-49c2-9ac6-e43b30635c39 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 2423 microversion: 2.25 time: 1.098300 Jul 30 21:04:35.856497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 538/1118] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:04:34 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 2423 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:04:35.971500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:35.972348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:35.983345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:35.984740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:35.986161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:35.987070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:36.224225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lazy-loading 'services' on Instance uuid bb6baf4d-2456-4286-a493-ab0b890becf0 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:04:36.373536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea339a02-76e1-4ad7-8015-00a1986120ed tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments/ef5d39c0-6fcc-4989-9a8e-f153d1d721ae" status: 202 len: 0 microversion: 2.25 time: 0.405834 Jul 30 21:04:36.375118 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 539/1119] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Jul 30 21:04:35 2022] DELETE /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments/ef5d39c0-6fcc-4989-9a8e-f153d1d721ae => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:04:36.401502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:36.408121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:36.419272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:36.420147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:36.421500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:36.422153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:36.501120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:36.556626 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30f731a8-83e4-4d13-bcf4-5418d789bb0a tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.176846 Jul 30 21:04:36.557505 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 540/1120] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:04:36 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:04:36.907740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:36.924894 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c37c3047-8022-4f99-8fdf-0d8c0c74b147 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 1.374257 Jul 30 21:04:36.927270 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 581/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:35 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:37.560237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-93fff304-3559-46dc-b75e-f68f2b2c9f2e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cda70d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:37.579082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-916209197", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:37.695971 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-93fff304-3559-46dc-b75e-f68f2b2c9f2e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09" status: 200 len: 661 microversion: 2.1 time: 0.155247 Jul 30 21:04:37.696869 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 582/1122] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:37 2022] GET /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09 => generated 661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:37.717962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:37.732553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:04:37.739771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:37.754812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:37.755682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:37.760370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:37.761002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:37.796542 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3203f929-c712-4c63-a92a-5294fa328f87 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.090715 Jul 30 21:04:37.796542 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 583/1123] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:04:37 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:37.809308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d981723-f182-4e1c-b825-f8459a5cc7d5 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ced8c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:37.857413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d981723-f182-4e1c-b825-f8459a5cc7d5 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09" status: 200 len: 661 microversion: 2.1 time: 0.059758 Jul 30 21:04:37.858996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 584/1124] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:04:37 2022] GET /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09 => generated 661 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:37.951586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:37.952915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:37.965886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:37.967914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:37.970363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:37.974273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:38.224612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:38.237801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c9de2df-6443-4f5d-9c59-f3419c7acf2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 0.292387 Jul 30 21:04:38.239163 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 585/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:37 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:38.245612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1164331744", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:38.335266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:04:38.695126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:04:38.700178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:04:38.700965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:04:38.701555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:04:38.702428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:04:38.702867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:04:38.703600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:04:38.704190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:04:38.704675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:04:38.705291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:04:38.717387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:38.735267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:38.737457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:38.741416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:38.742052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:38.747158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:38.747814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:38.748692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:38.749145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:38.786971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Getting quotas for project 3b49b328c44040f0b5ae9b929e137b55. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:04:38.795334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Getting quotas for user c8c95b7c11b24f13a2a7148a087d590e and project 3b49b328c44040f0b5ae9b929e137b55. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:04:38.800859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:04:38.816796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:04:38.834112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:04:38.837347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:04:38.841395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:04:38.843084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:04:38.966828 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c8d555c-c955-4d7a-96b5-12df4f70f554 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725583 Jul 30 21:04:38.968250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94dc8eb9-ca9e-44ba-b34a-42ba0e1339a5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644753 Jul 30 21:04:38.968737 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 586/1126] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:04:38.978098 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 541/1127] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:04:39.000775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb4c0835-44b6-4f65-923d-7b4567e395f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:39.002988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb4c0835-44b6-4f65-923d-7b4567e395f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:39.098601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bee0f965-7edd-45bd-a72a-84833b508dc8 req-ae37b513-d723-46c5-a5cb-26681821bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f98840b-782b-41a6-8bf2-5f3e4722d087", "name": "network-vif-plugged", "status": "completed", "tag": "60cd5c3a-0d14-4901-9c83-6f01d820a646"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:39.116728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bee0f965-7edd-45bd-a72a-84833b508dc8 req-ae37b513-d723-46c5-a5cb-26681821bba4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:39.131222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bee0f965-7edd-45bd-a72a-84833b508dc8 req-ae37b513-d723-46c5-a5cb-26681821bba4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:39.179063 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bee0f965-7edd-45bd-a72a-84833b508dc8 req-ae37b513-d723-46c5-a5cb-26681821bba4 service nova] Creating event network-vif-plugged:60cd5c3a-0d14-4901-9c83-6f01d820a646 for instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 on nch1-master-1 Jul 30 21:04:39.196232 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bee0f965-7edd-45bd-a72a-84833b508dc8 req-ae37b513-d723-46c5-a5cb-26681821bba4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101705 Jul 30 21:04:39.196855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 542/1128] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:39.225756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2012533169", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:39.239816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fb4c0835-44b6-4f65-923d-7b4567e395f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:39.249777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb4c0835-44b6-4f65-923d-7b4567e395f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1216 microversion: 2.1 time: 0.273787 Jul 30 21:04:39.250390 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 587/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:38 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1216 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:39.280585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:39.281243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:39.312520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:39.313111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:39.313802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:39.317143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:39.343431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:04:39.756804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:04:39.758042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:04:39.759582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:04:39.760181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:04:39.760823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:04:39.788411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:39.788888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:39.789988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:39.792125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:39.848391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Getting quotas for project 3b49b328c44040f0b5ae9b929e137b55. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:04:39.858019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Getting quotas for user c8c95b7c11b24f13a2a7148a087d590e and project 3b49b328c44040f0b5ae9b929e137b55. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:04:39.908899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:04:39.923924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:04:40.009176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-749dc739-0c4a-4a36-8b04-bf68bb489e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800814 Jul 30 21:04:40.018722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 543/1130] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:04:40.024346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d4441cf-c050-4fce-b46a-95d173ac1700 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:40.025215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d4441cf-c050-4fce-b46a-95d173ac1700 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:40.144590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d4441cf-c050-4fce-b46a-95d173ac1700 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:40.155679 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d4441cf-c050-4fce-b46a-95d173ac1700 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1218 microversion: 2.1 time: 0.135457 Jul 30 21:04:40.163260 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 544/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:40 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:40.281203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:40.282300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:40.301779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:40.311573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:40.314601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:40.317133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:40.320568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:40.431467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:40.458159 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a08933ec-ced9-4b6b-b67a-0f6b3a50af7a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1308 microversion: 2.1 time: 1.185338 Jul 30 21:04:40.459306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 588/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:39 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1308 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:40.588780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:40.599587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da7b9847-ea83-4897-97f4-5a66ee615740 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1220 microversion: 2.1 time: 0.333261 Jul 30 21:04:40.602307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 545/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:40 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1220 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:41.192225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:41.192966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:41.206253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.207098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.209090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.209641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.418506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:41.436861 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d0fc8c07-1f48-45f0-8fde-7418707b702c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1222 microversion: 2.1 time: 0.256538 Jul 30 21:04:41.451467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 589/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:41 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:41.480832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:41.483507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:41.500072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.501541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.502390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.502922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.623013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:41.624400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:41.636261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.638356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.639709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:41.640619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:41.912458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:41.931822 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d4d6e312-90d3-48de-b367-5f7a8491a0c8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1274 microversion: 2.1 time: 0.313112 Jul 30 21:04:41.932534 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 590/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:41 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:42.359633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:42.372585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70a5c581-669d-4007-9ed7-a237b13c3286 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1486 microversion: 2.1 time: 0.895030 Jul 30 21:04:42.374313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 546/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:41 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1486 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:42.396734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dcfaf9e4-f4c5-41a1-8c41-a021d21f40db tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:42.412772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcfaf9e4-f4c5-41a1-8c41-a021d21f40db tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.413507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcfaf9e4-f4c5-41a1-8c41-a021d21f40db tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.458059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:42.459422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:42.481570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.483004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.484133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.488357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.611576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dcfaf9e4-f4c5-41a1-8c41-a021d21f40db tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Going to try to stop instance {{(pid=130984) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:04:42.660535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:42.677400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:42.693098 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-644732b3-561f-48fa-b956-56ae8dfd6692 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1276 microversion: 2.1 time: 0.238754 Jul 30 21:04:42.694696 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 547/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:42 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:42.743844 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dcfaf9e4-f4c5-41a1-8c41-a021d21f40db tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087/action" status: 202 len: 0 microversion: 2.1 time: 0.351039 Jul 30 21:04:42.746471 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 591/1138] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:04:42 2022] POST /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:42.767325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:42.768067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:42.787022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.787805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.789048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.789797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.958679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:42.959525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:42.985198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.985901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:42.986939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:42.987561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:43.271365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:43.283333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3b313d3b-65f3-4983-93a6-82254357c527 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1274 microversion: 2.1 time: 0.330574 Jul 30 21:04:43.285062 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 592/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:42 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:43.496783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:43.532784 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb749dd4-6fe6-4a5c-bd9c-2d1354bf4c28 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.782777 Jul 30 21:04:43.535503 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 548/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:42 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:43.716233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:43.717836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:43.731072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:43.733526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:43.734611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:43.740113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:43.967476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:43.978284 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd778d38-7319-4bb5-ae8d-51d25813e7fc tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1276 microversion: 2.1 time: 0.265389 Jul 30 21:04:43.979946 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 593/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:43 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:44.304819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:44.305765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:44.318835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:44.319476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:44.320356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:44.321046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:44.460430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:44.486868 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9cec9bb2-c980-4d8e-b520-ed24da50ac2f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1274 microversion: 2.1 time: 0.185481 Jul 30 21:04:44.487839 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 549/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:44 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:44.556474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:44.557515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:44.566094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:44.566552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:44.568348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:44.569614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:44.999542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:45.000808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:45.016275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:45.020203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:45.021438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:45.022128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:45.129007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:45.138561 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f39cf64a-1ac4-4283-aa8d-a88e836c9b6d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1276 microversion: 2.1 time: 0.143955 Jul 30 21:04:45.143090 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 550/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:44 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:45.512178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:45.513076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:45.519456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:45.519841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:45.520690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:45.521152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:45.697153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:45.705892 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0102e194-7bc3-419c-8f9b-62f806d8e169 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 1.153419 Jul 30 21:04:45.710278 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 594/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:44 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:45.758803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:45.768308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1f34980-8454-4466-a353-8a0b9337d9eb tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.260661 Jul 30 21:04:45.773722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 551/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:45 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:46.162031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:46.163015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:46.170286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.170986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:46.172228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.173303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:46.329859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:46.338856 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96523687-e1c0-4983-936c-6cf46c2f203d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1276 microversion: 2.1 time: 0.180609 Jul 30 21:04:46.339585 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 595/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:46 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:46.732082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:46.732719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:46.743999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.748409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:46.749550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.750179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:46.802194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:46.803900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:46.824633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.825114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:46.825923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:46.826400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:47.036523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:47.051436 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc8b8342-93b7-4d9f-a63f-cd3f3857c2d2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.320578 Jul 30 21:04:47.052969 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 552/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:46 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:47.316021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:47.331180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e29e917-f377-4dd2-ae15-f4f33584fdbd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.531913 Jul 30 21:04:47.334383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 596/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:46 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:47.359688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:47.360591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:47.373067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:47.374095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:47.375208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:47.382320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:48.073677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:48.074382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:48.083925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:48.084400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:48.085216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:48.085684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:48.505504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:48.514953 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-982f3d21-5580-40af-8e96-542dd9d54995 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.445820 Jul 30 21:04:48.515490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 597/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:48 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:48.524980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:48.532498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:48.541735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:48.547697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:48.548985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:48.549508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:48.643155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:48.658601 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d36c4089-87e8-439f-825c-04433b7e2c2c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 1.302722 Jul 30 21:04:48.662129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 553/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:47 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:48.769776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:48.844950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:48.854320 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b815ef4-e755-44c8-b869-352e724cba3c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.333000 Jul 30 21:04:48.859244 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 598/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:48 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:49.535788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:49.536438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:49.546974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:49.549909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:49.550840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:49.551330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:49.693464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:49.694773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:49.707026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:49.719575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:49.720412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:49.721445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:49.722121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:49.817138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:50.129015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:50.146340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-234472ae-4766-454b-bf1d-3d163f012ce7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.458167 Jul 30 21:04:50.148381 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 599/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:49 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:50.149829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:50.156475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:50.168552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:50.176557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:50.177032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:50.182364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:50.183071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:50.235043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:50.257995 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d6ea296-4ecd-4215-89ec-ba48eb195958 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.721470 Jul 30 21:04:50.258855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 554/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:49 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:50.292053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-fbbc6f11-67d5-4efa-836c-d2adda4bad5e req-88389c4b-1050-4f32-84a3-770bb52d152d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f920502-e0cf-43aa-93ba-62d50d7905d7", "tag": "ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:50.318250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fbbc6f11-67d5-4efa-836c-d2adda4bad5e req-88389c4b-1050-4f32-84a3-770bb52d152d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:50.318876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fbbc6f11-67d5-4efa-836c-d2adda4bad5e req-88389c4b-1050-4f32-84a3-770bb52d152d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:50.342923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-fbbc6f11-67d5-4efa-836c-d2adda4bad5e req-88389c4b-1050-4f32-84a3-770bb52d152d service nova] Creating event network-changed:ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e for instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 on nch2-master-1 Jul 30 21:04:50.351245 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-fbbc6f11-67d5-4efa-836c-d2adda4bad5e req-88389c4b-1050-4f32-84a3-770bb52d152d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090029 Jul 30 21:04:50.353499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 555/1154] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:50.796040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:50.806746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-752a729c-1812-4ed6-86bd-35f58fe31044 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.655022 Jul 30 21:04:50.810962 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 600/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:50 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:51.170930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:51.171858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:51.202712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.209993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.211775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.215183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.282683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:51.283983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:51.306150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.306851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.311806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.312455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.673267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:51.692298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e47a329d-71f8-4bd3-8b61-3b16ef6e5105 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.526196 Jul 30 21:04:51.693073 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 556/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:51 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:51.707889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5453d2b4-2128-4a38-adb9-dde42102c9d1 req-80dfeb05-59a0-4c18-8a94-0445677be19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:51.736173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5453d2b4-2128-4a38-adb9-dde42102c9d1 req-80dfeb05-59a0-4c18-8a94-0445677be19d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.736644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5453d2b4-2128-4a38-adb9-dde42102c9d1 req-80dfeb05-59a0-4c18-8a94-0445677be19d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.770302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5453d2b4-2128-4a38-adb9-dde42102c9d1 req-80dfeb05-59a0-4c18-8a94-0445677be19d service nova] Creating event network-changed:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:04:51.803500 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5453d2b4-2128-4a38-adb9-dde42102c9d1 req-80dfeb05-59a0-4c18-8a94-0445677be19d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106543 Jul 30 21:04:51.805586 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 557/1157] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:51.831863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:51.832776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:51.847721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.848202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:51.849188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:51.849653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:52.038939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:52.057648 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1644256f-888c-4278-82da-a3774c59d1e5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.769877 Jul 30 21:04:52.059709 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 601/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:51 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:52.716967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:52.717928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:52.734160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:52.735380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:52.736198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:52.738231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:52.822054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:52.837218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-237869c5-7166-4181-a33b-9509feda3c89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 1.010781 Jul 30 21:04:52.837840 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 558/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:51 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:53.086039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:53.086680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:53.104888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:53.109549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:53.110581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:53.111061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:53.467875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:53.477075 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2424917-708e-49ab-8c30-256b3c3f8dd6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.766028 Jul 30 21:04:53.478071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 602/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:52 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:53.704961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cefd2315-6235-45ee-a794-8c61970753e0 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-225081228", "id": 635443600, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:53.708073 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:53.708073 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:04:53.736777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cefd2315-6235-45ee-a794-8c61970753e0 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.255694 Jul 30 21:04:53.738361 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 603/1161] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:53 2022] POST /compute/v2.1/flavors => generated 427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:53.755434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffa45a99-9f45-4a84-b300-4010fe581dd8 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eb8ec3b3cd3f46409711bae2091a042f"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:53.758498 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:53.758498 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:04:53.886654 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ffa45a99-9f45-4a84-b300-4010fe581dd8 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/635443600/action" status: 200 len: 96 microversion: 2.1 time: 0.137440 Jul 30 21:04:53.887678 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 604/1162] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Jul 30 21:04:53 2022] POST /compute/v2.1/flavors/635443600/action => generated 96 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:04:53.901718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:53.903187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:53.913402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:53.915039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:53.916088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:53.917134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:53.980895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:53.993868 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1790b88b-a75b-49ba-b4c7-1984426e0536 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.911318 Jul 30 21:04:54.015392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 559/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:53 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:54.026042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5cb43af6-b50d-4980-8cc8-d345b7aabae8 req-0fc86480-f4c2-4de1-bfeb-0518e5f4ba49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24", "tag": "a4a7f134-088e-4bed-bba6-67d689e70a28"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:54.040083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5cb43af6-b50d-4980-8cc8-d345b7aabae8 req-0fc86480-f4c2-4de1-bfeb-0518e5f4ba49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:54.041001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5cb43af6-b50d-4980-8cc8-d345b7aabae8 req-0fc86480-f4c2-4de1-bfeb-0518e5f4ba49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:54.058573 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5cb43af6-b50d-4980-8cc8-d345b7aabae8 req-0fc86480-f4c2-4de1-bfeb-0518e5f4ba49 service nova] Creating event network-changed:a4a7f134-088e-4bed-bba6-67d689e70a28 for instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 on nch2-master-1 Jul 30 21:04:54.064994 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5cb43af6-b50d-4980-8cc8-d345b7aabae8 req-0fc86480-f4c2-4de1-bfeb-0518e5f4ba49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043231 Jul 30 21:04:54.065789 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 560/1164] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:54.132806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:54.145241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d48d6f5f-a03c-45d1-b387-d80e2cfdf5e0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.255503 Jul 30 21:04:54.147682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 605/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:53 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:54.361142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9f574d6-cbaa-4c1f-9ec5-b5b360c80e89 tempest-FlavorsAccessTestJSON-1261712622 tempest-FlavorsAccessTestJSON-1261712622-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:54.387435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b9f574d6-cbaa-4c1f-9ec5-b5b360c80e89 tempest-FlavorsAccessTestJSON-1261712622 tempest-FlavorsAccessTestJSON-1261712622-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.319606 Jul 30 21:04:54.399140 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 561/1166] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:54 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:54.407859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bffc056e-7eb4-4802-9313-34642629afa4 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eb8ec3b3cd3f46409711bae2091a042f"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:54.411863 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:54.411863 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:04:54.791929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-391181161", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "e9b6ef4c-098f-4393-8b14-740aa6ff0b62"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:54.901847 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bffc056e-7eb4-4802-9313-34642629afa4 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/635443600/action" status: 200 len: 21 microversion: 2.1 time: 0.498885 Jul 30 21:04:54.907859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 606/1167] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Jul 30 21:04:54 2022] POST /compute/v2.1/flavors/635443600/action => generated 21 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:04:54.926799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:54.940805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:54.960955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:54.961430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:54.962265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:54.962692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:54.971725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] validate_networks() for [('e9b6ef4c-098f-4393-8b14-740aa6ff0b62', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:04:55.727944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:55.739903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-99ea7c06-4955-495c-aac3-dfe29af05fe9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.829948 Jul 30 21:04:55.740870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 607/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:54 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:55.758593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29145ebc-fac1-43df-95c2-8edc6a7c716f tempest-FlavorsAccessTestJSON-1261712622 tempest-FlavorsAccessTestJSON-1261712622-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:55.818872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29145ebc-fac1-43df-95c2-8edc6a7c716f tempest-FlavorsAccessTestJSON-1261712622 tempest-FlavorsAccessTestJSON-1261712622-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075178 Jul 30 21:04:55.821135 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 608/1169] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:55.833892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:55.834791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:55.849828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:55.850073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:04:55.850563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:04:55.851439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:55.851769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:04:55.852222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:04:55.852657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:04:55.853055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:55.853682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:55.873071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:55.875471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:55.876877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:55.877542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:55.898999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:04:55.906403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for user 5b51cd5eda484fad9a901893f75d1b48 and project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:04:55.925547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:04:55.929722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:04:55.993690 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1913994a-2af4-43fb-a693-cc9b731642f7 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546098 Jul 30 21:04:55.995113 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 562/1170] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:04:56.002463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.003454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:56.012956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:56.013570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:56.014477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:56.015105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:56.058094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:56.079201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:56.090985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-83082612-8b74-4a30-9b89-5d24434914ef tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.268508 Jul 30 21:04:56.097187 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 609/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:55 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:56.102157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-567a002f-bb67-473a-80e5-f231b94a5f78 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.110456 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:56.110456 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:04:56.149288 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-567a002f-bb67-473a-80e5-f231b94a5f78 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/635443600" status: 202 len: 0 microversion: 2.1 time: 0.050641 Jul 30 21:04:56.150182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 610/1172] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:04:56 2022] DELETE /compute/v2.1/flavors/635443600 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:56.158366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1d33dc5-40d4-4656-aa7f-ef288283c60d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.159166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1d33dc5-40d4-4656-aa7f-ef288283c60d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:56.271543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c1d33dc5-40d4-4656-aa7f-ef288283c60d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:56.280009 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1d33dc5-40d4-4656-aa7f-ef288283c60d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1224 microversion: 2.1 time: 0.128502 Jul 30 21:04:56.282818 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 611/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:56 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:56.302356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:56.307224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45221f3c-469f-4e3f-923e-cc4e77cff662 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.312345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc6ee3f8-f871-4031-aa9a-88a0b1bb484c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.315297 Jul 30 21:04:56.313029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 563/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:55 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:56.349211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45221f3c-469f-4e3f-923e-cc4e77cff662 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051584 Jul 30 21:04:56.350355 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 612/1175] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:56.368884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c50667d6-7c70-45c7-8059-f1bf7fa1fb5d tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1859171140", "id": 1336215008, "os-flavor-access:is_public": "False"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:56.372593 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:56.372593 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:04:56.418632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c50667d6-7c70-45c7-8059-f1bf7fa1fb5d tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.051958 Jul 30 21:04:56.419812 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 564/1176] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:04:56 2022] POST /compute/v2.1/flavors => generated 431 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:56.431452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-34930ade-db7e-401d-bd96-4bec54e461c2 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.432818 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:56.432818 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:04:56.457273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-34930ade-db7e-401d-bd96-4bec54e461c2 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1336215008/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029384 Jul 30 21:04:56.461415 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 613/1177] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:04:56 2022] GET /compute/v2.1/flavors/1336215008/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:04:56.481202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa36d258-677c-454f-b778-e217d57586d2 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.484213 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:04:56.484213 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:04:56.529929 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa36d258-677c-454f-b778-e217d57586d2 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1336215008" status: 202 len: 0 microversion: 2.1 time: 0.065574 Jul 30 21:04:56.535652 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 565/1178] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:04:56 2022] DELETE /compute/v2.1/flavors/1336215008 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:04:56.541557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c857e3e-cd7c-4d6e-a1f8-b2496d55a2e3 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.610250 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c857e3e-cd7c-4d6e-a1f8-b2496d55a2e3 tempest-FlavorsAccessTestJSON-1452658307 tempest-FlavorsAccessTestJSON-1452658307-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073313 Jul 30 21:04:56.620482 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 614/1179] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:04:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:56.770759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:56.771719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:56.788798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:56.790853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:56.795611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:56.797005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.121362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:57.122438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:57.140290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.150013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.154609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.156445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.178839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:57.188864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a453f88c-df53-4ec2-9f08-0a41ffd3855d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.424277 Jul 30 21:04:57.208409 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 566/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:56 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:57.307399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:57.308861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:57.317704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.325264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.326272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.329179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.454183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:57.463002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e0abd180-1e6d-4e20-a514-a544ed2c334e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1276 microversion: 2.1 time: 0.160701 Jul 30 21:04:57.464184 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 567/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:57 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:57.470535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:57.472038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:57.473962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:57.485235 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03cfcca8-b58c-4309-b186-e5119f75676c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.367966 Jul 30 21:04:57.500832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.501373 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 615/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:57 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:57.504306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.505386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:57.506065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:57.900349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:57.914167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f38fe4f-e72b-47e2-b690-d00b3e1f9386 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.448667 Jul 30 21:04:57.918035 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 568/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:57 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:58.124943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2522f4bc-d5b4-4e46-9407-870b85cb2d78 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:58.142941 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2522f4bc-d5b4-4e46-9407-870b85cb2d78 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.238921 Jul 30 21:04:58.166740 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 616/1184] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:04:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:04:58.216455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:58.221934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:58.231176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.231911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.236256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.236969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.488129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:58.488769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:58.512299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.513417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.516065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.518318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.531027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:58.545652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b0cd9a1-5149-466d-b88d-d49746828a3e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.335267 Jul 30 21:04:58.559213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 569/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:58 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:58.559213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:58.559213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:58.592775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.593239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.594421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.595035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.749517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:58.765515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fbc689f9-71f5-4132-9cf1-c3f1e61f0459 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1282 microversion: 2.1 time: 0.274397 Jul 30 21:04:58.767566 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 617/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:58 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:04:58.938217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:58.938849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:58.949624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:58.958506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9673700f-7fb1-4443-8758-03e8e6bcfb37 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.410790 Jul 30 21:04:58.960830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.961307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.962114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:58.963524 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 570/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:58 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:58.969861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:58.985840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:59.369454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:04:59.381058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7be3dd17-9d3c-4fd0-a0fe-9c4859432b3d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.446657 Jul 30 21:04:59.385567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 618/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:58 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:04:59.421538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-306c2c22-0398-4b45-8132-2b197ee3aced req-87766970-e156-4935-b50b-2f62dea5a380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f920502-e0cf-43aa-93ba-62d50d7905d7", "name": "network-vif-plugged", "status": "completed", "tag": "ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:04:59.459228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-306c2c22-0398-4b45-8132-2b197ee3aced req-87766970-e156-4935-b50b-2f62dea5a380 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:59.473720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-306c2c22-0398-4b45-8132-2b197ee3aced req-87766970-e156-4935-b50b-2f62dea5a380 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:59.555275 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-306c2c22-0398-4b45-8132-2b197ee3aced req-87766970-e156-4935-b50b-2f62dea5a380 service nova] Creating event network-vif-plugged:ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e for instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 on nch2-master-1 Jul 30 21:04:59.567050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:59.569087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:59.594393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:59.594947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:59.597077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:59.597548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:59.610670 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-306c2c22-0398-4b45-8132-2b197ee3aced req-87766970-e156-4935-b50b-2f62dea5a380 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195997 Jul 30 21:04:59.618929 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 571/1189] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:04:59.789093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:04:59.790087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:04:59.809949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:59.810421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:04:59.811237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:04:59.819632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:00.296756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:00.348855 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1638026-ed1d-4b90-8903-157e459442ed tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.564054 Jul 30 21:05:00.360888 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 572/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:59 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:00.382970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1044916344", "imageRef": "cb83adf4-78aa-458c-a037-38e0395404d7", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:00.412993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:00.430994 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dd8c3bfb-b6ed-4da6-80a8-4cd41ebeade4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.867158 Jul 30 21:05:00.434272 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 619/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:04:59 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:00.456552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:00.457326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:00.467164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:00.499913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:00.500495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:00.505825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:00.510157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:00.513914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:01.108787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] Request method failure captured: Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 143 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz5nPQRZidsdMcWEwitJ-JJdgmU3CucR1R0-ZcPQZU7fvArr5UYFEY1Ycf_vyu6f79UBtxJa6WJNj5Vu2r1hN0sAmHd3J0oNNIORLMjSoSz9qz1yNu4hlUm9lHbWhln-KXMfOAjl8mDzCdVMdu2bkQ7ItUKkhZT_bmAheay003Wbr0 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e42c5364a39747b69c18c6e6cc44e815 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsV2NegativeTest-454874985 Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:05:01.111773 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e42c5364a39747b69c18c6e6cc44e815"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e42c5364a39747b69c18c6e6cc44e815", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e42c5364a39747b69c18c6e6cc44e815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e42c5364a39747b69c18c6e6cc44e815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsV2NegativeTest-454874985 Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e42c5364a39747b69c18c6e6cc44e815 Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-454874985 Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsV2NegativeTest-454874985-project Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fbf76b231ffc44c691a0b60b685970f2 Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsV2NegativeTest-454874985-project Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1044916344", "imageRef": "cb83adf4-78aa-458c-a037-38e0395404d7", "flavorRef": "452"}} Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:05:01.113319 ncdv-master-1 devstack@n-api.service[130983]: exception: Flavor's memory is too small for requested image. Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1044916344', 'imageRef': 'cb83adf4-78aa-458c-a037-38e0395404d7', 'flavorRef': '452'}}} Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:01.114235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:01.115667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 30 21:05:01.117173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:01.121238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:01.122719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b2a49e2f-6366-4e46-aef1-90c1ffbf7630 tempest-FlavorsV2NegativeTest-454874985 tempest-FlavorsV2NegativeTest-454874985-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.753449 Jul 30 21:05:01.123644 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 573/1192] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:00 2022] POST /compute/v2.1/servers => generated 93 bytes in 758 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:05:01.135959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:01.137453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:01.147451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.148397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.149623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.151326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.170247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:01.187389 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b34a284b-61f8-4c4b-8de0-23d0b4df73b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.748331 Jul 30 21:05:01.188355 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 620/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:00 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:01.377981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:01.378622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:01.388059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.388517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.389327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.400512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.484705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:01.500714 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29d83335-f4b6-406d-b696-c27aaa083249 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1316 microversion: 2.1 time: 0.375466 Jul 30 21:05:01.501299 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 574/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:01 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:01.511201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:01.515408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:01.548537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.549316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.552571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.554682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.891679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:01.920728 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ffb29ed6-e54e-4b61-b821-37831db90e45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.415903 Jul 30 21:05:01.921341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 575/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:01 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:01.942210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7cc902a4-7c0c-405c-b28a-03b6c80242e4 req-abf22114-7722-438a-97cb-d3d1183940a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24", "name": "network-vif-plugged", "status": "completed", "tag": "a4a7f134-088e-4bed-bba6-67d689e70a28"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:01.959246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7cc902a4-7c0c-405c-b28a-03b6c80242e4 req-abf22114-7722-438a-97cb-d3d1183940a9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:01.959935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7cc902a4-7c0c-405c-b28a-03b6c80242e4 req-abf22114-7722-438a-97cb-d3d1183940a9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:01.973601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:01.984409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7cc902a4-7c0c-405c-b28a-03b6c80242e4 req-abf22114-7722-438a-97cb-d3d1183940a9 service nova] Creating event network-vif-plugged:a4a7f134-088e-4bed-bba6-67d689e70a28 for instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 on nch2-master-1 Jul 30 21:05:01.989668 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4f37e7d-6593-4456-bef8-8e4dd53ec0d4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.613376 Jul 30 21:05:01.990867 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7cc902a4-7c0c-405c-b28a-03b6c80242e4 req-abf22114-7722-438a-97cb-d3d1183940a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067899 Jul 30 21:05:01.996572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 576/1196] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:02.007443 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 621/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:01 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:02.022125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-556d457c-a18b-44a6-bb24-3a4b5b53ebaa req-91efb78a-ddda-4912-8230-effdeb888d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c2085-7678-42d9-bc8e-9c26adfd49f2", "tag": "1ceea3b8-69a2-41f2-9096-5571942472f0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:02.043777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-556d457c-a18b-44a6-bb24-3a4b5b53ebaa req-91efb78a-ddda-4912-8230-effdeb888d7c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.044239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-556d457c-a18b-44a6-bb24-3a4b5b53ebaa req-91efb78a-ddda-4912-8230-effdeb888d7c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.060307 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-556d457c-a18b-44a6-bb24-3a4b5b53ebaa req-91efb78a-ddda-4912-8230-effdeb888d7c service nova] Creating event network-changed:1ceea3b8-69a2-41f2-9096-5571942472f0 for instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 on nch1-master-1 Jul 30 21:05:02.066948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-556d457c-a18b-44a6-bb24-3a4b5b53ebaa req-91efb78a-ddda-4912-8230-effdeb888d7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065489 Jul 30 21:05:02.068085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 577/1198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:02.218680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:02.218680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:02.229904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.231343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.234981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.235910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.524205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:02.525076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:02.546730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.552076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.553233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.553967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.762368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:02.780728 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-74bbe028-0354-406b-bf6c-8e7723945d24 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.568692 Jul 30 21:05:02.784381 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 622/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:02 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:02.828449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:02.843967 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21a5de75-88da-4321-9c70-b5e413c06025 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1465 microversion: 2.1 time: 0.324162 Jul 30 21:05:02.845492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 578/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:02 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:02.943593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:02.944621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:02.952683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.953154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:02.955713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:02.957152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.241768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:03.250618 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95f088dc-f2cc-427a-8000-ad4e2c18d2c6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1318 microversion: 2.1 time: 0.310966 Jul 30 21:05:03.271786 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 579/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:02 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:03.281408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:03.284175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:03.298432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.298995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.299864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.300327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.684924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:03.713304 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d9f5a897-e008-4c2c-826c-ed57309cd26e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.437962 Jul 30 21:05:03.714447 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 580/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:03 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:03.809139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:03.812878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:03.826317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:03.827679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:03.853357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.854595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.857649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.859274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.871745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.872645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:03.876824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:03.877725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:04.301023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:04.328880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-edeb258f-2bed-443c-88ad-b642b05b6386 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.524504 Jul 30 21:05:04.348072 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 581/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:03 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:04.376968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-eca04721-cc29-489d-9b93-ff071ab3f472 req-066f6bae-e184-4eba-b796-43b722e05d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-plugged", "status": "completed", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:04.415957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-eca04721-cc29-489d-9b93-ff071ab3f472 req-066f6bae-e184-4eba-b796-43b722e05d42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:04.418389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-eca04721-cc29-489d-9b93-ff071ab3f472 req-066f6bae-e184-4eba-b796-43b722e05d42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:04.444095 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-eca04721-cc29-489d-9b93-ff071ab3f472 req-066f6bae-e184-4eba-b796-43b722e05d42 service nova] Creating event network-vif-plugged:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:05:04.456003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-eca04721-cc29-489d-9b93-ff071ab3f472 req-066f6bae-e184-4eba-b796-43b722e05d42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103648 Jul 30 21:05:04.457288 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 582/1204] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:04.470697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:04.471929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:04.503224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:04.504200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:04.507213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:04.507844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:04.839982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:04.860426 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5033d1d9-1493-4dac-8da5-91134569c27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1468 microversion: 2.1 time: 0.401242 Jul 30 21:05:04.863360 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 583/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:04 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:04.888576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:04.892536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:04.904316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:04.905469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:04.906669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:04.907543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:05.176302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:05.186556 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be98266d-8c5d-4406-83c9-d9b148ebbe21 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.321904 Jul 30 21:05:05.188418 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 584/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:04 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:05.207371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:05.208412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:05.216650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:05.235305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:05.235870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:05.236892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:05.237666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:05.338894 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-954a9dd0-457e-4f9d-b6bd-6622e29b4bbe tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1616 microversion: 2.1 time: 2.476696 Jul 30 21:05:05.359914 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 623/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:02 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1616 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:05.478613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:05.483182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:05.493641 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-494ff047-495a-42c4-8019-823860938126 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1318 microversion: 2.1 time: 0.302045 Jul 30 21:05:05.494626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 585/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:05 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:05.501996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:05.502878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:05.512547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:05.513631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:05.515695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:05.516511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:05.762020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de04b3c1-6699-4a27-bf41-252994babbd9 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-428987225", "id": 1908921626, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:05.764547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:05.765676 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:05.765676 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:05.772618 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63de9a66-62e3-4242-a402-4f9d72d8048d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.276515 Jul 30 21:05:05.773367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 586/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:05 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:05.778929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: .version_select at 0x7fbb5cfb11f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1993624872", "policies": ["affinity"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:05.788812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de04b3c1-6699-4a27-bf41-252994babbd9 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.425872 Jul 30 21:05:05.789701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 624/1210] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:05.798632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:05.803429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:05.812512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed2f38a1-fdfc-4337-8871-f0d7a4fed5e4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:05.815831 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:05.815831 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:05.887857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:05.893274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:05.895307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:05.910644 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed2f38a1-fdfc-4337-8871-f0d7a4fed5e4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1908921626/action" status: 200 len: 97 microversion: 2.1 time: 0.106632 Jul 30 21:05:05.911704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 625/1211] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:05 2022] POST /compute/v2.1/flavors/1908921626/action => generated 97 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:05:05.914311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-35f4ee17-1767-436f-b12b-f05cffd7a7d7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.139579 Jul 30 21:05:05.915031 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 587/1212] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:05:05 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:05.927353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-963beb20-d59d-491d-a87a-ef9aebe1eba2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:06.030424 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-963beb20-d59d-491d-a87a-ef9aebe1eba2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-963beb20-d59d-491d-a87a-ef9aebe1eba2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Request method failure captured: Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/flavors/1908921626/action HTTP/1.1 Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 67 Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz_bPrQgWwefxCo50MZVtXB4Aev80NjJVUXLCELts8sSX-JpLCBoFkOEKCPkO9pI2KIyQmzunKvxN_XIaf1yg8FkPqg5C8zwZo7gZg07bFYv5lBD5RoblKYQW0wkA9lSCdt6WesWnqS_RcJo7gYESbiPsg7Ec_9Yj4Wc7CqkWh71JM Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:05:06.035719 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c3514fe4e0a46d0b3b5e667c39a75ae", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 96e78fcd0a6646c19cbc129cd003dc3b Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} Jul 30 21:05:06.037456 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: exception: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1908921626', 'body': {'addTenantAccess': {'tenant': '4b9fd68002104013828f37ce3bda24e8'}}} Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:05:06.038623 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-4b9fd68002104013828f37ce3bda24e8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi session.flush() Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:05:06.039984 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 21:05:06.043514 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:05:06.046228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-4b9fd68002104013828f37ce3bda24e8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 30, 21, 5, 6, 20093), 'updated_at': None, 'flavor_id': 35, 'project_id': '4b9fd68002104013828f37ce3bda24e8'}] Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:06.048933 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:06.053516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:06.055168 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:06.056622 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. Jul 30 21:05:06.056622 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:06.056622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-963beb20-d59d-491d-a87a-ef9aebe1eba2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 4b9fd68002104013828f37ce3bda24e8 combination. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:06.056622 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-963beb20-d59d-491d-a87a-ef9aebe1eba2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1908921626/action" status: 409 len: 152 microversion: 2.1 time: 0.115342 Jul 30 21:05:06.056622 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 626/1213] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:05 2022] POST /compute/v2.1/flavors/1908921626/action => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:05:06.057127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ab40fa75-d65e-48e4-a16f-960bf680d6ff tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:06.058512 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:06.058512 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:06.120023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-876090747", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0859b13a-4963-4424-9588-1e36ab291a74"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:06.182666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ab40fa75-d65e-48e4-a16f-960bf680d6ff tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1908921626/action" status: 200 len: 21 microversion: 2.1 time: 0.135624 Jul 30 21:05:06.188844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:06.189445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 588/1214] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:06 2022] POST /compute/v2.1/flavors/1908921626/action => generated 21 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:05:06.195426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d301b25a-250a-41bd-b328-0440a1649a08 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:06.196214 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:06.196214 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:06.215569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d301b25a-250a-41bd-b328-0440a1649a08 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1908921626" status: 202 len: 0 microversion: 2.1 time: 0.024404 Jul 30 21:05:06.216175 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 589/1215] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:05:06 2022] DELETE /compute/v2.1/flavors/1908921626 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:06.224733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:06.225369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:06.232859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.233333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.234135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.234592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.276872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:06.428673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:06.429408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:06.429649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:06.430106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:06.430600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:06.438097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:06.447534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1df841d-9d49-41b4-ae78-ef93b51549da tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.226898 Jul 30 21:05:06.448045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 590/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:06 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:06.453836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca2d15ae-0180-4ec2-a057-1e584e2e67d7 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:06.464805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.466259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.467986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.468741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.496686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca2d15ae-0180-4ec2-a057-1e584e2e67d7 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047018 Jul 30 21:05:06.499377 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 591/1217] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:05:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:06.517950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:06.525198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:06.530197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:06.534522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:06.562955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 2 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:06.563480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.563947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.565151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.565426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:06.565619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.642404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130984) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 30 21:05:06.671102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:06.678743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:06.739029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:06.743882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:06.767700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:06.782717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d94e0628-0986-4190-a24e-9ba24bb59acd tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1318 microversion: 2.1 time: 0.259067 Jul 30 21:05:06.783125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=74aa1223-14ce-4f65-a00a-032dcb87adb7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:06.796015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 592/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:06 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:06.802263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ad2d9ce-c1c7-43dd-b371-4ca180b87696 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-987840358", "id": 2065308624, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:06.805967 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:06.805967 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:06.833920 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ad2d9ce-c1c7-43dd-b371-4ca180b87696 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.036699 Jul 30 21:05:06.835179 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 593/1219] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:06.841956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:06.842797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:06.850343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.850984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.852176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:06.852784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:06.906613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:06.916582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:06.989147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:06.993664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:07.031386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9f31774-790b-424b-b01f-80e29e604799 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.915837 Jul 30 21:05:07.036602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 627/1220] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 30 21:05:07.042173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fce6f0b-148a-444e-9d7a-24f83bd428b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.043234 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:07.043234 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:07.051744 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-7fce6f0b-148a-444e-9d7a-24f83bd428b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fce6f0b-148a-444e-9d7a-24f83bd428b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Request method failure captured: Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/flavors/2065308624/os-flavor-access HTTP/1.1 Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz_bPrQgWwefxCo50MZVtXB4Aev80NjJVUXLCELts8sSX-JpLCBoFkOEKCPkO9pI2KIyQmzunKvxN_XIaf1yg8FkPqg5C8zwZo7gZg07bFYv5lBD5RoblKYQW0wkA9lSCdt6WesWnqS_RcJo7gYESbiPsg7Ec_9Yj4Wc7CqkWh71JM Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:05:07.055176 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c3514fe4e0a46d0b3b5e667c39a75ae", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 96e78fcd0a6646c19cbc129cd003dc3b Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: exception: Access list not available for public flavors. Jul 30 21:05:07.057797 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'flavor_id': '2065308624'} Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 30 21:05:07.059751 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.063020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fce6f0b-148a-444e-9d7a-24f83bd428b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:07.064224 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7fce6f0b-148a-444e-9d7a-24f83bd428b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/2065308624/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026151 Jul 30 21:05:07.065071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 628/1221] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/flavors/2065308624/os-flavor-access => generated 91 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:05:07.070303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.076484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:07.077637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Searching by: {'deleted': False, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:05:07.085193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:07.095212 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a34514ce-a02e-4ff7-bfc0-dc56d3d854da tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1496 microversion: 2.1 time: 0.258597 Jul 30 21:05:07.097694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 594/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:06 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1496 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:07.103754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe1cd593-a9e1-45b3-8239-a388697d6d1d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.104627 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:07.104627 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:07.127955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.131211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.134497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.137260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.147043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe1cd593-a9e1-45b3-8239-a388697d6d1d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2065308624" status: 202 len: 0 microversion: 2.1 time: 0.048302 Jul 30 21:05:07.147863 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 595/1223] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:05:07 2022] DELETE /compute/v2.1/flavors/2065308624 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:07.167019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7fef0d03-44e6-470e-a1a6-e4860825c4b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.194924 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7fef0d03-44e6-470e-a1a6-e4860825c4b4 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042588 Jul 30 21:05:07.196143 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 596/1224] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:07.217407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94a80577-6ebe-4b74-986d-375698712cd2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1040817825", "id": 1514089714, "os-flavor-access:is_public": "False"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:07.220722 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:07.220722 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:07.245463 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94a80577-6ebe-4b74-986d-375698712cd2 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.031223 Jul 30 21:05:07.247078 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 597/1225] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:07.307164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:05:07.443523 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-163d3e58-3925-4d42-9f01-ffceba793728 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.377005 Jul 30 21:05:07.451332 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 629/1226] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/servers => generated 1001 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:07.461564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a9c67e21-2fd7-498d-8b26-4addab08e968 req-faa56827-8e83-425e-b98c-1e1713f1d1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c2085-7678-42d9-bc8e-9c26adfd49f2", "name": "network-vif-plugged", "status": "completed", "tag": "1ceea3b8-69a2-41f2-9096-5571942472f0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:07.484178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a9c67e21-2fd7-498d-8b26-4addab08e968 req-faa56827-8e83-425e-b98c-1e1713f1d1cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.484805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a9c67e21-2fd7-498d-8b26-4addab08e968 req-faa56827-8e83-425e-b98c-1e1713f1d1cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.516329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-817fecff-a3f8-4599-9b20-f59d71c9ec70 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:07.520113 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:07.520113 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:07.525087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-817fecff-a3f8-4599-9b20-f59d71c9ec70 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'efe8f31b2ffb49f39095e630ff4a0d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9fd68002104013828f37ce3bda24e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-817fecff-a3f8-4599-9b20-f59d71c9ec70 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Request method failure captured: Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/flavors/1514089714/action HTTP/1.1 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 67 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz-rSSMLkLH-_dx2y6Mlo8_hnv2d9FvAOiR3H2QqHIIVdwS8Pzj7SqG_148QbIx0862NMukzmjEag6x2R8jMFgv7rUOsGw8hteuWOHYckh7oNgvsKaeUk0_OSxfa68LGftsx82OcB6mUNkMS37wxsuF-YL4gCsCBeU1VXTZmrzgRTM Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4b9fd68002104013828f37ce3bda24e8 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:05:07.528440 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b9fd68002104013828f37ce3bda24e8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4b9fd68002104013828f37ce3bda24e8 Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsAccessNegativeTestJSON-2090653311-project Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: efe8f31b2ffb49f39095e630ff4a0d1b Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311-project Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} Jul 30 21:05:07.529918 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1514089714', 'body': {'addTenantAccess': {'tenant': '4b9fd68002104013828f37ce3bda24e8'}}} Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:05:07.530687 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 30 21:05:07.532174 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:07.536995 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a9c67e21-2fd7-498d-8b26-4addab08e968 req-faa56827-8e83-425e-b98c-1e1713f1d1cb service nova] Creating event network-vif-plugged:1ceea3b8-69a2-41f2-9096-5571942472f0 for instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 on nch1-master-1 Jul 30 21:05:07.539393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-817fecff-a3f8-4599-9b20-f59d71c9ec70 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:07.540491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-817fecff-a3f8-4599-9b20-f59d71c9ec70 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] 10.222.0.17 "POST /compute/v2.1/flavors/1514089714/action" status: 403 len: 130 microversion: 2.1 time: 0.285483 Jul 30 21:05:07.541272 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 598/1227] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:07 2022] POST /compute/v2.1/flavors/1514089714/action => generated 130 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:07.548352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a9c67e21-2fd7-498d-8b26-4addab08e968 req-faa56827-8e83-425e-b98c-1e1713f1d1cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095078 Jul 30 21:05:07.550445 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 630/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:07.553919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cddee909-0581-4375-9b88-1a3484672a97 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.554572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cddee909-0581-4375-9b88-1a3484672a97 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:07.559592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.560338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:07.562357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:07.568715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.569330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.570141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.570654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.692733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cddee909-0581-4375-9b88-1a3484672a97 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:07.700670 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cddee909-0581-4375-9b88-1a3484672a97 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1218 microversion: 2.1 time: 0.158123 Jul 30 21:05:07.713307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 599/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:07.719828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c53f4ab-cf12-4356-a78e-b56e47da47e8 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.721064 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:07.721064 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:07.750430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c53f4ab-cf12-4356-a78e-b56e47da47e8 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1514089714" status: 202 len: 0 microversion: 2.1 time: 0.046147 Jul 30 21:05:07.752750 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 600/1230] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:05:07 2022] DELETE /compute/v2.1/flavors/1514089714 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:07.775237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ba3c798-c080-48df-8a8f-6c3e41818f65 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.811344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ba3c798-c080-48df-8a8f-6c3e41818f65 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052761 Jul 30 21:05:07.812509 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 601/1231] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:07.817783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:07.818586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:07.828283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.829037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:07.830538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:07.831197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.003788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:08.015382 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-84de86f5-5b0d-4e81-aace-aad7b1eee1e4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1324 microversion: 2.1 time: 0.462870 Jul 30 21:05:08.016395 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 631/1232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:08.043055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b31d04bf-4850-4d24-becd-964a0036dcd5 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1762255612", "id": 1073746209, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.046287 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:08.046287 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:08.085451 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b31d04bf-4850-4d24-becd-964a0036dcd5 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.068073 Jul 30 21:05:08.092716 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 632/1233] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/flavors => generated 439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:08.110502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-29125914", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "68a236a2-c168-48e8-bff4-a731709fe73b"}], "block_device_mapping_v2": [{"uuid": "1941c452-ad85-49ec-b06a-60721b5e727b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.116496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:08.131716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ecb9238-08d3-44c9-8d55-08a5b6fa7f13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1467 microversion: 2.1 time: 0.317782 Jul 30 21:05:08.143317 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 602/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:07 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1467 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:08.154610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-57b67293-143b-42f8-b33b-62e605bbda7d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.154610 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:08.154610 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:08.234726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] validate_networks() for [('68a236a2-c168-48e8-bff4-a731709fe73b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:08.276833 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-57b67293-143b-42f8-b33b-62e605bbda7d tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1073746209/action" status: 200 len: 97 microversion: 2.1 time: 0.141616 Jul 30 21:05:08.277974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 603/1235] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/flavors/1073746209/action => generated 97 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:05:08.284187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:08.284901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:08.296580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.297287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.298351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.298871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.457869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:08.471936 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fbf333ae-6c65-4f69-8d36-8ee659ae95c2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 200 len: 1473 microversion: 2.1 time: 0.192626 Jul 30 21:05:08.472652 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 604/1236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:08 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:08.479822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1389750972"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.482558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:08.489262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.489822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.491104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.493621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.805376 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f1ee7a4-2d52-4234-999c-eff1449e324d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "POST /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac/action" status: 202 len: 0 microversion: 2.1 time: 0.329922 Jul 30 21:05:08.807846 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 605/1237] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:05:08.821800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ec7e2916-66fb-43ed-a307-ed1953126b84 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.828155 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:08.828155 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:08.831770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ec7e2916-66fb-43ed-a307-ed1953126b84 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'efe8f31b2ffb49f39095e630ff4a0d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9fd68002104013828f37ce3bda24e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ec7e2916-66fb-43ed-a307-ed1953126b84 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Request method failure captured: Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/flavors/1073746209/action HTTP/1.1 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 70 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz-rSSMLkLH-_dx2y6Mlo8_hnv2d9FvAOiR3H2QqHIIVdwS8Pzj7SqG_148QbIx0862NMukzmjEag6x2R8jMFgv7rUOsGw8hteuWOHYckh7oNgvsKaeUk0_OSxfa68LGftsx82OcB6mUNkMS37wxsuF-YL4gCsCBeU1VXTZmrzgRTM Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4b9fd68002104013828f37ce3bda24e8 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:05:08.836649 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b9fd68002104013828f37ce3bda24e8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b9fd68002104013828f37ce3bda24e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4b9fd68002104013828f37ce3bda24e8 Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311 Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsAccessNegativeTestJSON-2090653311-project Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: efe8f31b2ffb49f39095e630ff4a0d1b Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2090653311-project Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: {"removeTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} Jul 30 21:05:08.838796 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1073746209', 'body': {'removeTenantAccess': {'tenant': '4b9fd68002104013828f37ce3bda24e8'}}} Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi context.can( Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:05:08.839836 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 30 21:05:08.841330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:08.844589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ec7e2916-66fb-43ed-a307-ed1953126b84 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:08.846767 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ec7e2916-66fb-43ed-a307-ed1953126b84 tempest-FlavorsAccessNegativeTestJSON-2090653311 tempest-FlavorsAccessNegativeTestJSON-2090653311-project] 10.222.0.17 "POST /compute/v2.1/flavors/1073746209/action" status: 403 len: 133 microversion: 2.1 time: 0.035394 Jul 30 21:05:08.847635 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 606/1238] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/flavors/1073746209/action => generated 133 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:08.855566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-793793367"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:08.859957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:08.879225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.883015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:08.888379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:08.889141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.163769 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d14411c7-15b5-4c26-8e52-4f28d37d894d tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087/action" status: 202 len: 0 microversion: 2.1 time: 0.314576 Jul 30 21:05:09.165036 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 607/1239] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:05:09.172988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:09.173969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:09.201224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.201971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.202903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.203505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.300471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:09.309886 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4406b6c0-c3d8-468c-ae85-6387d2edaa8b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1270 microversion: 2.1 time: 0.143579 Jul 30 21:05:09.310457 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 608/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:09 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:09.315401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50b79b21-2292-4758-8771-a345ebaae827 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ced5280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:09.366178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50b79b21-2292-4758-8771-a345ebaae827 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 200 len: 1455 microversion: 2.1 time: 0.053423 Jul 30 21:05:09.367357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 609/1241] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:09 2022] GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:09.372992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:09.373699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:09.374676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:09.375467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:09.376097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:09.377099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-540d194b-cd11-4e74-8471-9259c9573050 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b9fd68002104013828f37ce3bda24e8"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:09.379896 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:09.379896 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:09.391509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.392008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.392915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.393892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.432129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:09.442464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Getting quotas for user 96815c6776f1464a8b6350b4a52d4548 and project 81fb262c72e0468e92246bf31d93a204. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:09.498625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:09.534037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-540d194b-cd11-4e74-8471-9259c9573050 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1073746209/action" status: 200 len: 21 microversion: 2.1 time: 0.164909 Jul 30 21:05:09.536781 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 610/1242] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:09 2022] POST /compute/v2.1/flavors/1073746209/action => generated 21 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:05:09.552893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:09.553559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:09.556685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:09.559206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1941c452-ad85-49ec-b06a-60721b5e727b',volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:09.575379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.576422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.578335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:09.578963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:09.869180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-468f0c24-8980-446d-b5bd-2854470410dc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774870 Jul 30 21:05:09.876694 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 633/1243] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:05:09.881953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3070b4b6-7155-4a85-a5c7-2e3157ec7192 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cdf7040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:09.944506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:09.954781 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03525b56-79bf-4ae0-9fd2-5e1fdecce4be tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.414827 Jul 30 21:05:09.956205 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 611/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:09 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:09.961278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3631e54-1683-4872-8491-21583a9fa53c tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:09.962260 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:09.962260 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:10.024618 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3070b4b6-7155-4a85-a5c7-2e3157ec7192 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 200 len: 1411 microversion: 2.1 time: 0.146437 Jul 30 21:05:10.029609 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 634/1245] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:09 2022] GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:10.040243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd3f9025-49a0-40f1-8416-41dc9673faa4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:10.041270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd3f9025-49a0-40f1-8416-41dc9673faa4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:10.049881 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3631e54-1683-4872-8491-21583a9fa53c tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1073746209" status: 202 len: 0 microversion: 2.1 time: 0.092290 Jul 30 21:05:10.051458 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 612/1246] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:05:09 2022] DELETE /compute/v2.1/flavors/1073746209 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:10.059840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:10.064015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:10.085322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:10.085983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:10.087069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:10.087633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:10.402526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:10.415151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e7389ff-161b-4e5c-802d-79bfc4457fbf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.359627 Jul 30 21:05:10.416470 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 613/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:10 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:10.422428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-79303099", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab"}], "block_device_mapping_v2": [{"uuid": "c0dfeefa-d76c-47b8-8db2-d0d74ae557ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:10.538903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] validate_networks() for [('f22fbb87-4f5f-4493-bb82-e0ce0d6e01ab', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:10.723391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd3f9025-49a0-40f1-8416-41dc9673faa4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:10.736690 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd3f9025-49a0-40f1-8416-41dc9673faa4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1051 microversion: 2.1 time: 0.705112 Jul 30 21:05:10.751494 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 635/1248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:10 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1051 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:10.761541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-da2bcaf3-1c4a-4a48-b426-852801981473 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:10.809517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-da2bcaf3-1c4a-4a48-b426-852801981473 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054865 Jul 30 21:05:10.811068 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 636/1249] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:05:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:10.817091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:10.817935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:10.836736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:10.837487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:10.838826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:10.841260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.065196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:11.065642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:11.066136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:11.066567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:11.067426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:11.080959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.081480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.083487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.083973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.085674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:11.098847 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-019fac89-7d9a-4f88-a742-d2eb30458214 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1276 microversion: 2.1 time: 0.286236 Jul 30 21:05:11.103730 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 637/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:10 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:11.109299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:11.112903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50bbf1ed-9321-4f1e-9cd4-658ec2528bc3 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd37160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.114233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Getting quotas for user 46d7264a2f63436bb8519cd8cec6d9f5 and project bfb74be507694713821cb1a68619f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:11.180513 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50bbf1ed-9321-4f1e-9cd4-658ec2528bc3 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 200 len: 1455 microversion: 2.1 time: 0.075349 Jul 30 21:05:11.181112 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 638/1251] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:11 2022] GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:11.191255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe740063-247f-4e31-bf3b-f9a3a21194ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1421104491", "metadata": {"": ""}}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe740063-247f-4e31-bf3b-f9a3a21194ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action HTTP/1.1 Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 107 Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:05:11.204243 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1421104491", "metadata": {"": ""}}} Jul 30 21:05:11.205886 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1421104491', 'metadata': {'': ''}}}} Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'': ''} Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:11.206753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.209015 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:11.211843 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.212706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:11.213660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0dfeefa-d76c-47b8-8db2-d0d74ae557ed',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:11.213817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe740063-247f-4e31-bf3b-f9a3a21194ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:11.215227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe740063-247f-4e31-bf3b-f9a3a21194ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action" status: 400 len: 170 microversion: 2.1 time: 0.031268 Jul 30 21:05:11.216186 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 639/1252] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 30 21:05:11 2022] POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action => generated 170 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:05:11.222610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25e90286-1c3e-44d8-966a-a2df62248d59 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-665765009", "id": 2134805248, "os-flavor-access:is_public": "False"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:11.226919 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:11.226919 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:11.254534 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25e90286-1c3e-44d8-966a-a2df62248d59 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.036895 Jul 30 21:05:11.255974 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 640/1253] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:11 2022] POST /compute/v2.1/flavors => generated 438 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:11.269543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eacde76d-1684-4193-8200-a4273c6680d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cd06ee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.347655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eacde76d-1684-4193-8200-a4273c6680d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 200 len: 1411 microversion: 2.1 time: 0.090239 Jul 30 21:05:11.348861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 641/1254] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:11 2022] GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:11.354018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.355071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:11.363476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.364447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.366698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.367887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.498353 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.080396 Jul 30 21:05:11.498856 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 614/1255] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:05:11.510722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df594912-0e2b-4a65-b347-4751941b44da tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98216049978b4ec59b313fa005651b51"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:11.513710 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:11.513710 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:11.625278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-df594912-0e2b-4a65-b347-4751941b44da tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] HTTP exception thrown: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df594912-0e2b-4a65-b347-4751941b44da tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Request method failure captured: Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/flavors/2134805248/action HTTP/1.1 Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 70 Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz_bPrQgWwefxCo50MZVtXB4Aev80NjJVUXLCELts8sSX-JpLCBoFkOEKCPkO9pI2KIyQmzunKvxN_XIaf1yg8FkPqg5C8zwZo7gZg07bFYv5lBD5RoblKYQW0wkA9lSCdt6WesWnqS_RcJo7gYESbiPsg7Ec_9Yj4Wc7CqkWh71JM Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:05:11.629062 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c3514fe4e0a46d0b3b5e667c39a75ae", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c3514fe4e0a46d0b3b5e667c39a75ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8c3514fe4e0a46d0b3b5e667c39a75ae Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883 Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 96e78fcd0a6646c19cbc129cd003dc3b Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: {"removeTenantAccess": {"tenant": "98216049978b4ec59b313fa005651b51"}} Jul 30 21:05:11.630779 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: exception: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2134805248', 'body': {'removeTenantAccess': {'tenant': '98216049978b4ec59b313fa005651b51'}}} Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 30 21:05:11.631748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.632924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. Jul 30 21:05:11.634186 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:11.635941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df594912-0e2b-4a65-b347-4751941b44da tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Returning 404 to user: Flavor access not found for 39 / 98216049978b4ec59b313fa005651b51 combination. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:11.637623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df594912-0e2b-4a65-b347-4751941b44da tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/2134805248/action" status: 404 len: 124 microversion: 2.1 time: 0.130772 Jul 30 21:05:11.642075 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 615/1256] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Jul 30 21:05:11 2022] POST /compute/v2.1/flavors/2134805248/action => generated 124 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:11.647521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.648984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:11.731140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:11.740081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:11.743389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:11.745279 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1d76f754-bd20-460d-8dcf-91e6d0bd1d97 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1102 microversion: 2.25 time: 0.101743 Jul 30 21:05:11.746581 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 616/1257] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:11 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1102 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:11.777344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6b6983b-299e-462b-ab25-f3f8f5de1a28 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.778566 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:11.778566 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:11.817084 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e6b6983b-299e-462b-ab25-f3f8f5de1a28 tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2134805248" status: 202 len: 0 microversion: 2.1 time: 0.056209 Jul 30 21:05:11.821146 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 617/1258] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:05:11 2022] DELETE /compute/v2.1/flavors/2134805248 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:11.827832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:11.830284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:11.843282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.843791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.844585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:11.845034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:11.997808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:12.013250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-635fbc35-2313-492b-bf6a-e8f7a9cfa978 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1167 microversion: 2.1 time: 0.192808 Jul 30 21:05:12.014251 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 618/1259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:11 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1167 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:12.032129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-16b301ad-d6ff-41d8-9ece-02a1c7aa29ad tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:12.076194 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-16b301ad-d6ff-41d8-9ece-02a1c7aa29ad tempest-FlavorsAccessNegativeTestJSON-1257224883 tempest-FlavorsAccessNegativeTestJSON-1257224883-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059142 Jul 30 21:05:12.077369 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 619/1260] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:05:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:12.134341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:12.137018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:12.150273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:12.151117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:12.155085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:12.158283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:12.350335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:12.369243 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1acb31ca-0a58-4ed3-a62b-47d72a2f104b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1276 microversion: 2.1 time: 0.243335 Jul 30 21:05:12.370090 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 620/1261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:12 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:12.384345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8bababa-8f07-44ba-ae18-d825adf4c993 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cefcca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:12.663663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:12.684846 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f238390-7626-4f08-8aa5-0f86f73e32a5 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 1.334687 Jul 30 21:05:12.688012 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 642/1262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:11 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:12.698384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8199d17-7ad0-4d73-9f4c-c08b6885be25 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cbf80d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:12.703011 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8bababa-8f07-44ba-ae18-d825adf4c993 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 200 len: 1455 microversion: 2.1 time: 0.331177 Jul 30 21:05:12.711773 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 621/1263] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:12 2022] GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 1455 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:12.734009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:12.737667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:12.754325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:12.756139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:12.759391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:12.760089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:12.796626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:13.275415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:13.289127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9c8f07e-53ed-49e5-95d8-fc165d0a2cdc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.575348 Jul 30 21:05:13.290059 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 622/1264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:12 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:13.308672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:13.309715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:13.319047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:13.319914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:13.324216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:13.324902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:13.536986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:13.561502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:13.581192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:13.584815 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f0614d6b-1927-40c8-b8e7-3c1b8e425a0b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1231 microversion: 2.25 time: 0.293440 Jul 30 21:05:13.587414 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 623/1265] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:13 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1231 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:13.631948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:13.638587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:13.687216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:13.701277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:13.702335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:13.702810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:14.020895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:14.031569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0bc3a2c-1bb8-41d6-bf37-1d97a18b450f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1167 microversion: 2.1 time: 0.443048 Jul 30 21:05:14.054551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 624/1266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:13 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1167 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:14.060468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8c69c9d-396d-4167-8135-d4031e2673ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-50562058", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8c69c9d-396d-4167-8135-d4031e2673ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action HTTP/1.1 Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 617 Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:05:14.071868 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:14.073544 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:05:14.074229 ncdv-master-1 devstack@n-api.service[130983]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-50562058", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 30 21:05:14.074229 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:05:14.074229 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-50562058', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 30 21:05:14.074466 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:14.075251 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.078159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:05:14.080448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:14.087076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8c69c9d-396d-4167-8135-d4031e2673ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:14.090823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d8c69c9d-396d-4167-8135-d4031e2673ea tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action" status: 400 len: 938 microversion: 2.1 time: 0.034800 Jul 30 21:05:14.093507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 625/1267] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 30 21:05:14 2022] POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action => generated 938 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:05:14.113262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:14.115988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:14.147659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:14.148707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:14.149828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:14.154029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:14.637894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:14.657999 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8316c10c-2228-4c7f-8823-5ea3349162f7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1318 microversion: 2.1 time: 0.558647 Jul 30 21:05:14.659045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 626/1268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:14 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:14.674193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-757db459-c215-4a50-9417-56c74899e0db tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ced50d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:19.414769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:20.727980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=30 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:21.096008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:21.684491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=5 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:21.739718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=24 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:22.675602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=66 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:24.128300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:24.644124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=21 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:28.958730 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8199d17-7ad0-4d73-9f4c-c08b6885be25 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 200 len: 1411 microversion: 2.1 time: 16.269591 Jul 30 21:05:28.959357 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 643/1269] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:12 2022] GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 1411 bytes in 16271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:28.971381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5c314016-1b4f-4e2d-8fc6-596728596e23 req-0e8528ba-78d2-43cc-b275-381f78d8075b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f98840b-782b-41a6-8bf2-5f3e4722d087", "name": "network-vif-plugged", "status": "completed", "tag": "60cd5c3a-0d14-4901-9c83-6f01d820a646"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:29.002061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5c314016-1b4f-4e2d-8fc6-596728596e23 req-0e8528ba-78d2-43cc-b275-381f78d8075b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.002245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5c314016-1b4f-4e2d-8fc6-596728596e23 req-0e8528ba-78d2-43cc-b275-381f78d8075b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.008343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-757db459-c215-4a50-9417-56c74899e0db tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 200 len: 1464 microversion: 2.1 time: 14.347936 Jul 30 21:05:29.018028 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 627/1270] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:14 2022] GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 1464 bytes in 14358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.022945 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5c314016-1b4f-4e2d-8fc6-596728596e23 req-0e8528ba-78d2-43cc-b275-381f78d8075b service nova] Creating event network-vif-plugged:60cd5c3a-0d14-4901-9c83-6f01d820a646 for instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 on nch1-master-1 Jul 30 21:05:29.028613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.031239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.031872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5c314016-1b4f-4e2d-8fc6-596728596e23 req-0e8528ba-78d2-43cc-b275-381f78d8075b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066999 Jul 30 21:05:29.033091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 644/1271] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:29.039965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.040556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.041427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.041882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.043684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.045864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.060878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.061965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.062928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.063620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.221143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.234186 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b273cffe-1227-4af1-a2e6-719420572374 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.213525 Jul 30 21:05:29.234792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 628/1272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.242691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.243546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.247226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.263450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.263922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.264721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.265299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.278560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.280512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.282494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1d214fdc-a888-42b0-8e8c-81c9a12895a2 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1279 microversion: 2.25 time: 0.247689 Jul 30 21:05:29.294879 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 645/1273] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:29.294879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.294879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.299258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.300943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.302592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.303546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.485836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.494958 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b904ecd-ff36-4352-98b9-f389ccd8d7ee tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1197 microversion: 2.1 time: 0.258469 Jul 30 21:05:29.496503 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 629/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.565243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.569383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cec9280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.572414 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:29.572414 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:29.573677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.574150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.574980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.575475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.578450 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3175c1f5-70c4-4c14-a9d6-09716a44977b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1318 microversion: 2.1 time: 0.293020 Jul 30 21:05:29.579078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 646/1275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.584411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-46305854-95a0-41d7-9b6e-92f7c6b19b9a req-08ef2678-1bc6-4d85-a53c-dccb88b59fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946868a8-2e74-4fe6-bb0d-94b638c3ebb2", "tag": "1e9100f3-43be-47fe-8736-4a19079b8b5e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:29.596304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-46305854-95a0-41d7-9b6e-92f7c6b19b9a req-08ef2678-1bc6-4d85-a53c-dccb88b59fb0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.597060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-46305854-95a0-41d7-9b6e-92f7c6b19b9a req-08ef2678-1bc6-4d85-a53c-dccb88b59fb0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.610448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-46305854-95a0-41d7-9b6e-92f7c6b19b9a req-08ef2678-1bc6-4d85-a53c-dccb88b59fb0 service nova] Creating event network-changed:1e9100f3-43be-47fe-8736-4a19079b8b5e for instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 on nch1-master-1 Jul 30 21:05:29.615031 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4c9777c-fc35-4b02-97fc-ac3154e18f45 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.117383 Jul 30 21:05:29.616110 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 630/1276] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:29.616511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-46305854-95a0-41d7-9b6e-92f7c6b19b9a req-08ef2678-1bc6-4d85-a53c-dccb88b59fb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Jul 30 21:05:29.617445 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 647/1277] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:29.627641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d74987fa-64ee-43d4-a4ce-c702a84b3b49 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd34f70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.681424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-606dcb13-470e-4b99-9aba-e34c2663aca4 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Action: 'create', calling method: .version_select at 0x7fbb5cfb1160>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:29.683729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d74987fa-64ee-43d4-a4ce-c702a84b3b49 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 200 len: 1464 microversion: 2.1 time: 0.064638 Jul 30 21:05:29.685923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 648/1278] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 1464 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.690871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.692113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.700156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.700633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.701436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.701920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.843048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:29.852237 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6d0154f0-4545-4ef8-9b86-ac3d57c5790e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.165039 Jul 30 21:05:29.863577 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 649/1279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:29.868289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cd41dc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.872064 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:29.872064 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:29.873374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.873871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.874695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.875142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.905734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90cdd51f-f649-4a0a-a6d8-ccb2a685cd48 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.051497 Jul 30 21:05:29.906645 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 650/1280] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:29.912616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:29.913469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:29.921310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.921773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:29.922565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:29.923014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.099233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:30.108416 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61e86fcf-0351-48dc-8f8b-b0d1b35f0c5b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1467 microversion: 2.1 time: 0.200907 Jul 30 21:05:30.113760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 651/1281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:29 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1467 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:30.114322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39df3aa3-45c3-4543-9caf-f66a4ba36456 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39df3aa3-45c3-4543-9caf-f66a4ba36456 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action HTTP/1.1 Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 285 Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:05:30.118442 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:05:30.119954 ncdv-master-1 devstack@n-api.service[130984]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:05:30.121019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:05:30.121712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:05:30.125487 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:05:30.126473 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:05:30.126473 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:30.126473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39df3aa3-45c3-4543-9caf-f66a4ba36456 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:30.126473 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39df3aa3-45c3-4543-9caf-f66a4ba36456 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action" status: 400 len: 619 microversion: 2.1 time: 0.010013 Jul 30 21:05:30.126846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 652/1282] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 30 21:05:30 2022] POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:05:30.126846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cce5c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:30.128755 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:30.128755 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:30.130114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.130580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.131420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.131873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.157037 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f28adf1-24e5-4240-a974-cdbfadbc7e36 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034938 Jul 30 21:05:30.157647 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 653/1283] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 30 21:05:30 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:05:30.162948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad90a6ce-986f-46f4-8977-99de83ee586a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cce53a0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:30.209345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad90a6ce-986f-46f4-8977-99de83ee586a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 200 len: 1420 microversion: 2.1 time: 0.050571 Jul 30 21:05:30.209914 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 654/1284] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:30 2022] GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:30.216566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2030126659"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:30.219385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:30.226175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.226637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.227498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.227950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.431473 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1bf88cb5-3517-4833-b00b-b455987a43f0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "POST /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24/action" status: 202 len: 0 microversion: 2.1 time: 0.219930 Jul 30 21:05:30.432227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 655/1285] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:30 2022] POST /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:05:30.438340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:30.439484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:30.446870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.447741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.449412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.450118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.952781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:30.963684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9eb15756-39c7-47a6-b67b-c481ef8119fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.529466 Jul 30 21:05:30.965221 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 656/1286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:30 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:30.985803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cd471f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:30.988793 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:30.988793 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:30.990370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.991099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:30.992367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:30.993063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.028202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc26c397-7686-4a17-9e8b-d8d44da9fdd4 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.060427 Jul 30 21:05:31.029676 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 657/1287] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:05:30 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:31.034976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eea55653-5d66-45b1-9d82-069b34a0f6b7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cbf8310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.118905 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eea55653-5d66-45b1-9d82-069b34a0f6b7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 200 len: 1420 microversion: 2.1 time: 0.087882 Jul 30 21:05:31.121608 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 658/1288] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:31.127042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.128112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:31.143623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.144346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.145333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.145992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.275476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-606dcb13-470e-4b99-9aba-e34c2663aca4 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.657265 Jul 30 21:05:31.283723 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 631/1289] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:05:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:31.283723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd3306e9-d359-4774-aad7-9144f9780e7e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ced5700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.332450 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd3306e9-d359-4774-aad7-9144f9780e7e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.054567 Jul 30 21:05:31.333020 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 632/1290] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:31.337672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.338478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:31.345236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.345839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.346085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.347061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.347534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.356313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.357889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.359038 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-817103cd-51fc-4682-bfec-9a46887ae118 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1279 microversion: 2.25 time: 0.236316 Jul 30 21:05:31.359828 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 659/1291] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:31.364935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.365598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:31.372478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.372903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.373702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.375132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.526393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.537970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-08cabbc3-2c19-4f67-83ff-8d05d3f95099 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1197 microversion: 2.1 time: 0.203552 Jul 30 21:05:31.538792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 633/1292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:31.540337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.550255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.550515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bae40220-cf10-4b49-b98a-59ce9536a019 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1318 microversion: 2.1 time: 0.189294 Jul 30 21:05:31.551256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:31.551644 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 660/1293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:31.557492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cc07e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.560746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.560910 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:31.560910 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:31.561631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.561914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.562560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.562819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.563273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.563888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.564348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.592051 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41e01744-b6e3-413e-9082-e21a1439277b tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.039239 Jul 30 21:05:31.592657 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 661/1294] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:31.599905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-plugged", "status": "completed", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}, {"server_uuid": "946868a8-2e74-4fe6-bb0d-94b638c3ebb2", "name": "network-vif-plugged", "status": "completed", "tag": "1e9100f3-43be-47fe-8736-4a19079b8b5e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:31.615932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.616405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.633196 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] Creating event network-vif-plugged:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:05:31.634114 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] Creating event network-vif-plugged:1e9100f3-43be-47fe-8736-4a19079b8b5e for instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 on nch1-master-1 Jul 30 21:05:31.644849 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-eab0c6a7-7039-4fe2-b1db-d3eb05c904d9 req-8423c322-f547-47cb-932b-b536b524c817 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049886 Jul 30 21:05:31.645731 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 662/1295] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:31.665193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2baf45fd-4b89-4ba6-9eab-1ac8c6b2be50 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cbf8430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.731866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:31.740229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4bc4f4dd-0ea5-4262-9449-31f787cf20dc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.199986 Jul 30 21:05:31.742235 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 634/1296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:31.762068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30242bdf-e6dc-40d0-93f2-fbad4f727d54 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5cef4f70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.961768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30242bdf-e6dc-40d0-93f2-fbad4f727d54 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/06385c43-5f8c-404a-9a13-1fcc934cc335" status: 200 len: 142 microversion: 2.1 time: 0.218204 Jul 30 21:05:31.962367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 635/1297] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/os-floating-ips/06385c43-5f8c-404a-9a13-1fcc934cc335 => generated 142 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:31.966790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cef4550>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:31.972874 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:31.972874 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:31.982176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.982721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:31.983974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:31.984523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.017927 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6a2c9e4b-e297-4724-879d-64a383d97b29 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.054480 Jul 30 21:05:32.018554 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 636/1298] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:05:31 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:32.023449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58612e09-b9e2-4a54-adea-ca6664d46930", "tag": "507d6eec-0fdd-4088-9ad6-489f49cc80aa"}, {"name": "network-changed", "server_uuid": "74aa1223-14ce-4f65-a00a-032dcb87adb7", "tag": "5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9"}, {"name": "network-changed", "server_uuid": "95e02e9d-1ab9-47de-b94d-8e12af04955b", "tag": "34bd0d71-e49d-43c6-9423-cd886e7af073"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:32.039347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.039980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.056746 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Creating event network-changed:507d6eec-0fdd-4088-9ad6-489f49cc80aa for instance 58612e09-b9e2-4a54-adea-ca6664d46930 on nch2-master-1 Jul 30 21:05:32.057315 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Creating event network-changed:5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9 for instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 on nch1-master-1 Jul 30 21:05:32.058381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] Creating event network-changed:34bd0d71-e49d-43c6-9423-cd886e7af073 for instance 95e02e9d-1ab9-47de-b94d-8e12af04955b on nch1-master-1 Jul 30 21:05:32.068807 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-231350e0-b7f7-4324-ae68-ece371038465 req-49f3bc43-d01b-4c2c-81f2-eda0809a165d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.049028 Jul 30 21:05:32.069686 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 637/1299] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:32.077555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-681814783"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:32.080212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.087948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.088610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.090168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.090780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.351730 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ec156ce7-f287-4262-b8e2-db22423ff223 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action" status: 202 len: 0 microversion: 2.1 time: 0.280238 Jul 30 21:05:32.358918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 638/1300] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:32 2022] POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:05:32.364514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2065b8e-9d15-4c00-8a81-5273c546df3a tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5cf068b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.377338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2baf45fd-4b89-4ba6-9eab-1ac8c6b2be50 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 204 len: 0 microversion: 2.1 time: 0.730397 Jul 30 21:05:32.377921 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 663/1301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:31 2022] DELETE /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:05:32.385765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5cc079d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.387001 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:32.387001 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:32.394072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.394865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.409752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.410575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.447912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cca7d8a4-8ac1-49d9-b27b-8b2c5d37c254 tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 860 microversion: 2.1 time: 0.065621 Jul 30 21:05:32.449205 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 664/1302] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 860 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:32.454849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e1ba283-78c3-4cec-b967-f4cd903112b6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd47040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.511357 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e1ba283-78c3-4cec-b967-f4cd903112b6 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.060209 Jul 30 21:05:32.512185 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 665/1303] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:32.523514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268751883"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:32.526011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.533564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.534038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.534848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.535352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.568491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Cannot 'createImage' instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 while it is in task_state image_snapshot_pending Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action HTTP/1.1 Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 84 Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:05:32.570220 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268751883"}} Jul 30 21:05:32.571719 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'createImage' instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 while it is in task_state image_snapshot_pending Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-268751883'}}} Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:32.572498 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 while it is in task_state image_snapshot_pending Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 while it is in task_state image_snapshot_pending Jul 30 21:05:32.573754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:32.574972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 409 to user: Cannot 'createImage' instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 while it is in task_state image_snapshot_pending {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:32.574972 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a3e7f54-100e-4f2f-910c-edbc1f3be043 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action" status: 409 len: 167 microversion: 2.1 time: 0.058388 Jul 30 21:05:32.574972 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 666/1304] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:32 2022] POST /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2/action => generated 167 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:05:32.577470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.578103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.584545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.585017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.585815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.586274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.593860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2065b8e-9d15-4c00-8a81-5273c546df3a tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.233287 Jul 30 21:05:32.594448 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 639/1305] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:32.599812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.600693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.611006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.611587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.613644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.614289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.640534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:05:32.722046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea3ba73e-55af-49b3-8818-4dd595b8f314 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 204 len: 0 microversion: 2.1 time: 0.126028 Jul 30 21:05:32.722538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 640/1306] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:05:32 2022] DELETE /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:05:32.741029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Calling method '.version_select at 0x7fbb5ce5c670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.741818 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:32.741818 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:05:32.749213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.749681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.772935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.774466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.808369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0c4e7c9-47a6-40ba-8bc2-811f3cd5d33e tempest-HostsAdminTestJSON-686012757 tempest-HostsAdminTestJSON-686012757-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.084413 Jul 30 21:05:32.809300 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 641/1307] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:32.815580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.817509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.824820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.825294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.826114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.826628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.878538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:32.889140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:32.890685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:32.892594 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df28fc2d-ec9f-482b-ac49-f0de8a270454 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1279 microversion: 2.25 time: 0.318939 Jul 30 21:05:32.893900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 667/1308] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:32.900514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:32.901153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:32.910468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.911631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:32.912453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:32.912927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:33.035770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:33.045928 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1cad47b-fbaf-4024-9a00-533309f05179 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1197 microversion: 2.1 time: 0.234194 Jul 30 21:05:33.046539 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 642/1309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:33.060709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-25382185-ad1b-49d3-9334-60f300b0fa16 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb5cea65e0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:33.107645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:33.118743 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-869f993b-29cc-4c7e-9375-f013bf22ef2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1318 microversion: 2.1 time: 0.223289 Jul 30 21:05:33.124616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 668/1310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:32 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:33.140164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d280d1bb-8a5a-4ae6-ab28-67baf3b08683 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5cd47e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:33.269274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-25382185-ad1b-49d3-9334-60f300b0fa16 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/images/219cfbe1-5f42-4fe6-b799-09e9a9de2466" status: 204 len: 0 microversion: 2.1 time: 0.221645 Jul 30 21:05:33.270297 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 643/1311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:33 2022] DELETE /compute/v2.1/images/219cfbe1-5f42-4fe6-b799-09e9a9de2466 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:05:33.275868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1746087334", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "0ad1dccc-1f18-4d8d-a178-5d43d230baa8"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:33.344383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] validate_networks() for [('0ad1dccc-1f18-4d8d-a178-5d43d230baa8', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:34.047665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:34.049223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:34.049805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:34.050631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:34.051315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:34.052062 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d280d1bb-8a5a-4ae6-ab28-67baf3b08683 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/06385c43-5f8c-404a-9a13-1fcc934cc335" status: 202 len: 0 microversion: 2.1 time: 0.926089 Jul 30 21:05:34.052684 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 669/1312] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:05:33 2022] DELETE /compute/v2.1/os-floating-ips/06385c43-5f8c-404a-9a13-1fcc934cc335 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:34.059158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:34.059752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:34.064089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.064737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.066161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.067240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.072778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.074286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.075683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.076547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.117140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:34.121578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for user 8379e04d2b30488387b3eefab6669768 and project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:34.135020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:34.137701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:34.198958 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8eb72c28-58cd-43ca-b3b8-e2cacc3056bf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927074 Jul 30 21:05:34.200551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 644/1313] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:05:34.207239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ea5c709-dfbe-43bb-92b6-7efd87b47410 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cefc820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:34.253207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:34.259784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:34.266034 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8a27c4d-1090-42d8-8497-4296ce24d47e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1534 microversion: 2.1 time: 0.212303 Jul 30 21:05:34.267966 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 670/1314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:34 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1534 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:34.273680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58612e09-b9e2-4a54-adea-ca6664d46930", "name": "network-vif-plugged", "status": "completed", "tag": "507d6eec-0fdd-4088-9ad6-489f49cc80aa"}, {"server_uuid": "74aa1223-14ce-4f65-a00a-032dcb87adb7", "name": "network-vif-plugged", "status": "completed", "tag": "5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9"}, {"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-unplugged", "status": "completed", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}, {"server_uuid": "95e02e9d-1ab9-47de-b94d-8e12af04955b", "name": "network-vif-plugged", "status": "completed", "tag": "34bd0d71-e49d-43c6-9423-cd886e7af073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:34.291922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.293017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.305327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ea5c709-dfbe-43bb-92b6-7efd87b47410 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.103414 Jul 30 21:05:34.305962 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 645/1315] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:34 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:34.310749 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Creating event network-vif-plugged:507d6eec-0fdd-4088-9ad6-489f49cc80aa for instance 58612e09-b9e2-4a54-adea-ca6664d46930 on nch2-master-1 Jul 30 21:05:34.311228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Creating event network-vif-plugged:5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9 for instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 on nch1-master-1 Jul 30 21:05:34.311812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Creating event network-vif-unplugged:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:05:34.312326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] Creating event network-vif-plugged:34bd0d71-e49d-43c6-9423-cd886e7af073 for instance 95e02e9d-1ab9-47de-b94d-8e12af04955b on nch1-master-1 Jul 30 21:05:34.320239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:34.320889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:34.324892 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a7414022-6218-47c8-8833-72b47f54cdfd req-16d23c1f-3b99-4008-9422-2aaf0fd190fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.054763 Jul 30 21:05:34.332016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 671/1316] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:34.338055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0672dd1d-486a-4415-bdb9-68d03062022e tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Action: 'create', calling method: .version_select at 0x7fbb5cd065e0>, body: {"pool": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:34.340005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.340611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.341434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.343991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.604760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:34.615315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:34.617078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:34.618460 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7cb96187-6c23-449a-91d2-12908ebf9970 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1279 microversion: 2.25 time: 0.310526 Jul 30 21:05:34.619029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 646/1317] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:34 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1279 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:34.652262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:34.652902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:34.661272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.661958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.663455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.664084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.929120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:34.942380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74db0e4b-e07b-4c27-8861-9734ffbe7dfc tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1197 microversion: 2.1 time: 0.321867 Jul 30 21:05:34.943313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 647/1318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:34 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1197 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:34.952936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:34.954401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:34.963245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.964638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:34.965715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:34.966581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.231649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:35.243081 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c5e1953-25fe-4773-9634-1d5353892e5b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1467 microversion: 2.1 time: 0.296816 Jul 30 21:05:35.243879 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 648/1319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:34 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1467 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:35.250481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:35.253167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:35.260108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.260953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.262328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.263776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.397771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:35.406822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e99c5f2a-d78a-41ae-877b-6ebe2c71b098 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1212 microversion: 2.1 time: 0.161557 Jul 30 21:05:35.420454 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 649/1320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:35 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:35.420454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:35.420454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:35.427373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.427664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.428465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.428912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.456784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:35.628630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:35.636894 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c86bded6-7b94-444e-a213-02fa394c42a7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1318 microversion: 2.1 time: 0.223846 Jul 30 21:05:35.637507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 650/1321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:35 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:35.656759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:35.657386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:35.664959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.665421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.666208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.666653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.862298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:35.873683 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7d3720c-449c-4b55-8873-29a27d0cc1d9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1540 microversion: 2.1 time: 0.220274 Jul 30 21:05:35.874509 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 651/1322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:35 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1540 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:35.880429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b565fed0-ebf6-43b8-82d3-334c7fd09f74 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cf069d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:35.940700 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b565fed0-ebf6-43b8-82d3-334c7fd09f74 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.065247 Jul 30 21:05:35.941602 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 652/1323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:35 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:35.950493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:35.951119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:35.968039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.968489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:35.969489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:35.969736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:36.174258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:36.193624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:36.194690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:36.195888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-efbedc26-3b42-4b96-ba42-537e41631754 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1279 microversion: 2.25 time: 0.253335 Jul 30 21:05:36.196470 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 653/1324] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:35 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:36.222803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:36.223500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:36.237694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:36.238370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:36.246641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:36.247346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:36.464504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:36.474052 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ffffa82-65d3-4aec-a0e8-841260dba8e9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1197 microversion: 2.1 time: 0.272486 Jul 30 21:05:36.476201 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 654/1325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:36 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:36.483018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f98840b-782b-41a6-8bf2-5f3e4722d087", "name": "network-vif-unplugged", "status": "completed", "tag": "60cd5c3a-0d14-4901-9c83-6f01d820a646"}, {"server_uuid": "4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24", "name": "network-vif-plugged", "status": "completed", "tag": "a4a7f134-088e-4bed-bba6-67d689e70a28"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:36.500536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:36.501436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:36.519379 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] Creating event network-vif-unplugged:60cd5c3a-0d14-4901-9c83-6f01d820a646 for instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 on nch1-master-1 Jul 30 21:05:36.520446 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] Creating event network-vif-plugged:a4a7f134-088e-4bed-bba6-67d689e70a28 for instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 on nch2-master-1 Jul 30 21:05:36.531624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-76326efd-12f9-4c50-aa0c-3f09829024ca req-c551b515-b98d-461b-bc26-bd7b5fb2f7ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.053654 Jul 30 21:05:36.546698 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 655/1326] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:36.964899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3df3c4e6-f4d6-4c9e-b901-84189c5bbcc0 req-21583ed7-969a-4b22-9877-c2b9eb92e07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f98840b-782b-41a6-8bf2-5f3e4722d087", "name": "network-vif-deleted", "tag": "60cd5c3a-0d14-4901-9c83-6f01d820a646"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:37.003439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3df3c4e6-f4d6-4c9e-b901-84189c5bbcc0 req-21583ed7-969a-4b22-9877-c2b9eb92e07f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.005945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3df3c4e6-f4d6-4c9e-b901-84189c5bbcc0 req-21583ed7-969a-4b22-9877-c2b9eb92e07f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.041665 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3df3c4e6-f4d6-4c9e-b901-84189c5bbcc0 req-21583ed7-969a-4b22-9877-c2b9eb92e07f service nova] Creating event network-vif-deleted:60cd5c3a-0d14-4901-9c83-6f01d820a646 for instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 on nch1-master-1 Jul 30 21:05:37.049246 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3df3c4e6-f4d6-4c9e-b901-84189c5bbcc0 req-21583ed7-969a-4b22-9877-c2b9eb92e07f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.500583 Jul 30 21:05:37.050349 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 656/1327] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:37.056446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:37.059032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:37.070823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.071566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.073429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.074111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.175816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:37.186879 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0d7e209-60e9-4185-ae8e-125f446a2a10 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1278 microversion: 2.1 time: 0.135063 Jul 30 21:05:37.187733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 657/1328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:37 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:37.193801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:37.195901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:37.208103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.208986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.210504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.212164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.778161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:37.787662 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a58db01-bf6e-4a9e-a18e-68c35d2a731e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1467 microversion: 2.1 time: 0.597526 Jul 30 21:05:37.790301 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 658/1329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:37 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1467 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:37.796279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:37.797046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:37.812079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.812560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:37.813393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:37.814204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.104550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.115640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e154160-d654-429a-a96d-717813dfdd4f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1540 microversion: 2.1 time: 0.324600 Jul 30 21:05:38.121739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 659/1330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:37 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1540 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:38.142378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59f93658-6a6d-4f04-94df-8900a903699c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cf06670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:38.252885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-59f93658-6a6d-4f04-94df-8900a903699c tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.129311 Jul 30 21:05:38.253698 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 660/1331] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:38 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:38.267060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:38.273999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:38.311947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.312539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.313573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.314137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.493732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.506141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.508312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.510305 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff9ddd21-6171-4134-b529-af6f3a33bfd7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1476 microversion: 2.25 time: 0.251946 Jul 30 21:05:38.511451 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 661/1332] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:38 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:38.533765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:38.534403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:38.541722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.542958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.543961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.544944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.744987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.755324 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-528406d6-7f83-4095-a0e0-447997e7655d tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1380 microversion: 2.1 time: 0.242503 Jul 30 21:05:38.756677 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 662/1333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:38 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1380 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:38.776282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:38.783760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:38.785495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Searching by: {'reservation_id': 'r-1r2gs88v', 'deleted': False, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:05:38.793081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.793886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.795055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.795694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.872476 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0672dd1d-486a-4415-bdb9-68d03062022e tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.537961 Jul 30 21:05:38.879844 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 672/1334] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:05:34 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:38.891943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:38.892693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:38.903667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.904203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.905504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:38.906472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:38.968550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:05:39.084072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:39.092559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:39.097287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:39.243740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:39.258087 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1451e90b-1c93-44ae-aa4e-ce3fc83a72b2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.368524 Jul 30 21:05:39.259223 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 673/1335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:38 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:39.274947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:39.277158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:39.295835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:39.296347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:39.299382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:39.299861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:39.378983 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2a3f4c8-c5a6-42ad-8642-6a1a8317d9b2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-1r2gs88v" status: 200 len: 2927 microversion: 2.1 time: 0.620956 Jul 30 21:05:39.381532 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 663/1336] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Jul 30 21:05:38 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1r2gs88v => generated 2927 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:39.575722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e135406a-71bf-4090-8f8d-3e4a7d9d42de tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] Calling method '.version_select at 0x7fbb5cefa430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:39.715515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 95e02e9d-1ab9-47de-b94d-8e12af04955b {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:39.735907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa603b4d-820f-4284-b77b-c294b52c4fda tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1967 microversion: 2.25 time: 0.470989 Jul 30 21:05:39.740600 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 674/1337] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:39 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1967 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:39.747337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:39.748218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:39.748337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e135406a-71bf-4090-8f8d-3e4a7d9d42de tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 6726 microversion: 2.1 time: 0.364453 Jul 30 21:05:39.748805 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 664/1338] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:05:39 2022] GET /compute/v2.1/os-networks => generated 6726 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:39.753835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-db09b1ff-8087-4b3a-a3e6-802e82a11d79 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5cf06a60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:39.772591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:39.774417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:39.775265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:39.775761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.051418 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-031f29f2-8290-4a31-aad0-f3403c8742cf tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1531 microversion: 2.1 time: 0.308892 Jul 30 21:05:40.064080 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 675/1339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:39 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1531 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:40.069338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.070165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:40.076868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.077654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.078705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.079436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.359592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:40.378067 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-380ebf55-8a38-48f7-bb3b-4413254cf77a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1522 microversion: 2.1 time: 0.312329 Jul 30 21:05:40.394911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 676/1340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:40.405813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c43e19b-5cd0-4bdb-a5c5-2ef656345864 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cde5c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.467012 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c43e19b-5cd0-4bdb-a5c5-2ef656345864 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.070450 Jul 30 21:05:40.467647 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 677/1341] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:40.485811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-295fa86e-80f2-4d7e-a589-ece429b69adc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.502111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.server_groups [None req-295fa86e-80f2-4d7e-a589-ece429b69adc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Querying cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) for 2 instances {{(pid=130984) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 30 21:05:40.503338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295fa86e-80f2-4d7e-a589-ece429b69adc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.506736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295fa86e-80f2-4d7e-a589-ece429b69adc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.540796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-295fa86e-80f2-4d7e-a589-ece429b69adc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/0859b13a-4963-4424-9588-1e36ab291a74" status: 200 len: 266 microversion: 2.1 time: 0.068879 Jul 30 21:05:40.542691 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 678/1342] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/os-server-groups/0859b13a-4963-4424-9588-1e36ab291a74 => generated 266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:40.558383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2fd858f9-9b6f-45a1-9f19-3a468a0ca3d8 req-e993a47c-fd13-4e4c-829b-050428af545c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c2085-7678-42d9-bc8e-9c26adfd49f2", "name": "network-vif-plugged", "status": "completed", "tag": "1ceea3b8-69a2-41f2-9096-5571942472f0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:40.583031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2fd858f9-9b6f-45a1-9f19-3a468a0ca3d8 req-e993a47c-fd13-4e4c-829b-050428af545c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.583737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2fd858f9-9b6f-45a1-9f19-3a468a0ca3d8 req-e993a47c-fd13-4e4c-829b-050428af545c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.597753 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2fd858f9-9b6f-45a1-9f19-3a468a0ca3d8 req-e993a47c-fd13-4e4c-829b-050428af545c service nova] Creating event network-vif-plugged:1ceea3b8-69a2-41f2-9096-5571942472f0 for instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 on nch1-master-1 Jul 30 21:05:40.602733 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2fd858f9-9b6f-45a1-9f19-3a468a0ca3d8 req-e993a47c-fd13-4e4c-829b-050428af545c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056308 Jul 30 21:05:40.603673 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 679/1343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:40.610180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f90e403-4ea2-4efb-9e1a-ee75ba0e6d25 tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] Calling method '.version_select at 0x7fbb5cd77820>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.806620 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-db09b1ff-8087-4b3a-a3e6-802e82a11d79 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe" status: 202 len: 0 microversion: 2.1 time: 1.056675 Jul 30 21:05:40.809012 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f90e403-4ea2-4efb-9e1a-ee75ba0e6d25 tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks/a0034a96-be0d-4757-bce7-9e6e768c30b8" status: 200 len: 652 microversion: 2.1 time: 0.202279 Jul 30 21:05:40.810502 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 680/1344] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/os-networks/a0034a96-be0d-4757-bce7-9e6e768c30b8 => generated 652 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:40.810961 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 665/1345] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:05:39 2022] DELETE /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:40.818268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.818713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:40.818885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:40.819698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:40.829245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.830050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.831835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.836473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.836926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.837479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:40.838598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:40.839680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.021873 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1696dc7-1116-4873-a162-2b1b3cc09c2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1531 microversion: 2.1 time: 0.209116 Jul 30 21:05:41.022687 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 666/1346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1531 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.029847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-68a4cc27-8703-4a7f-91ae-3c7ffc369ef9 req-84257eff-2537-4838-9097-15ea77972dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d8e6b3-e409-4478-a027-a64a6e76ab67", "tag": "04af983f-2705-47b6-8aa0-cdfbd34d3707"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:41.042140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-68a4cc27-8703-4a7f-91ae-3c7ffc369ef9 req-84257eff-2537-4838-9097-15ea77972dc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.043379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-68a4cc27-8703-4a7f-91ae-3c7ffc369ef9 req-84257eff-2537-4838-9097-15ea77972dc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.053443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 95e02e9d-1ab9-47de-b94d-8e12af04955b {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:41.070005 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-68a4cc27-8703-4a7f-91ae-3c7ffc369ef9 req-84257eff-2537-4838-9097-15ea77972dc9 service nova] Creating event network-changed:04af983f-2705-47b6-8aa0-cdfbd34d3707 for instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 on nch2-master-1 Jul 30 21:05:41.075875 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-68a4cc27-8703-4a7f-91ae-3c7ffc369ef9 req-84257eff-2537-4838-9097-15ea77972dc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051108 Jul 30 21:05:41.078176 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 667/1347] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:41.080716 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94addbb0-e325-40f8-bec2-a56c2948246c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1967 microversion: 2.25 time: 0.268369 Jul 30 21:05:41.081567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 681/1348] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:40 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1967 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:41.086768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.087413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.087792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.088497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.095056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.095566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.096475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.096833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.097473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.097649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.098927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.099589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.140231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:05:41.234703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41f81608-6993-469c-b082-9ec61f70cd56 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 204 len: 0 microversion: 2.1 time: 0.150944 Jul 30 21:05:41.235939 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 682/1349] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:05:41 2022] DELETE /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:05:41.243009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.244050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.259446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.260063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.263929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.263929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.306008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:41.334102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31b21ce9-5e8c-4881-9b09-4f77270346eb tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.252098 Jul 30 21:05:41.339761 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 668/1350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.342404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5ced5670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.394397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dfb0b753-47e7-475e-b1b3-bf32988834fe could not be found", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:05:41.395516 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] HTTP exception thrown: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Request method failure captured: Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe HTTP/1.1 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0VQOJJ8F4M17daIhEyJyJ3KLt5A2tENvGS3UQjkj94CWpo66VJKHuW157VGd-IJ8LM7_zV94a98Ade1y6T3UOLGwwoCjZYBX1ep8dqh9a9xDiVjH2-QrfBAu-lbLDFT2Ta22zUdG2Z2btktnY6fTqQtL9WC8fKkSeTfD6I_hMSjQ4 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2f684cc4b6d44b398d3c6cd0e8aac7b0 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:05:41.397756 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f684cc4b6d44b398d3c6cd0e8aac7b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2f684cc4b6d44b398d3c6cd0e8aac7b0 Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsTestJSON-1756215457-project Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 1906745af3e24906adf16c6c68e12968 Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsTestJSON-1756215457-project Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: exception: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'dfb0b753-47e7-475e-b1b3-bf32988834fe'} Jul 30 21:05:41.399139 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:05:41.400068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dfb0b753-47e7-475e-b1b3-bf32988834fe could not be found Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0e221c-262c-422a-a169-30ca342aafda'] Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe. Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.401343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:41.403265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:41.407516 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.407516 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.408671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Returning 404 to user: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:41.409786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41280de9-080d-408e-9907-bbbf009a04fb tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe" status: 404 len: 111 microversion: 2.1 time: 0.072943 Jul 30 21:05:41.410597 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 669/1351] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:41.417567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b71e4840-9d86-4d2f-a519-c8b2d7e92765 tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] Calling method '.version_select at 0x7fbb5cedfe50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.506539 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ab417ec3-dcba-4d3c-9e03-12a7f8914d5f tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1618 microversion: 2.1 time: 0.269322 Jul 30 21:05:41.522518 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 683/1352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1618 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.523747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.527476 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:41.527476 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:41.529140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.529847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.530787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.531367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.558266 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41796d39-63cc-4246-9c5f-d3530f4f07bd tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039646 Jul 30 21:05:41.565960 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 684/1353] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:41.565960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.569436 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:05:41.569436 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:05:41.570548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.571316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.572245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.572783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.585878 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b71e4840-9d86-4d2f-a519-c8b2d7e92765 tempest-NetworksTest-534449999 tempest-NetworksTest-534449999-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 6726 microversion: 2.1 time: 0.173804 Jul 30 21:05:41.586873 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 670/1354] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/os-networks => generated 6726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.601051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.602855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.603871 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a5d6a1b-026d-49f0-8d16-8cc344565e17 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043556 Jul 30 21:05:41.615001 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 685/1355] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:05:41.615001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Calling method '.version_select at 0x7fbb5cd77e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.615332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.615332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.615332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.615332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.667937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dfb0b753-47e7-475e-b1b3-bf32988834fe could not be found", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:05:41.668700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] HTTP exception thrown: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Request method failure captured: Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe HTTP/1.1 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z0VQOJJ8F4M17daIhEyJyJ3KLt5A2tENvGS3UQjkj94CWpo66VJKHuW157VGd-IJ8LM7_zV94a98Ade1y6T3UOLGwwoCjZYBX1ep8dqh9a9xDiVjH2-QrfBAu-lbLDFT2Ta22zUdG2Z2btktnY6fTqQtL9WC8fKkSeTfD6I_hMSjQ4 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2f684cc4b6d44b398d3c6cd0e8aac7b0 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:05:41.670742 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f684cc4b6d44b398d3c6cd0e8aac7b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f684cc4b6d44b398d3c6cd0e8aac7b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2f684cc4b6d44b398d3c6cd0e8aac7b0 Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1756215457 Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsTestJSON-1756215457-project Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 1906745af3e24906adf16c6c68e12968 Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsTestJSON-1756215457-project Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: exception: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'dfb0b753-47e7-475e-b1b3-bf32988834fe'} Jul 30 21:05:41.672403 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:05:41.673269 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dfb0b753-47e7-475e-b1b3-bf32988834fe could not be found Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba53921-48cc-4da2-ac75-615ca93bd649'] Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe. Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.674449 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:41.675715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:41.677149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe Jul 30 21:05:41.677149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:41.677149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] Returning 404 to user: Floating IP not found for ID dfb0b753-47e7-475e-b1b3-bf32988834fe {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:41.677149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48b33b8c-5723-43a4-873d-2fbb300529f3 tempest-FloatingIPsTestJSON-1756215457 tempest-FloatingIPsTestJSON-1756215457-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe" status: 404 len: 111 microversion: 2.1 time: 0.066135 Jul 30 21:05:41.677830 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 686/1356] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:05:41 2022] DELETE /compute/v2.1/os-floating-ips/dfb0b753-47e7-475e-b1b3-bf32988834fe => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:41.683667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73247c87-bb95-42de-88e0-010cb051fe78 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cc075e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.821826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73247c87-bb95-42de-88e0-010cb051fe78 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.142650 Jul 30 21:05:41.831336 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 687/1357] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.841443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:41.842362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.845976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:41.853901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.855002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.856344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-994a192f-b6e9-4616-b753-00ec4f139cda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1528 microversion: 2.1 time: 0.268415 Jul 30 21:05:41.856478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.857022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.860607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 671/1358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1528 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:41.880316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:41.884456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:41.895762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.896303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.899460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:41.899953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:41.936589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lazy-loading 'flavor' on Instance uuid 58612e09-b9e2-4a54-adea-ca6664d46930 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:41.954975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Going to try to live migrate instance to nch1-master-1 {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:05:42.035216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:42.139315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75fb424e-de86-4298-9fa4-5453a51299ea tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 200 len: 1618 microversion: 2.1 time: 0.305842 Jul 30 21:05:42.140235 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 688/1359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:41 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 1618 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:42.147679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:42.150277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:42.159469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:42.160086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:42.161256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:42.161721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:42.235826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'flavor' on Instance uuid 95e02e9d-1ab9-47de-b94d-8e12af04955b {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:42.271271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Going to try to live migrate instance to nch2-master-1 {{(pid=130984) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:05:44.613867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b/action" status: 202 len: 0 microversion: 2.25 time: 2.471956 Jul 30 21:05:44.615671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 689/1360] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:05:42 2022] POST /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b/action => generated 0 bytes in 2475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:05:44.623459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: .version_select at 0x7fbb5cda7c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-770913594", "policies": ["anti-affinity"]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:44.634686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930/action" status: 202 len: 0 microversion: 2.1 time: 2.772545 Jul 30 21:05:44.639007 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 672/1361] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:41 2022] POST /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930/action => generated 0 bytes in 2778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:05:44.653365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:44.654607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:44.690854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:44.691938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:44.695461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:44.697079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:44.704329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:44.711679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:44.715898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:44.856106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:44.861115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:44.877200 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76fbb962-6e7e-49d1-ae5b-5d1b8505452f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.259917 Jul 30 21:05:44.890492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 690/1362] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:05:44 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:44.898417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cb05b8df-4c3b-4a23-ac8d-26ffe89ef044 req-b2d675d4-8047-4267-bb55-10302d099fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c2085-7678-42d9-bc8e-9c26adfd49f2", "name": "network-vif-unplugged", "status": "completed", "tag": "1ceea3b8-69a2-41f2-9096-5571942472f0"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:44.912362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cb05b8df-4c3b-4a23-ac8d-26ffe89ef044 req-b2d675d4-8047-4267-bb55-10302d099fc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:44.913179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cb05b8df-4c3b-4a23-ac8d-26ffe89ef044 req-b2d675d4-8047-4267-bb55-10302d099fc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:44.940254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cb05b8df-4c3b-4a23-ac8d-26ffe89ef044 req-b2d675d4-8047-4267-bb55-10302d099fc3 service nova] Creating event network-vif-unplugged:1ceea3b8-69a2-41f2-9096-5571942472f0 for instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 on nch1-master-1 Jul 30 21:05:44.964831 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cb05b8df-4c3b-4a23-ac8d-26ffe89ef044 req-b2d675d4-8047-4267-bb55-10302d099fc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072055 Jul 30 21:05:44.965424 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 691/1363] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:44.978027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d69cfbb8-179b-425c-b282-57249132fe45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd13ee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:45.113446 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d69cfbb8-179b-425c-b282-57249132fe45 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.133900 Jul 30 21:05:45.116401 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 692/1364] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:44 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:45.137553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:45.147909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:45.198266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.199457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.199851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.204639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.241581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.251457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-caab5acf-26e4-4fef-b0ad-50891eb5a020 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.607403 Jul 30 21:05:45.251969 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 673/1365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:44 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:45.279403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:45.295494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:45.340212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:45.346865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.347376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.350236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.357231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.393983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.394453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.394932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lazy-loading 'fault' on Instance uuid 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:45.413445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:45.648716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.666029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.668658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.670170 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04b445c5-3789-45b4-bc7c-bf34478d2389 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.417167 Jul 30 21:05:45.671236 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 674/1366] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:45 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:45.676489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:45.677298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:45.684989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.685705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.686751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.687401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.862823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.873971 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a87f4dcb-0a16-4b4e-a912-9c8e8527e832 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.200130 Jul 30 21:05:45.873971 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 675/1367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:45 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:45.878680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4c9a5e10-2196-4879-8814-0bc19c7c69f5 req-f6ceb145-9a1f-46a5-9df1-6fef267b1bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c2085-7678-42d9-bc8e-9c26adfd49f2", "name": "network-vif-deleted", "tag": "1ceea3b8-69a2-41f2-9096-5571942472f0"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:45.888883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4c9a5e10-2196-4879-8814-0bc19c7c69f5 req-f6ceb145-9a1f-46a5-9df1-6fef267b1bff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:45.889355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4c9a5e10-2196-4879-8814-0bc19c7c69f5 req-f6ceb145-9a1f-46a5-9df1-6fef267b1bff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:45.894158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:45.903483 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4c9a5e10-2196-4879-8814-0bc19c7c69f5 req-f6ceb145-9a1f-46a5-9df1-6fef267b1bff service nova] Creating event network-vif-deleted:1ceea3b8-69a2-41f2-9096-5571942472f0 for instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 on nch1-master-1 Jul 30 21:05:45.906440 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1976c00d-ffdd-43c6-b988-439c8965d26d tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 200 len: 1314 microversion: 2.1 time: 0.785328 Jul 30 21:05:45.916271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4c9a5e10-2196-4879-8814-0bc19c7c69f5 req-f6ceb145-9a1f-46a5-9df1-6fef267b1bff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Jul 30 21:05:45.916271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 676/1368] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:45.916271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-653356729", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0bbfb402-6390-47ca-a78d-fbea5b1ba88a"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:45.923019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 693/1369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:45 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:46.010913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:46.130622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-04cd94a0-80ee-40e4-9b72-6f49807abf99 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ce2e670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:46.210709 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-04cd94a0-80ee-40e4-9b72-6f49807abf99 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.083991 Jul 30 21:05:46.218939 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 694/1370] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:46 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:46.274833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:46.277841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:46.303190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.303943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:46.304906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.309125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:46.436920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:46.437366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:46.437866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:46.438295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:46.438759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:46.485260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.485748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:46.486857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.487511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:46.520842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:46.528140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:46.542819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 2 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:46.546632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:46.597158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130983) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 30 21:05:46.650978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:46.656405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:46.718748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:46.723985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:46.744123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:46.823977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:46.831558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:46.888989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:46.895973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:46.948415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43000955-a289-48c8-9277-460bbbdf7d46 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.036263 Jul 30 21:05:46.950896 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 677/1371] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:05:46.957495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:46.958692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:46.969646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.972284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:46.973473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:46.974132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.163734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.177645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.179884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.181220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11a5f5d5-ff81-43f5-b351-7f17301e8aef tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.228873 Jul 30 21:05:47.182132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 678/1372] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:46 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:47.188811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:47.189778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:47.198093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.198853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.200042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.200504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.248743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.267909 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67a2b1d5-159f-43b2-b5a9-4e4024aa9736 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.997701 Jul 30 21:05:47.268810 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 695/1373] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:46 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:47.273619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:47.274509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:47.299050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.299611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.300398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.300864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.353907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 HTTP/1.1 Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:05:47.357388 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:05:47.358821 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2'} Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:05:47.359683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:05:47.362525 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:05:47.365124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:05:47.365124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d19685dd-e33b-4c4c-9a67-bf274086efc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 404 len: 111 microversion: 2.1 time: 0.088848 Jul 30 21:05:47.365124 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 696/1374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:47 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:05:47.383081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:47.396806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.397677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Searching by: {'deleted': False, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:05:47.431376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:47.443629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60acbbbd-0f92-4e1e-a980-14f13af8905a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.256319 Jul 30 21:05:47.444553 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 679/1375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:47 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:47.454065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-104b6616-249d-4b44-aac8-201dcee08128 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cea6040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:47.494327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.494951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.496636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.497098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.509988 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-104b6616-249d-4b44-aac8-201dcee08128 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.064152 Jul 30 21:05:47.511477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 680/1376] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:47 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:47.517723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-368083fd-d44e-4a37-b90f-073fa6fe028a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'create', calling method: .version_select at 0x7fbb5cee81f0>, body: {"keypair": {"name": "tempest-keypair-1371140701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGab5LhsANoLA4T6zMIynsDDAPoHdpwFHv+TDv+i08N5CKg3ri1vUZyBrbbY5ADzn5soiAv1Qm7dgaq8tylm9Bq3h7bxc/jXeP7dvLtdIbzSEPUqPct06lgkd4kHnH+klA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:47.543827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-368083fd-d44e-4a37-b90f-073fa6fe028a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for project c4671c42e59f421192dea290a355021d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:47.553411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-368083fd-d44e-4a37-b90f-073fa6fe028a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for user 5b51cd5eda484fad9a901893f75d1b48 and project c4671c42e59f421192dea290a355021d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:47.596581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:05:47.659048 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-368083fd-d44e-4a37-b90f-073fa6fe028a tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144785 Jul 30 21:05:47.670151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 681/1377] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:05:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:47.715202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9645bd08-852a-4f6c-9122-06cfe104c751 req-fb0690a7-52cc-4cc0-bfcb-719065cbd85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d8e6b3-e409-4478-a027-a64a6e76ab67", "name": "network-vif-plugged", "status": "completed", "tag": "04af983f-2705-47b6-8aa0-cdfbd34d3707"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:47.738094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9645bd08-852a-4f6c-9122-06cfe104c751 req-fb0690a7-52cc-4cc0-bfcb-719065cbd85b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:47.746112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9645bd08-852a-4f6c-9122-06cfe104c751 req-fb0690a7-52cc-4cc0-bfcb-719065cbd85b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:47.749863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-31308c36-f503-4e22-9727-bda4f2d671ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.389081 Jul 30 21:05:47.762040 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 697/1378] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:05:47 2022] GET /compute/v2.1/servers => generated 1661 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:47.814555 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9645bd08-852a-4f6c-9122-06cfe104c751 req-fb0690a7-52cc-4cc0-bfcb-719065cbd85b service nova] Creating event network-vif-plugged:04af983f-2705-47b6-8aa0-cdfbd34d3707 for instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 on nch2-master-1 Jul 30 21:05:47.904071 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9645bd08-852a-4f6c-9122-06cfe104c751 req-fb0690a7-52cc-4cc0-bfcb-719065cbd85b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238422 Jul 30 21:05:47.907614 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 682/1379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:47.921421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ac589fe-a70e-4244-9604-ab812f499092 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:47.922275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ac589fe-a70e-4244-9604-ab812f499092 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:48.234773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1938593325", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:48.256737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ac589fe-a70e-4244-9604-ab812f499092 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:48.265168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ac589fe-a70e-4244-9604-ab812f499092 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1218 microversion: 2.1 time: 0.356449 Jul 30 21:05:48.268923 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 683/1380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:47 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1218 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:48.274750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:48.275688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:48.285728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:48.288289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:48.292502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:48.299786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:48.301727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:48.397975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:48.731851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:48.750744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:48.760637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:48.772093 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f6da9a8-efbd-480d-bb92-b8b348896cfe tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.499507 Jul 30 21:05:48.777891 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 684/1381] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:48 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:48.815180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:48.817964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:48.835308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:48.837934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:48.839255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:48.840182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:49.287773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:49.302884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2d89814-d68b-48d0-939a-02d1e7eb76a9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.521597 Jul 30 21:05:49.304286 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 685/1382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:48 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:49.312880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:49.314034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:49.327075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:49.327915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:49.329217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:49.329959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:49.697883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:49.716151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51c151db-3ce2-4089-bdd9-0276f324cca4 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.408033 Jul 30 21:05:49.718547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 686/1383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:49 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:49.734766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-926b85e2-cb27-4577-9865-640c50d106fe tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cfb1af0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:49.863516 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-926b85e2-cb27-4577-9865-640c50d106fe tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.143775 Jul 30 21:05:49.865428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 687/1384] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:49 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:49.877066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:49.880683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:49.900660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:49.901219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:49.907347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:49.908131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:49.976560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:49.977060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:49.977478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:49.977959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:49.978719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:50.000187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.002477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.003673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.004355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.056895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Getting quotas for project ebe60ae219554ca1839242aa20d2bda7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:50.066400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:50.068499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Getting quotas for user f820053bb2d942fd968b7129b2faae47 and project ebe60ae219554ca1839242aa20d2bda7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:50.086813 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fc380390-729b-4e4e-9cc9-29462237c886 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1270 microversion: 2.1 time: 0.220176 Jul 30 21:05:50.087446 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 688/1385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:49 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:50.100293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:50.101243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:50.117224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.119276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.121682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.122340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:50.123610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.125714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:50.206807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4aa9e828-4a33-4fc5-ad2c-27c289f24c14 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.442955 Jul 30 21:05:50.209970 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 698/1386] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:05:50.222927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6a53a19-de42-4580-9d1f-36d149903971 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:50.223857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b6a53a19-de42-4580-9d1f-36d149903971 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:50.485689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:50.510469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:50.513414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:50.515885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4dfb8df5-5965-40a9-a418-d2411fc1a22f tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.424453 Jul 30 21:05:50.517242 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 689/1387] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:50 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:50.522374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:50.523371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:50.559441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.571988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.580406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:50.581149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:50.951190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6a53a19-de42-4580-9d1f-36d149903971 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:50.959447 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6a53a19-de42-4580-9d1f-36d149903971 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1222 microversion: 2.1 time: 0.740519 Jul 30 21:05:50.966306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 699/1388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:50 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1222 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:50.972374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:50.990007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:51.017953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.032213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.033552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.034508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.205585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:51.220587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e16fbed3-41b3-4c4b-816c-cf922d4edfc4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1308 microversion: 2.1 time: 0.702026 Jul 30 21:05:51.221324 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 690/1389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:50 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:51.229809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5f4d0c5-bc90-4a4e-8b0a-5269d6ab89f2 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cf15d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:51.302204 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5f4d0c5-bc90-4a4e-8b0a-5269d6ab89f2 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.079515 Jul 30 21:05:51.304895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 691/1390] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:51 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:51.319759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:51.322935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:51.346526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.352899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.356683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.357817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.488506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:51.516814 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c41774ee-6885-43be-8964-397438baf706 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1276 microversion: 2.1 time: 0.209286 Jul 30 21:05:51.519014 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 692/1391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:51 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:51.544067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:51.545239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:51.568248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.568726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.572632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:51.575281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:51.746087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:51.760683 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7f82d99-5465-4316-bd0b-01be31b5b8f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.792017 Jul 30 21:05:51.765242 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 700/1392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:50 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:51.990014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:51.990699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:52.007004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.007728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.008695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.009313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.171414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.185641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42139faa-3cdb-455c-a0e0-5fcb24695b0e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1274 microversion: 2.1 time: 0.199229 Jul 30 21:05:52.186966 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 701/1393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:51 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:05:52.242721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:52.243746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:52.263513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.264729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.266028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.267998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.404541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.419888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.423367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.426271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1dffa556-b3dc-4f01-9706-bb2ee4b14790 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.889011 Jul 30 21:05:52.429117 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 693/1394] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:51 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:05:52.440360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7944c033-dcce-4251-b29c-04d7cdf8c2f5 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cfa1c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:52.534099 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7944c033-dcce-4251-b29c-04d7cdf8c2f5 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.104492 Jul 30 21:05:52.542438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 694/1395] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:52 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:52.550081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:52.550878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:52.564899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.565600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.567496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.568315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.705148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.723998 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a529ca9-a330-4b6a-b5cf-d2adace8b925 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1276 microversion: 2.1 time: 0.181834 Jul 30 21:05:52.728801 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 695/1396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:52 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:52.828123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:52.864660 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f48930f1-d4ef-4a3c-bcf6-7f910166be2e tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1487 microversion: 2.1 time: 0.626699 Jul 30 21:05:52.865728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 702/1397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:52 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1487 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:52.889969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:52.890610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:52.907376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.914370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.915404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:52.917777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:52.984013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lazy-loading 'flavor' on Instance uuid 52d8e6b3-e409-4478-a027-a64a6e76ab67 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:05:53.056073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:53.056767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:53.070339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.071626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.072965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.073094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.250901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bdc1a32f-df5f-4134-9e71-a9664d206ec9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67/action" status: 202 len: 0 microversion: 2.1 time: 0.363620 Jul 30 21:05:53.257444 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 703/1398] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:52 2022] POST /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:05:53.270869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:53.275630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:53.294710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.295483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.297486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.298156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.627138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:53.636787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75e3cdef-4d71-49d2-ad1d-450d4a722795 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1292 microversion: 2.1 time: 0.380383 Jul 30 21:05:53.639662 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 704/1399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:53 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1292 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:53.662822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:53.663483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:53.681886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.682352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.683181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.687047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.698232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:53.705533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:53.721721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-802f5fc1-89c8-404c-bffd-38c3f6e000c7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.935198 Jul 30 21:05:53.723268 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 696/1400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:52 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:53.733522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:53.734390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:53.753681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.754417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:53.755671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:53.757353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:54.244756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:54.261153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:54.266218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:54.269937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-953b1ff1-46ae-4231-9bf6-b7c2eacddaaa tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.544815 Jul 30 21:05:54.270869 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 697/1401] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:53 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:54.302807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1faf9efd-f953-48cf-b0ea-10ecb0cc699f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cf2f700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:54.413187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1faf9efd-f953-48cf-b0ea-10ecb0cc699f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.121030 Jul 30 21:05:54.413798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 698/1402] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:54 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:54.419097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:54.431537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:54.451272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:54.451771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:54.452585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:54.453048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:54.761300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:54.770370 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2bc524d0-4744-471c-b2ad-cdf76deb1b27 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1276 microversion: 2.1 time: 0.355498 Jul 30 21:05:54.773218 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 699/1403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:54 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:54.778561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-461996078", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:54.862144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] validate_networks() for [('e9b6ef4c-098f-4393-8b14-740aa6ff0b62', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:05:55.060107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:55.083978 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98a34ecd-4202-4bce-a9cc-8c6cd7e3d5d7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1495 microversion: 2.1 time: 1.429648 Jul 30 21:05:55.086496 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 705/1404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:53 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1495 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:55.098420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:55.100161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:55.112255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:55.115190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:55.116409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:55.117406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:55.291832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:55.349151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc3b8d41-1e02-41a3-ba06-cda447112679 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1280 microversion: 2.1 time: 0.258283 Jul 30 21:05:55.370394 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 706/1405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:55 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:55.387195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:55.388264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:55.436530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:55.437356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:55.438428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:55.439082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:55.973738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:05:55.975346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:05:55.976115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:05:55.977066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:05:55.978086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:05:56.001863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.002617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.003793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.004515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.023140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=11 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:56.049566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:05:56.055712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for user 5b51cd5eda484fad9a901893f75d1b48 and project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:05:56.072361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:05:56.076024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:05:56.146991 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd0c977c-4325-4e37-bdf2-ef69e0d30638 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.372391 Jul 30 21:05:56.156796 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 700/1406] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:05:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:05:56.477218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3b09a673-a827-4ebf-a0c1-2409ab6723a5 req-92bd6aa3-19c7-468b-9543-8b9a774eba70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e02e9d-1ab9-47de-b94d-8e12af04955b", "name": "network-vif-unplugged", "status": "completed", "tag": "34bd0d71-e49d-43c6-9423-cd886e7af073"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:56.514990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3b09a673-a827-4ebf-a0c1-2409ab6723a5 req-92bd6aa3-19c7-468b-9543-8b9a774eba70 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.518809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3b09a673-a827-4ebf-a0c1-2409ab6723a5 req-92bd6aa3-19c7-468b-9543-8b9a774eba70 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.555713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3b09a673-a827-4ebf-a0c1-2409ab6723a5 req-92bd6aa3-19c7-468b-9543-8b9a774eba70 service nova] Creating event network-vif-unplugged:34bd0d71-e49d-43c6-9423-cd886e7af073 for instance 95e02e9d-1ab9-47de-b94d-8e12af04955b on nch1-master-1 Jul 30 21:05:56.562504 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3b09a673-a827-4ebf-a0c1-2409ab6723a5 req-92bd6aa3-19c7-468b-9543-8b9a774eba70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.403084 Jul 30 21:05:56.563374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 701/1407] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:56.573800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:56.579038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:56.598095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.598840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.599707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.600169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.765840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:56.777326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20080807-2e89-4174-96a8-7dbff95de1f3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 1.399121 Jul 30 21:05:56.779049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 707/1408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:55 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:56.790788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2058b3ca-cdac-40aa-bb5b-efd11e5d6c71 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd34dc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:56.946591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2058b3ca-cdac-40aa-bb5b-efd11e5d6c71 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1455 microversion: 2.1 time: 0.165907 Jul 30 21:05:56.953832 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 708/1409] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:56 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:56.959886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:56.964566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:56.978265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.978796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:56.981924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:56.982412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.013018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.024994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.026869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.029378 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1663e944-c9df-4c2d-9dfe-7ebb9c6a0f2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.463701 Jul 30 21:05:57.030862 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 702/1410] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:56 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:57.036607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:57.037458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:57.046766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.047499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.048447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.049045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.320043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.331427 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3166f4f-ead5-456c-9899-a759c7bd4926 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 200 len: 1478 microversion: 2.1 time: 0.299023 Jul 30 21:05:57.332418 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 703/1411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:57 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 1478 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:57.349570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:57.352292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:57.362188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.362932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.364210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.364879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.465764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.474156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc3cc0b1-7f0b-4c7a-a208-65b8e3e69399 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1228 microversion: 2.1 time: 0.139918 Jul 30 21:05:57.475142 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 704/1412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:57 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1228 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:57.481126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:57.481904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:57.492018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.492890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.494021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.494675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.601414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.613818 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a14cc3f-f96c-43f6-b102-372ac0a46a8b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1280 microversion: 2.1 time: 0.137307 Jul 30 21:05:57.614741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 705/1413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:57 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:57.629833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e24e5c34-4e0b-4d77-a5ab-8d2e32425de8 req-8c59ccbd-9199-4cad-92d0-a8c15e13c7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58612e09-b9e2-4a54-adea-ca6664d46930", "name": "network-vif-unplugged", "status": "completed", "tag": "507d6eec-0fdd-4088-9ad6-489f49cc80aa"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:57.660341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e24e5c34-4e0b-4d77-a5ab-8d2e32425de8 req-8c59ccbd-9199-4cad-92d0-a8c15e13c7b6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.661221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e24e5c34-4e0b-4d77-a5ab-8d2e32425de8 req-8c59ccbd-9199-4cad-92d0-a8c15e13c7b6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.685004 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e24e5c34-4e0b-4d77-a5ab-8d2e32425de8 req-8c59ccbd-9199-4cad-92d0-a8c15e13c7b6 service nova] Creating event network-vif-unplugged:507d6eec-0fdd-4088-9ad6-489f49cc80aa for instance 58612e09-b9e2-4a54-adea-ca6664d46930 on nch2-master-1 Jul 30 21:05:57.692727 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e24e5c34-4e0b-4d77-a5ab-8d2e32425de8 req-8c59ccbd-9199-4cad-92d0-a8c15e13c7b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067095 Jul 30 21:05:57.693982 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 706/1414] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:57.701647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1107284492"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:57.705673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:57.721322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.722302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.736509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.738665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.738992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:57.756180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d2a3d50-87fe-49c3-972d-30172072d01f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.805966 Jul 30 21:05:57.756760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 709/1415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:56 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:57.803020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:57.804918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:57.813854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.814327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:57.815134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:57.820194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.152224 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68b38757-f244-40fa-8263-adfec1b87a0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67/action" status: 202 len: 0 microversion: 2.1 time: 0.456442 Jul 30 21:05:58.168342 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 707/1416] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:57 2022] POST /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:05:58.174328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11823915-cacf-4421-ac20-c0974523b82e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ce5c040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.240231 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11823915-cacf-4421-ac20-c0974523b82e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1464 microversion: 2.1 time: 0.069781 Jul 30 21:05:58.242067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 708/1417] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1464 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:58.249346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.250502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:58.259835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.261577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.263259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.264001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.328641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:58.338242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75ce9af9-fb14-47dd-9cf3-4fce22ffb93f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.539010 Jul 30 21:05:58.339070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 710/1418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:57 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:58.356163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5353475e-2c52-4b28-97b4-7a4feac0d7a5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cd41ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.428586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5353475e-2c52-4b28-97b4-7a4feac0d7a5 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1438 microversion: 2.1 time: 0.079889 Jul 30 21:05:58.429565 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 711/1419] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:58.435398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87be8cca-81e7-473a-81bb-97d3d2a1ebae tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ce2e0d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.487813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87be8cca-81e7-473a-81bb-97d3d2a1ebae tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 200 len: 1464 microversion: 2.1 time: 0.056828 Jul 30 21:05:58.488989 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 712/1420] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 1464 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:58.500719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.501732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:58.510026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.510731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.511835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.512472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.545928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:58.563385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:58.566994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:58.568594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f136e97-0c00-4768-8df3-b7f50b7c59b7 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.325326 Jul 30 21:05:58.583751 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 709/1421] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:05:58.593012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.594703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:58.595533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:58.602343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.603260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.605418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.606067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.608804 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f00c0649-1a62-4024-bedd-62d95751cc3f tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1276 microversion: 2.1 time: 0.113856 Jul 30 21:05:58.609428 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 713/1422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:58.622983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1b0da0d7-3d4a-4a75-bbd8-6f44715f2f85 req-d83789b0-4a87-4418-b6ec-cea6bd87f438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e02e9d-1ab9-47de-b94d-8e12af04955b", "tag": "34bd0d71-e49d-43c6-9423-cd886e7af073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:58.647013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1b0da0d7-3d4a-4a75-bbd8-6f44715f2f85 req-d83789b0-4a87-4418-b6ec-cea6bd87f438 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.647513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1b0da0d7-3d4a-4a75-bbd8-6f44715f2f85 req-d83789b0-4a87-4418-b6ec-cea6bd87f438 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.687690 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1b0da0d7-3d4a-4a75-bbd8-6f44715f2f85 req-d83789b0-4a87-4418-b6ec-cea6bd87f438 service nova] Creating event network-changed:34bd0d71-e49d-43c6-9423-cd886e7af073 for instance 95e02e9d-1ab9-47de-b94d-8e12af04955b on nch1-master-1 Jul 30 21:05:58.703079 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1b0da0d7-3d4a-4a75-bbd8-6f44715f2f85 req-d83789b0-4a87-4418-b6ec-cea6bd87f438 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090825 Jul 30 21:05:58.705237 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 714/1423] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:05:58.718739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:58.722335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:58.748681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.750649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.751560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:58.753768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:58.795829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:59.083119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:59.096473 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0e561abd-3753-4cd8-9f65-b01ff4928d50 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1468 microversion: 2.1 time: 0.509792 Jul 30 21:05:59.097635 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 710/1424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1468 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:59.116476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:59.117171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:59.129174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.133492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.134999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.136212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.631013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:59.643447 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a059530c-6d5e-495d-a591-660805d372c0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.544226 Jul 30 21:05:59.644064 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 711/1425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:59 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:59.652744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-189313064"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:05:59.655607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:59.666018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.666770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.668511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.668984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.808390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:05:59.832002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-62e7671c-aca9-4b74-a687-69a275b3c037 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 1.122815 Jul 30 21:05:59.833219 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 715/1426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:58 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:05:59.846414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:05:59.848174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:05:59.866652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.867533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.869063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:05:59.869742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:05:59.992172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7916b6a1-ba40-400a-a4f6-f9bc632ca1c7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "POST /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac/action" status: 202 len: 0 microversion: 2.1 time: 0.345601 Jul 30 21:06:00.002815 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 712/1427] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:05:59 2022] POST /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:06:00.010162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73e2040a-82ba-414c-be56-16fdd2494839 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ce5ca60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.033861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:00.089748 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73e2040a-82ba-414c-be56-16fdd2494839 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1438 microversion: 2.1 time: 0.081889 Jul 30 21:06:00.098837 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 713/1428] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:00.108347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.109876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:00.132747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.133327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.134213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.134748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.520570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:00.530847 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89191711-b3c5-4197-8ea9-a3caa70dbafe tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.696011 Jul 30 21:06:00.531470 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 716/1429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:05:59 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:00.537083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.537719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:00.544479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.545460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.547201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.548595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.625216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:00.634778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:00.637538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:00.639086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd9e437c-2dca-44f8-ae58-56bf95200415 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.540116 Jul 30 21:06:00.639744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 714/1430] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:00.644418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58612e09-b9e2-4a54-adea-ca6664d46930", "tag": "507d6eec-0fdd-4088-9ad6-489f49cc80aa"}, {"name": "network-changed", "server_uuid": "d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef", "tag": "df19c8c3-fc29-439b-85fd-bfa6dd84b0df"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:00.658129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.658592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.676875 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] Creating event network-changed:507d6eec-0fdd-4088-9ad6-489f49cc80aa for instance 58612e09-b9e2-4a54-adea-ca6664d46930 on nch2-master-1 Jul 30 21:06:00.677497 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] Creating event network-changed:df19c8c3-fc29-439b-85fd-bfa6dd84b0df for instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef on nch1-master-1 Jul 30 21:06:00.687516 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0c600adc-58ef-4e50-b1f1-6c988b8150d3 req-2f2f512d-177b-4173-8160-7ae543fd28be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046227 Jul 30 21:06:00.689060 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 715/1431] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:00.694587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3050d789-e83c-4113-bc8d-627ac627ed75 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d2e9ca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.748924 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3050d789-e83c-4113-bc8d-627ac627ed75 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 0.058435 Jul 30 21:06:00.750001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 716/1432] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:00.756008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.756922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:00.766731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.767206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.768285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.768781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.788724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:00.808493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:00.820770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dbe83f26-c32d-4b27-b217-d2ae36a8539e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1282 microversion: 2.1 time: 0.287923 Jul 30 21:06:00.821463 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 717/1433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:00.858073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:00.859144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:00.870332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.871462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.874688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:00.875227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:00.959454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:01.282770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:01.297408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-372c7790-32d4-4650-9143-d2f741cdafc3 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.544754 Jul 30 21:06:01.300334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 717/1434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:01.317714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:01.325882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce194373-117d-46df-b6f9-6dd5de551fdf tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 0.472428 Jul 30 21:06:01.328060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ecb9a75-f612-4560-ab65-a80bb9e60240 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ced5f70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:01.332447 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 718/1435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:00 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:01.402173 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ecb9a75-f612-4560-ab65-a80bb9e60240 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1438 microversion: 2.1 time: 0.099104 Jul 30 21:06:01.403147 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 718/1436] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:01 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:01.558585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:01.559764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:01.568784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:01.569563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:01.571612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:01.572332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:01.664416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:01.665054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:01.676048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:01.676520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:01.688478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:01.689267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:02.066784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:02.082555 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-487bf9c3-e340-43c5-b3d5-a492673f03e3 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 0.533848 Jul 30 21:06:02.105111 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 719/1437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:01 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:02.120203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4704aac-b1e0-4e51-87e7-17d4c2183c02 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ce2d040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:02.200911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4704aac-b1e0-4e51-87e7-17d4c2183c02 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 0.093715 Jul 30 21:06:02.201968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 720/1438] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:02 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:02.212977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:02.221438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:02.247773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:02.249038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:02.253099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:02.256001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:02.294623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:02.328290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:02.330364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:02.331637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb5bab05-873c-45ac-8c8b-ff967b90e319 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.673371 Jul 30 21:06:02.332445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 719/1439] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:01 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:02.338304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:02.339735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:02.346348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:02.346910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:02.347879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:02.348364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:03.075234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:03.085485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aea1dc98-e666-4cc0-890a-488a9b8677f9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1324 microversion: 2.1 time: 0.882284 Jul 30 21:06:03.090816 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 721/1440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:02 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1324 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:03.096865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:03.103916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:03.128046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:03.128822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:03.130088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:03.130662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:03.376125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:03.390282 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-802ff662-1c9d-49b2-8a8b-90220dd8018d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 1.056712 Jul 30 21:06:03.395644 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 720/1441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:02 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:03.409380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7f154d39-ee29-40be-b6ed-6a9319df9b1c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cedf430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:03.504159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7f154d39-ee29-40be-b6ed-6a9319df9b1c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1438 microversion: 2.1 time: 0.106893 Jul 30 21:06:03.504677 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 721/1442] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:03 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:03.514782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c19afe9-9429-4bf5-8aa6-fe6975c184ec", "tag": "f5923a26-4789-4405-a2a2-faffb61f9b0d"}, {"name": "network-changed", "server_uuid": "7e5b45b4-c802-4081-bd6c-d4b8ef1b2835", "tag": "4bed58a6-7dad-4d35-b3a9-9589ef49c7a7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:03.554787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:03.555256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:03.597534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] Creating event network-changed:f5923a26-4789-4405-a2a2-faffb61f9b0d for instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec on nch2-master-1 Jul 30 21:06:03.598057 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] Creating event network-changed:4bed58a6-7dad-4d35-b3a9-9589ef49c7a7 for instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 on nch1-master-1 Jul 30 21:06:03.619136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4fa70dad-057d-4934-b857-b45bf34eb48b req-b351eb6c-8ff2-42fd-a31f-110acaf82187 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111363 Jul 30 21:06:03.622150 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 722/1443] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:03.634337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:03.635084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:03.651151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:03.653172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:03.660956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:03.661882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:04.393452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:04.411768 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-682e43fa-2907-436d-a95d-4705cd2b6589 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 1.316722 Jul 30 21:06:04.415490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 722/1444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:03 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:04.432895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dda18216-dad9-40ee-8973-ba712df9c915 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5ce42d30>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:04.511692 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dda18216-dad9-40ee-8973-ba712df9c915 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 0.092631 Jul 30 21:06:04.513923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 723/1445] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:04 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:04.519581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:04.520781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:04.529630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:04.530419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:04.532036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:04.532790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:04.887365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:04.898285 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81cc2cb4-daa2-4e7e-9aef-68a67427946f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 1.274846 Jul 30 21:06:04.899144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 723/1446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:03 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:04.904466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:04.905337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:04.921650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:04.922711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:04.925230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:04.926661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.055254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.076670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.078612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.084294 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61fab502-0aa9-46a6-be53-4aca46ced436 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 0.569141 Jul 30 21:06:05.101262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 724/1447] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:04 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:05.122396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:05.123657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:05.134575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.135579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.137546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.140487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.340522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.351344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5d521d77-94fe-49be-a62a-364be042da80 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1324 microversion: 2.1 time: 0.450643 Jul 30 21:06:05.353855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 724/1448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:04 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:05.361603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a4f3fa8-5ae5-461f-8209-61cf05848334 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d0ea0d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:05.376002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.399333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-382f2dda-f7d2-4e44-b953-1a9363ec1da0 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.294280 Jul 30 21:06:05.402688 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 725/1449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:05 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:05.436534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a4f3fa8-5ae5-461f-8209-61cf05848334 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1438 microversion: 2.1 time: 0.080795 Jul 30 21:06:05.437437 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 725/1450] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:05 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:05.452040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:05.452924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:05.460125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.462267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.463511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.464742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.531092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e9fb6a4-1799-46a5-9757-754be1b61c75 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d100280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:05.638187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e9fb6a4-1799-46a5-9757-754be1b61c75 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 0.109443 Jul 30 21:06:05.639190 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 726/1451] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:05 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:05.926041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:05.929095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:05.933982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:05.945946 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d4cfcb6-2817-4ca6-8366-f6f89ade5c7b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 0.499188 Jul 30 21:06:05.964300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.967992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:05.968484 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 726/1452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:05 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:05.969647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:05.973064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:06.074585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:06.085671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=42 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:06.106879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:06.107626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:06.124554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:06.130252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:06.133051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:06.134661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:07.421012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:07.498085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:07.502764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:07.506197 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16a169f6-f11a-4173-8e6e-2eb055706315 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1486 microversion: 2.25 time: 1.401851 Jul 30 21:06:07.508732 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 727/1453] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:06 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1486 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:07.523537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:07.525453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:07.556837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:07.565695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:07.566863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:07.570486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:07.705146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:07.718414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13b473c6-030f-4098-a032-121cf0dd26a8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1390 microversion: 2.1 time: 1.801667 Jul 30 21:06:07.722694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 727/1454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:05 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1390 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:08.119503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-05b336b0-b60c-4048-880c-f4c044913a08 req-b3149ba5-b78d-49f5-94c8-66fb56dad5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef", "name": "network-vif-plugged", "status": "completed", "tag": "df19c8c3-fc29-439b-85fd-bfa6dd84b0df"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:08.145061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-05b336b0-b60c-4048-880c-f4c044913a08 req-b3149ba5-b78d-49f5-94c8-66fb56dad5b8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:08.146726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-05b336b0-b60c-4048-880c-f4c044913a08 req-b3149ba5-b78d-49f5-94c8-66fb56dad5b8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:08.180094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-05b336b0-b60c-4048-880c-f4c044913a08 req-b3149ba5-b78d-49f5-94c8-66fb56dad5b8 service nova] Creating event network-vif-plugged:df19c8c3-fc29-439b-85fd-bfa6dd84b0df for instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef on nch1-master-1 Jul 30 21:06:08.193806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-05b336b0-b60c-4048-880c-f4c044913a08 req-b3149ba5-b78d-49f5-94c8-66fb56dad5b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.467417 Jul 30 21:06:08.196893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 728/1455] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:08.252576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:08.259044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:08.291339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:08.294349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:08.296777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:08.297853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:08.609347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:08.633792 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f00cce0-0801-4c71-928b-4160d4d02fa8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1324 microversion: 2.1 time: 1.120227 Jul 30 21:06:08.638176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 728/1456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:07 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1324 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:08.668369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0fa201b4-6e82-43bf-a0fe-af1f40a6faaf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5ce42b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:08.994459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:09.006088 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e43fbc4d-97c4-430b-81fd-7e148951afbf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.806354 Jul 30 21:06:09.014651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 729/1457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:08 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:09.031970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1aef2b0a-1f34-4fa8-97e8-c439fa319789 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1bf8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:17.534612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:18.281874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:18.616625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=70 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:19.001747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=42 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:21.253429 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0fa201b4-6e82-43bf-a0fe-af1f40a6faaf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1447 microversion: 2.1 time: 12.612975 Jul 30 21:06:21.256949 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1aef2b0a-1f34-4fa8-97e8-c439fa319789 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 12.240502 Jul 30 21:06:21.257494 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 730/1458] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:09 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 12242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:21.258915 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 729/1459] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:08 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1447 bytes in 12620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:21.263370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:21.264256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:21.270345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7a791410-2fa9-4b8d-864d-9465fcac583d req-93e11414-71aa-4c30-8241-968ded9e4ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc34ecec-a31a-43eb-ab9b-a0021285c703", "tag": "c08fc2ce-c881-4919-ad5a-721b88136053"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:21.272607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.273445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.274642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.275442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.290740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7a791410-2fa9-4b8d-864d-9465fcac583d req-93e11414-71aa-4c30-8241-968ded9e4ef0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.292079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7a791410-2fa9-4b8d-864d-9465fcac583d req-93e11414-71aa-4c30-8241-968ded9e4ef0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.305578 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7a791410-2fa9-4b8d-864d-9465fcac583d req-93e11414-71aa-4c30-8241-968ded9e4ef0 service nova] Creating event network-changed:c08fc2ce-c881-4919-ad5a-721b88136053 for instance fc34ecec-a31a-43eb-ab9b-a0021285c703 on nch1-master-1 Jul 30 21:06:21.312640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7a791410-2fa9-4b8d-864d-9465fcac583d req-93e11414-71aa-4c30-8241-968ded9e4ef0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052453 Jul 30 21:06:21.313331 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 730/1460] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:21.504247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:21.505278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:21.528439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.530993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.532835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.534842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.716892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:21.742142 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0dce954-df53-4a24-ac3e-fefca5f043b1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 0.483353 Jul 30 21:06:21.742745 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 731/1461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:21 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:21.779754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:21.783722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:21.795068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:21.808895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:21.811179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:21.812809 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fda793eb-293f-4ffb-b333-3b677cc836de tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1476 microversion: 2.25 time: 0.497995 Jul 30 21:06:21.814497 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 731/1462] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:21 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1476 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:21.820763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.821421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:21.821564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.823420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:21.824429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.832212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.833174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.834229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:21.835456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:21.836313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.034382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:22.050482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fdfdc02e-76c8-436c-9f23-14ca5ac564a1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1324 microversion: 2.1 time: 0.231526 Jul 30 21:06:22.051163 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 732/1463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:21 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.058485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:22.059544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:22.087811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:22.088744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.089859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:22.090487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.202562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:22.230450 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56aa470b-a14f-4f1b-8cb1-9a50034899de tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1380 microversion: 2.1 time: 0.472454 Jul 30 21:06:22.233077 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 732/1464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:21 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1380 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.264061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2b7b10ba-c882-4dea-ae5a-544a21543916 req-a6e247ff-fe72-4fbb-9608-9c5ffe9cc6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b45b4-c802-4081-bd6c-d4b8ef1b2835", "name": "network-vif-plugged", "status": "completed", "tag": "4bed58a6-7dad-4d35-b3a9-9589ef49c7a7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:22.299940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2b7b10ba-c882-4dea-ae5a-544a21543916 req-a6e247ff-fe72-4fbb-9608-9c5ffe9cc6e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:22.304067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2b7b10ba-c882-4dea-ae5a-544a21543916 req-a6e247ff-fe72-4fbb-9608-9c5ffe9cc6e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.335368 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2b7b10ba-c882-4dea-ae5a-544a21543916 req-a6e247ff-fe72-4fbb-9608-9c5ffe9cc6e7 service nova] Creating event network-vif-plugged:4bed58a6-7dad-4d35-b3a9-9589ef49c7a7 for instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 on nch1-master-1 Jul 30 21:06:22.357406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2b7b10ba-c882-4dea-ae5a-544a21543916 req-a6e247ff-fe72-4fbb-9608-9c5ffe9cc6e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121360 Jul 30 21:06:22.358617 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 733/1465] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:22.373894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:22.396712 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-116f9ed6-5ddd-4bdf-8020-1ca99951babf tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.344027 Jul 30 21:06:22.416530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 733/1466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:22 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.424911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d73f505-a88a-4355-8e69-9c15e9c8d72f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5cfabc10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:22.515909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7840aeb-e6cb-42f8-b4c5-d7c971c83378 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Action: 'create', calling method: .version_select at 0x7fbb5d162280>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:22.525412 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d73f505-a88a-4355-8e69-9c15e9c8d72f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 200 len: 1447 microversion: 2.1 time: 0.107069 Jul 30 21:06:22.526808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 734/1467] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:22 2022] GET /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.532898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0eac9952-e6f2-4751-9c65-7ccc9cf86b5c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '.version_select at 0x7fbb5d00bdc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:22.546867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eac9952-e6f2-4751-9c65-7ccc9cf86b5c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:22.547778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eac9952-e6f2-4751-9c65-7ccc9cf86b5c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.581274 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0eac9952-e6f2-4751-9c65-7ccc9cf86b5c tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3376 microversion: 2.25 time: 0.052833 Jul 30 21:06:22.582108 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 735/1468] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 30 21:06:22 2022] GET /compute/v2.1/os-migrations => generated 3376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:22.598041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75c2182b-6e27-4c63-94cb-7f36868d6e2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '.version_select at 0x7fbb5da170d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:22.605644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75c2182b-6e27-4c63-94cb-7f36868d6e2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:22.606243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75c2182b-6e27-4c63-94cb-7f36868d6e2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:22.626917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75c2182b-6e27-4c63-94cb-7f36868d6e2c tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3088 microversion: 2.1 time: 0.043061 Jul 30 21:06:22.636355 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 736/1469] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:06:22 2022] GET /compute/v2.1/os-migrations => generated 3088 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.646196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5c98fcd-9795-4e49-9c0e-bd74cf5e4d13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d00bca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:22.715677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5c98fcd-9795-4e49-9c0e-bd74cf5e4d13 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1454 microversion: 2.1 time: 0.077773 Jul 30 21:06:22.716643 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 737/1470] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:22 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:22.735183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db41c760-fecb-4456-9159-7d537a000bb3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d00bee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:23.586405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db41c760-fecb-4456-9159-7d537a000bb3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 204 len: 0 microversion: 2.1 time: 0.867936 Jul 30 21:06:23.587628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 738/1471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:22 2022] DELETE /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:23.594185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:23.595108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:23.607212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:23.608156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:23.609229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:23.609753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:23.824457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] Lazy-loading 'services' on Instance uuid 95e02e9d-1ab9-47de-b94d-8e12af04955b {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:23.859807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e252c0b-e31b-49eb-b9d0-03cdb1a23624 tempest-LiveAutoBlockMigrationV225Test-1902217911 tempest-LiveAutoBlockMigrationV225Test-1902217911-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1967 microversion: 2.25 time: 0.270857 Jul 30 21:06:23.860896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 739/1472] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:23 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1967 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:23.886121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:23.886725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:23.895272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:23.896089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:23.897320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:23.897982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.085775 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec850348-2cbc-46ed-8485-1be97c1ca813 tempest-LiveMigrationTest-1705367644 tempest-LiveMigrationTest-1705367644-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1531 microversion: 2.1 time: 0.203668 Jul 30 21:06:24.092021 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 740/1473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:23 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1531 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.096539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.097181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.117977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.118484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.119591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.120239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.278691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:24.287689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92e0acc1-2953-4634-89aa-e171e703a273 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1322 microversion: 2.1 time: 0.199754 Jul 30 21:06:24.288338 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 741/1474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:24 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.294179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.294741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.301065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.301815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.302792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.303253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.331566 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7840aeb-e6cb-42f8-b4c5-d7c971c83378 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.971136 Jul 30 21:06:24.332382 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 734/1475] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:06:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:24.339706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.340815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.349322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.349791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.350871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.351568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.463081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:24.472637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ba552f8-6496-4b5e-8d1a-19b90b0fca53 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1324 microversion: 2.1 time: 0.182818 Jul 30 21:06:24.473385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 742/1476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:24 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.478661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.479809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.486439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.487033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.488039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.488666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.521018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:24.527349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:24.534912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ca18e22-605e-4678-b8cf-ab6eeef218c2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.200572 Jul 30 21:06:24.535527 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 735/1477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:24 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.539923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5fd6a47a-0352-46ba-9c4c-3fc2c7525cbb tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1bfa60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.599597 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5fd6a47a-0352-46ba-9c4c-3fc2c7525cbb tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1463 microversion: 2.1 time: 0.062386 Jul 30 21:06:24.608859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa8d313f-e587-4bab-8f22-a19608ac9b15 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 204 len: 0 microversion: 2.1 time: 0.133954 Jul 30 21:06:24.609486 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 743/1478] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:24 2022] DELETE /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:24.610929 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 736/1479] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:24 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1463 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.615001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.615851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.618578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.619580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:24.627945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.628110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.628598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.629085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.629770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.630185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.630390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.631051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.663848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:24.664824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:24.755865 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-540233eb-f9a1-46d7-9557-b8a14750a5d9 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 204 len: 0 microversion: 2.1 time: 0.143101 Jul 30 21:06:24.756572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 737/1480] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:24 2022] DELETE /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:24.763159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cda5641-bab3-4ef6-a65d-99d3aed35720 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Action: 'create', calling method: .version_select at 0x7fbb5d0a2280>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:24.779552 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0618102d-004e-4a07-ba68-82c3a0026647 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 204 len: 0 microversion: 2.25 time: 0.168142 Jul 30 21:06:24.780705 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 744/1481] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:06:24 2022] DELETE /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:06:24.786445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c19afe9-9429-4bf5-8aa6-fe6975c184ec", "name": "network-vif-plugged", "status": "completed", "tag": "f5923a26-4789-4405-a2a2-faffb61f9b0d"}, {"server_uuid": "4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24", "name": "network-vif-unplugged", "status": "completed", "tag": "a4a7f134-088e-4bed-bba6-67d689e70a28"}, {"server_uuid": "52d8e6b3-e409-4478-a027-a64a6e76ab67", "name": "network-vif-plugged", "status": "completed", "tag": "04af983f-2705-47b6-8aa0-cdfbd34d3707"}, {"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-plugged", "status": "completed", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}, {"server_uuid": "fc34ecec-a31a-43eb-ab9b-a0021285c703", "name": "network-vif-plugged", "status": "completed", "tag": "c08fc2ce-c881-4919-ad5a-721b88136053"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:24.801111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:24.801500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:24.822432 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Creating event network-vif-plugged:f5923a26-4789-4405-a2a2-faffb61f9b0d for instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec on nch2-master-1 Jul 30 21:06:24.823821 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Creating event network-vif-unplugged:a4a7f134-088e-4bed-bba6-67d689e70a28 for instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 on nch2-master-1 Jul 30 21:06:24.824498 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Creating event network-vif-plugged:04af983f-2705-47b6-8aa0-cdfbd34d3707 for instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 on nch2-master-1 Jul 30 21:06:24.825515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Creating event network-vif-plugged:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:06:24.826169 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] Creating event network-vif-plugged:c08fc2ce-c881-4919-ad5a-721b88136053 for instance fc34ecec-a31a-43eb-ab9b-a0021285c703 on nch1-master-1 Jul 30 21:06:24.841996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-12791e6c-acbc-49a2-bbc3-8c6a452a27ae req-d9111e2e-46ea-4211-9e3c-62b32acf3bd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.059557 Jul 30 21:06:24.842631 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 745/1482] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:24.848771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b8b1d80-6811-41da-bb9b-032b414c20eb tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cdf3b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:24.903532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b8b1d80-6811-41da-bb9b-032b414c20eb tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 200 len: 1463 microversion: 2.1 time: 0.059560 Jul 30 21:06:24.907349 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 746/1483] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:24 2022] GET /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 1463 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:24.910590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-861014300", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "0ad1dccc-1f18-4d8d-a178-5d43d230baa8"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:24.979410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] validate_networks() for [('0ad1dccc-1f18-4d8d-a178-5d43d230baa8', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:06:25.516371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:06:25.516939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:06:25.517413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:06:25.518353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:06:25.518353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:06:25.529350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.529945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:25.531239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.532003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:25.554901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:06:25.561688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Getting quotas for user 8379e04d2b30488387b3eefab6669768 and project afa530811f1f43aeb7957b6cd28d4653. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:06:25.579845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:06:25.582759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:06:25.658918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f72f515-89af-43ef-8eb0-cc303e41891a tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753185 Jul 30 21:06:25.659841 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 747/1484] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:06:25.664988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:25.665856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:25.673734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.674209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:25.675236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.675568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:25.849835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:25.869203 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40b1b449-a350-4c55-87a1-13a21b96a2c8 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1386 microversion: 2.1 time: 0.208034 Jul 30 21:06:25.875365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 748/1485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:25 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1386 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:25.877923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:25.878995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:25.888201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.888786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:25.889964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:25.890511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.123987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.133646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.135283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.147888 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-190c39e1-3f9c-4c28-8bda-e00917d32792 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1482 microversion: 2.25 time: 0.274160 Jul 30 21:06:26.155691 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 749/1486] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:25 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1482 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:26.155691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:26.155691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:26.161941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.162444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.163232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.163740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.169217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:26.327769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.336537 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-65eb6faf-bc45-4db6-a3dd-383e2f734dda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1467 microversion: 2.1 time: 0.186608 Jul 30 21:06:26.343361 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 750/1487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:26 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1467 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:26.343361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:26.343361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:26.350032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.350705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.351589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.352041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.669452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.689455 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f50d5e0e-530f-402f-8e73-29d9d67f4c03 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1472 microversion: 2.1 time: 0.351218 Jul 30 21:06:26.690049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 751/1488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:26 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:26.703688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:26.704536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:26.715497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.719018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.720157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.720636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.867337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cda5641-bab3-4ef6-a65d-99d3aed35720 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.108099 Jul 30 21:06:26.883193 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 738/1489] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:06:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:26.907220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:26.908627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:26.921300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.922585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.923561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.926164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.933901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:26.947486 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b24644db-43c8-4091-a60e-084811f85e78 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1521 microversion: 2.1 time: 0.256039 Jul 30 21:06:26.955360 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 752/1490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:26 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:26.966823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:26.966823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:26.975352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.975352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:26.975352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:26.975352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.113536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:27.123672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1c38b56-181d-4941-adf4-5a88eaf547b3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1259 microversion: 2.1 time: 0.166772 Jul 30 21:06:27.124953 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 753/1491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:26 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:27.130795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b32551c0-57f1-4b2b-bf4a-a826506f6f55 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cee3280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:27.154083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:27.165635 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d80cbe40-1858-430a-a56b-161262f5bb7c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1318 microversion: 2.1 time: 0.278593 Jul 30 21:06:27.168580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 739/1492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:26 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:27.274477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b32551c0-57f1-4b2b-bf4a-a826506f6f55 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?changes-since=2022-07-30T21%3A04%3A36Z" status: 200 len: 1902 microversion: 2.1 time: 0.146373 Jul 30 21:06:27.276305 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 754/1493] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 30 21:06:27 2022] GET /compute/v2.1/images?changes-since=2022-07-30T21%3A04%3A36Z => generated 1902 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:27.283482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d8e6b3-e409-4478-a027-a64a6e76ab67", "name": "network-vif-unplugged", "status": "completed", "tag": "04af983f-2705-47b6-8aa0-cdfbd34d3707"}, {"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-unplugged", "status": "completed", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:27.318905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.319418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.353171 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] Creating event network-vif-unplugged:04af983f-2705-47b6-8aa0-cdfbd34d3707 for instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 on nch2-master-1 Jul 30 21:06:27.353707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] Creating event network-vif-unplugged:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:06:27.370467 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8ce018bd-4774-473e-8579-1f4fec8edcac req-d5623e5b-4884-40cf-b8ab-712aed0f8c35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.092817 Jul 30 21:06:27.379799 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 755/1494] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:27.389804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c633fa96-68d2-44fe-96cd-c6d1a603ce2f tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Action: 'create', calling method: .version_select at 0x7fbb5cfddf70>, body: {"pool": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:27.403983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:27.404951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: f12b0bb2-83f8-43c4-b8c1-259af47b2629] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:27.417831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] HTTP exception thrown: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Request method failure captured: Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/f12b0bb2-83f8-43c4-b8c1-259af47b2629/action HTTP/1.1 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0rU4TUlZeUPtj6cEdahCGpALwxixmEyiHErR3YnKsEzjecrM4M-SQ1C4UVSd4Nx8rmH3-4p5YBJowYfYjlC4QotZ3DrX3djr-wYnJpckpM9sdAZxTwHERFMDuy5UMwk9RYd65PHh1VlsSjKy7_uaLUUOr9aNFSNgIvrd4_6qmOSTQ Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:06:27.423097 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d0fa9f6f453a4d9c8383c84368b98970", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f71a7b16f8b4e1fa3b08b96c1705327 Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: {"migrate": {}} Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:27.425131 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f12b0bb2-83f8-43c4-b8c1-259af47b2629', 'body': {'migrate': {}}} Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:27.426238 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. Jul 30 21:06:27.427892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:27.429507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Returning 404 to user: Instance f12b0bb2-83f8-43c4-b8c1-259af47b2629 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:27.430587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e47727c-c5e0-4d99-8163-9c788cda5b75 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/f12b0bb2-83f8-43c4-b8c1-259af47b2629/action" status: 404 len: 111 microversion: 2.1 time: 0.259164 Jul 30 21:06:27.442625 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 740/1495] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:27 2022] POST /compute/v2.1/servers/f12b0bb2-83f8-43c4-b8c1-259af47b2629/action => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:27.442625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:27.442625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:27.461975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.462605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.464419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.464971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.519825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.520343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.520983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lazy-loading 'fault' on Instance uuid 58612e09-b9e2-4a54-adea-ca6664d46930 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:27.832481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:27.841630 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cb87733-4ee5-4551-ae4a-e9d11400ad7b tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 200 len: 1141 microversion: 2.1 time: 0.409130 Jul 30 21:06:27.846331 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 741/1496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:27 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 1141 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:27.861626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:27.862607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:27.885759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.888955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:27.890203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:27.890943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:28.232665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:28.241213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-227e9506-80f7-44aa-b0a1-2112ba450740 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1521 microversion: 2.1 time: 0.393433 Jul 30 21:06:28.242162 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 742/1497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:27 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:28.247761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a973e927-f707-479a-83de-f5a8a4ee8b1e req-eaf3f06d-d116-4bf7-a755-8edd7536def5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58612e09-b9e2-4a54-adea-ca6664d46930", "name": "network-vif-deleted", "tag": "507d6eec-0fdd-4088-9ad6-489f49cc80aa"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:28.259160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a973e927-f707-479a-83de-f5a8a4ee8b1e req-eaf3f06d-d116-4bf7-a755-8edd7536def5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:28.259947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a973e927-f707-479a-83de-f5a8a4ee8b1e req-eaf3f06d-d116-4bf7-a755-8edd7536def5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:28.274701 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a973e927-f707-479a-83de-f5a8a4ee8b1e req-eaf3f06d-d116-4bf7-a755-8edd7536def5 service nova] Creating event network-vif-deleted:507d6eec-0fdd-4088-9ad6-489f49cc80aa for instance 58612e09-b9e2-4a54-adea-ca6664d46930 on nch1-master-1 Jul 30 21:06:28.280510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a973e927-f707-479a-83de-f5a8a4ee8b1e req-eaf3f06d-d116-4bf7-a755-8edd7536def5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 Jul 30 21:06:28.281498 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 743/1498] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:28.287024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:28.288018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:28.294870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:28.295347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:28.296153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:28.296792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:28.635421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:28.644919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:28.646932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:28.648365 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d97d1ce3-7722-49da-9962-0a9df1e111f8 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 200 len: 1482 microversion: 2.25 time: 0.365580 Jul 30 21:06:28.649381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 744/1499] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:28 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 1482 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:28.654407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df474f32-5648-43dd-b011-1e5636404e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d32d9d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:28.741055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df474f32-5648-43dd-b011-1e5636404e87 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1847300583" status: 200 len: 485 microversion: 2.1 time: 0.090183 Jul 30 21:06:28.741953 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 745/1500] 10.222.0.17 () {58 vars in 1231 bytes} [Sat Jul 30 21:06:28 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1847300583 => generated 485 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:28.747759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1567274882", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:28.812622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:06:28.975084 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c633fa96-68d2-44fe-96cd-c6d1a603ce2f tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.595231 Jul 30 21:06:28.975976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 756/1501] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:06:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:28.981502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-00a5e3ef-3e57-4f73-9ef4-5dd0da6ed278 req-661e6ec8-f812-4ccd-97e7-84c837f14bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d8e6b3-e409-4478-a027-a64a6e76ab67", "name": "network-vif-deleted", "tag": "04af983f-2705-47b6-8aa0-cdfbd34d3707"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:28.994274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-00a5e3ef-3e57-4f73-9ef4-5dd0da6ed278 req-661e6ec8-f812-4ccd-97e7-84c837f14bff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:28.996145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-00a5e3ef-3e57-4f73-9ef4-5dd0da6ed278 req-661e6ec8-f812-4ccd-97e7-84c837f14bff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.010856 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-00a5e3ef-3e57-4f73-9ef4-5dd0da6ed278 req-661e6ec8-f812-4ccd-97e7-84c837f14bff service nova] Creating event network-vif-deleted:04af983f-2705-47b6-8aa0-cdfbd34d3707 for instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 on nch2-master-1 Jul 30 21:06:29.017437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-00a5e3ef-3e57-4f73-9ef4-5dd0da6ed278 req-661e6ec8-f812-4ccd-97e7-84c837f14bff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039317 Jul 30 21:06:29.018367 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 757/1502] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:29.024658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:29.025278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:29.033696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.034974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.035988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.036601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.122500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:29.131801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-380c38e6-d0b6-41a2-9f4a-fc5107901a3c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1265 microversion: 2.1 time: 0.111973 Jul 30 21:06:29.133431 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 758/1503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:29 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:29.140108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:29.140763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:29.164605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.165438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.166957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.168564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.268369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:06:29.268908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:06:29.270645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:06:29.271669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:06:29.273477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:06:29.303641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.304326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.305217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.306294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.333664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Getting quotas for project ebe60ae219554ca1839242aa20d2bda7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:06:29.340006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Getting quotas for user f820053bb2d942fd968b7129b2faae47 and project ebe60ae219554ca1839242aa20d2bda7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:06:29.357478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:06:29.360955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:06:29.366331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:29.381191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cac9d286-2093-421d-b77e-98ec41f594cd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1467 microversion: 2.1 time: 0.245980 Jul 30 21:06:29.381815 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 759/1504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:29 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1467 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:29.404716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-51112279"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:29.407578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:29.425426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.427901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.431416 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8326afc-1b8f-4cd6-820f-4585790152b0 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687144 Jul 30 21:06:29.433090 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 746/1505] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:06:29.438625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5d1936f4-75ac-4d67-be08-b92cafab4ce0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cffe1f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:29.455010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.456611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.616367 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5d1936f4-75ac-4d67-be08-b92cafab4ce0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?server=e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 957 microversion: 2.1 time: 0.181780 Jul 30 21:06:29.619168 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 747/1506] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:06:29 2022] GET /compute/v2.1/images?server=e91695d7-6216-4040-acf5-7ddf3498aeac => generated 957 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:29.637882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:29.638578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 58612e09-b9e2-4a54-adea-ca6664d46930] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:29.652778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.653250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.656887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.658389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.702919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] HTTP exception thrown: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Request method failure captured: Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 HTTP/1.1 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zv21b3OqmWG1rd4QASk77xiO5YBFooI8ww0H_6Z5Yb0DYDfVj5V0HJvL35VZnr2aTyc87BA--ohzE5KAGAkyUe7HSGRFJPfgC200D1uMPR-AsBqegS7SVlC4xRzEY_1LPIB5EdWtdyY3Xy1bci2FOxbSSMSE52caBzMMmuNVncN9Q4 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:29.705532 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81fb262c72e0468e92246bf31d93a204", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-LiveMigrationTest-774293737 Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 96815c6776f1464a8b6350b4a52d4548 Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. Jul 30 21:06:29.707377 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '58612e09-b9e2-4a54-adea-ca6664d46930'} Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:29.708645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. Jul 30 21:06:29.710301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:29.712596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Returning 404 to user: Instance 58612e09-b9e2-4a54-adea-ca6664d46930 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:29.712596 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-12dbb83a-6ff8-4232-b1ec-826bbde51919 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930" status: 404 len: 111 microversion: 2.1 time: 0.085593 Jul 30 21:06:29.712596 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 748/1507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:29 2022] GET /compute/v2.1/servers/58612e09-b9e2-4a54-adea-ca6664d46930 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:29.719653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be3ca252-b0ed-44e9-821d-cfc43734d92b tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Action: 'create', calling method: .version_select at 0x7fbb5d2c29d0>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:29.922254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2573559-c04f-4814-bc35-56ed97ee2f38 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703/action" status: 202 len: 0 microversion: 2.1 time: 0.539086 Jul 30 21:06:29.929451 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 760/1508] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:29 2022] POST /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:06:29.937331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:29.938180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:29.945405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.946196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:29.947196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:29.948398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.137359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:30.148211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51d24890-1feb-441d-bbca-856a5737ecea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 200 len: 1468 microversion: 2.1 time: 0.216727 Jul 30 21:06:30.151785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 761/1509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:29 2022] GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:30.159879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.160837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:30.170340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.170912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.171841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.172396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.242935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:30.252464 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73c45e0a-7ac9-4f6c-847e-c1aeb375d222 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1226 microversion: 2.1 time: 0.099314 Jul 30 21:06:30.253427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 762/1510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:30 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:30.259157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b31bff00-d763-44d8-beca-c7b04154940b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd06430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.318368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b31bff00-d763-44d8-beca-c7b04154940b tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 485 microversion: 2.1 time: 0.063592 Jul 30 21:06:30.326487 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 763/1511] 10.222.0.17 () {58 vars in 1317 bytes} [Sat Jul 30 21:06:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:30.326487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.326487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 95e02e9d-1ab9-47de-b94d-8e12af04955b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:30.333347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.333892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.334845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.335445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.350219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] HTTP exception thrown: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Request method failure captured: Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b HTTP/1.1 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwKyrqVtNBnTcM3tMzjdgdgQQChdI0dcRu2Gm86sGf9h8AyaWcpS2Um4X6YcmxEBVmlbosf_HWDU49JoLP3Ab-FkH8q7dDyh94JIoRHqB2yfmAMcZqMO8P29-MVRyLjIFTnmyfQoWyx6iW-FOeB3usv4ESiWn-JovJdOidIC9EaQao Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.25 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:30.352001 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bfb74be507694713821cb1a68619f9e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 46d7264a2f63436bb8519cd8cec6d9f5 Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. Jul 30 21:06:30.353815 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '95e02e9d-1ab9-47de-b94d-8e12af04955b'} Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:30.354826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. Jul 30 21:06:30.356404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:30.358700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Returning 404 to user: Instance 95e02e9d-1ab9-47de-b94d-8e12af04955b could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:30.358700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d365ec9a-d100-4505-8eb0-53715013dc50 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b" status: 404 len: 111 microversion: 2.25 time: 0.034719 Jul 30 21:06:30.361663 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 764/1512] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:30 2022] GET /compute/v2.1/servers/95e02e9d-1ab9-47de-b94d-8e12af04955b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:06:30.366985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ddf674c0-3080-4a91-88d4-ccbb87b6a924 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb5cd06670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.554750 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ddf674c0-3080-4a91-88d4-ccbb87b6a924 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c" status: 204 len: 0 microversion: 2.1 time: 0.191795 Jul 30 21:06:30.555460 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 765/1513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:30 2022] DELETE /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:30.562598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.563764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:30.571656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.571944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.573313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.574009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.798452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:30.823321 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92d3f556-2b0b-4fde-85df-6e618e99cf03 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.265841 Jul 30 21:06:30.825165 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 766/1514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:30 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:30.830699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:30.844592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:30.846108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Searching by: {'reservation_id': 'r-kgprgvox', 'deleted': False, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:06:30.856945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.857698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.859526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:30.860721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:30.986845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:06:31.098468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:31.122877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.124260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.301486 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d16ca66f-8020-4d9d-b1ad-e40104c3d364 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-kgprgvox" status: 200 len: 2928 microversion: 2.1 time: 0.474806 Jul 30 21:06:31.303327 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 767/1515] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Jul 30 21:06:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-kgprgvox => generated 2928 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:31.309532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6aceaccc-565c-4cc7-864b-91c9bc44a20f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cd065e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.410525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6aceaccc-565c-4cc7-864b-91c9bc44a20f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 485 microversion: 2.1 time: 0.105504 Jul 30 21:06:31.411112 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 768/1516] 10.222.0.17 () {58 vars in 1303 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 485 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:31.415998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d48cf30b-68eb-44de-986c-2076d8521eb2 req-5900e622-0eb3-4415-b437-ad3fa261a1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e02e9d-1ab9-47de-b94d-8e12af04955b", "name": "network-vif-deleted", "tag": "34bd0d71-e49d-43c6-9423-cd886e7af073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:31.428880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d48cf30b-68eb-44de-986c-2076d8521eb2 req-5900e622-0eb3-4415-b437-ad3fa261a1b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.429337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d48cf30b-68eb-44de-986c-2076d8521eb2 req-5900e622-0eb3-4415-b437-ad3fa261a1b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.441186 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d48cf30b-68eb-44de-986c-2076d8521eb2 req-5900e622-0eb3-4415-b437-ad3fa261a1b9 service nova] Creating event network-vif-deleted:34bd0d71-e49d-43c6-9423-cd886e7af073 for instance 95e02e9d-1ab9-47de-b94d-8e12af04955b on nch2-master-1 Jul 30 21:06:31.446326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d48cf30b-68eb-44de-986c-2076d8521eb2 req-5900e622-0eb3-4415-b437-ad3fa261a1b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Jul 30 21:06:31.447027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 769/1517] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:31.453299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2e52b5d-69fb-40b5-96cf-16c280608ec1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb5ced8ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.477456 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-f2e52b5d-69fb-40b5-96cf-16c280608ec1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Image not found. Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2e52b5d-69fb-40b5-96cf-16c280608ec1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c HTTP/1.1 Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:31.510780 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c'} Jul 30 21:06:31.512777 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:31.513944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:31.520743 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c could not be found. Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:31.522844 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:31.524437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2e52b5d-69fb-40b5-96cf-16c280608ec1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:31.525670 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f2e52b5d-69fb-40b5-96cf-16c280608ec1 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c" status: 404 len: 62 microversion: 2.1 time: 0.064244 Jul 30 21:06:31.525670 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 770/1518] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:31.527966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.527966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:31.537345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.537345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.537907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.538437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.618450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:31.628425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1064ffd-8fef-4dd5-9386-2d4afb1bf03f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1280 microversion: 2.1 time: 0.111032 Jul 30 21:06:31.629025 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 771/1519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:31.634223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1dce922-3e9d-4e6f-8174-df4a2ab4dea7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.651691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.server_groups [None req-d1dce922-3e9d-4e6f-8174-df4a2ab4dea7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Querying cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) for 2 instances {{(pid=130984) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 30 21:06:31.652525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1dce922-3e9d-4e6f-8174-df4a2ab4dea7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.653106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1dce922-3e9d-4e6f-8174-df4a2ab4dea7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.676189 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1dce922-3e9d-4e6f-8174-df4a2ab4dea7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/0bbfb402-6390-47ca-a78d-fbea5b1ba88a" status: 200 len: 270 microversion: 2.1 time: 0.046060 Jul 30 21:06:31.676790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 772/1520] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/os-server-groups/0bbfb402-6390-47ca-a78d-fbea5b1ba88a => generated 270 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:31.681587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61a60a5d-2dd8-44fd-8b7b-3dcd14c86cda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d00b310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.799563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61a60a5d-2dd8-44fd-8b7b-3dcd14c86cda tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.121539 Jul 30 21:06:31.800071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 773/1521] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:31.804816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.805730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:31.815860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.816674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.817489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.817946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.951187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:31.954914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:31.960145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-423bb03b-d252-4a04-8542-7fe27e8ebb34 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1539 microversion: 2.1 time: 0.158914 Jul 30 21:06:31.961202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 774/1522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:31 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:31.966465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:31.966964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:31.979684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.980375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:31.981395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:31.982061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.009689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:32.087372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:32.101252 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-297defe8-ca8b-428f-8eb9-767c68093177 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 204 len: 0 microversion: 2.25 time: 0.139168 Jul 30 21:06:32.102262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 775/1523] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:06:31 2022] DELETE /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:06:32.109450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.110364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:32.117551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.118022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.118953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.119642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.255938 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-842b5cf1-13fe-443b-bf5e-d17ef6c3c9a8 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1618 microversion: 2.1 time: 0.152122 Jul 30 21:06:32.256524 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 776/1524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1618 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:32.261975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a2d9cf6-12b5-4462-aca8-c984fe6b40aa tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d025700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.353061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a2d9cf6-12b5-4462-aca8-c984fe6b40aa tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.095454 Jul 30 21:06:32.353710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 777/1525] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:32.367051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.367697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:32.374764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.375237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.376054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.376600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.528409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:32.536923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6771b5f-5612-447b-b94b-2914204c0b75 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.173743 Jul 30 21:06:32.537823 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 778/1526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:32.543199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.544113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:32.550933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.551643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.552531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.553073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.583672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:32.666120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0368a48d-45db-4336-adc1-b958b8fde5f0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 204 len: 0 microversion: 2.1 time: 0.126596 Jul 30 21:06:32.669685 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 779/1527] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:32 2022] DELETE /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:32.673250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.673751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:32.680067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.680541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.681477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.682666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.850264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:32.860223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:32.862193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:32.863605 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ccd62980-1320-42d6-b22d-ee1b00eb7ac9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1732 microversion: 2.25 time: 0.195666 Jul 30 21:06:32.864667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 780/1528] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:32.870494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.871477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:32.878578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.879237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.880552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:32.881017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:32.900183 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be3ca252-b0ed-44e9-821d-cfc43734d92b tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.187980 Jul 30 21:06:32.900885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 749/1529] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:06:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:32.905601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f6cd4f1a-2536-48f9-b039-1480b90913ed tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1b20d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:32.993824 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f6cd4f1a-2536-48f9-b039-1480b90913ed tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.091753 Jul 30 21:06:33.010607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 750/1530] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:33.019409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.027606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:33.047321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.049357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.050363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.051038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.102263 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-54b2e143-fc0b-4cde-a5f3-c1c80fdbb764 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 200 len: 1619 microversion: 2.1 time: 0.235648 Jul 30 21:06:33.125155 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 781/1531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:32 2022] GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 1619 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:33.125155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.125155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:33.125155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.125155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.125959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.125959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.317217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:33.325864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:33.329566 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2dde3c6-6f58-4b5a-a5d1-ecce7429596f tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1667 microversion: 2.1 time: 0.217528 Jul 30 21:06:33.330160 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 782/1532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:33 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:33.333536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-59b99080-735e-419d-a912-96a81daa01ea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.320859 Jul 30 21:06:33.346951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b08bd9f2-4c23-4b09-8463-1be667a0ff06 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d078310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.348262 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 751/1533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:33 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:33.353738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.355251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:33.361817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.362523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.363548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.364152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.544933 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b08bd9f2-4c23-4b09-8463-1be667a0ff06 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/530cb3f5-f026-4826-b18d-6678d5661029" status: 200 len: 142 microversion: 2.1 time: 0.213378 Jul 30 21:06:33.552734 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 783/1534] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:06:33 2022] GET /compute/v2.1/os-floating-ips/530cb3f5-f026-4826-b18d-6678d5661029 => generated 142 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:33.552734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f29d6d9-d01c-4d6e-9b89-17b21f9bb145 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0788b0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.644253 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f29d6d9-d01c-4d6e-9b89-17b21f9bb145 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?changes-since=2022-07-30T21%3A04%3A30Z" status: 200 len: 6333 microversion: 2.1 time: 0.097431 Jul 30 21:06:33.645128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 784/1535] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 30 21:06:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-30T21%3A04%3A30Z => generated 6333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:33.649935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1239715767", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7f920502-e0cf-43aa-93ba-62d50d7905d7"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:33.711118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:06:33.725288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:33.734136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f226103b-3789-4cac-a432-b702620a7764 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1539 microversion: 2.1 time: 0.384482 Jul 30 21:06:33.734834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 752/1536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:33 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1539 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:33.739994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8187ff5b-792d-4a7b-a771-568ef32c5920 req-7579ebfd-ad4b-45b9-acd3-7a156231fc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acde74b-d13f-486b-92ed-9da11ed229af", "tag": "ca530d4a-b837-417f-8262-587ab295da34"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:33.755959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8187ff5b-792d-4a7b-a771-568ef32c5920 req-7579ebfd-ad4b-45b9-acd3-7a156231fc08 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.756635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8187ff5b-792d-4a7b-a771-568ef32c5920 req-7579ebfd-ad4b-45b9-acd3-7a156231fc08 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.778139 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8187ff5b-792d-4a7b-a771-568ef32c5920 req-7579ebfd-ad4b-45b9-acd3-7a156231fc08 service nova] Creating event network-changed:ca530d4a-b837-417f-8262-587ab295da34 for instance 9acde74b-d13f-486b-92ed-9da11ed229af on nch2-master-1 Jul 30 21:06:33.784774 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8187ff5b-792d-4a7b-a771-568ef32c5920 req-7579ebfd-ad4b-45b9-acd3-7a156231fc08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048473 Jul 30 21:06:33.785670 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 753/1537] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:33.791986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8740c25f-5d9b-4179-94da-47cd5333a160 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d1c5040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:33.944768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:06:33.945202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:06:33.945682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:06:33.946097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:06:33.946516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:06:33.956583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.957049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.957866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:33.958324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:33.977584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:06:33.982036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:06:34.003144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:06:34.012596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:06:34.059818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-530a8207-35aa-4828-9c4b-470eaf759d79 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.413292 Jul 30 21:06:34.068361 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 785/1538] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:06:34.068361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:34.068361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:34.074743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.075373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:34.076261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.076809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:34.357120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:34.366459 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d76832b7-0c3b-4d4d-b7ad-b3ea4a7a74d4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.304497 Jul 30 21:06:34.368347 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 786/1539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:34 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:34.378289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-99a5f4b9-8556-4ca7-b309-e634a6132004 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d6d1430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:34.448204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-99a5f4b9-8556-4ca7-b309-e634a6132004 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1847300583" status: 200 len: 665 microversion: 2.1 time: 0.076774 Jul 30 21:06:34.449917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 787/1540] 10.222.0.17 () {58 vars in 1252 bytes} [Sat Jul 30 21:06:34 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1847300583 => generated 665 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:34.459215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:34.460254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:34.467751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.468359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:34.469317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.469904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:34.587041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:34.598144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:34.601261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:34.602636 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b62c1915-a934-404b-badb-46a9feeffbba tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1666 microversion: 2.25 time: 0.150488 Jul 30 21:06:34.608422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 788/1541] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:34 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:34.615066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f811d44b-9ce9-4635-bb91-f41c63be2c84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:34.615735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f811d44b-9ce9-4635-bb91-f41c63be2c84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:34.731826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f811d44b-9ce9-4635-bb91-f41c63be2c84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:34.740207 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f811d44b-9ce9-4635-bb91-f41c63be2c84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1217 microversion: 2.1 time: 0.130392 Jul 30 21:06:34.755940 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 789/1542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:34 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:34.762355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:34.763463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:34.772786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.773626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:34.774885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:34.776113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.039980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:35.055972 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f9f6cee-04f9-4936-8690-e1ce68c797b8 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.298358 Jul 30 21:06:35.057982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 790/1543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:34 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.063164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.063858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:35.071194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.071916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.075351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.077849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.194817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:35.203877 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23803342-a5c0-4cc4-933c-9eaa665e873a tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 200 len: 1599 microversion: 2.1 time: 0.144466 Jul 30 21:06:35.204386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 791/1544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:35 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.209072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f471cc72-9b9e-499b-b816-9ec67083529f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0e4160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.269257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f471cc72-9b9e-499b-b816-9ec67083529f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1467 microversion: 2.1 time: 0.063600 Jul 30 21:06:35.270059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 792/1545] 10.222.0.17 () {58 vars in 1338 bytes} [Sat Jul 30 21:06:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1467 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.274913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.275865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:35.299775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.305528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.306706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.307056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.548684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:35.560235 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-492d76f9-69ab-48b4-8691-6f9fd8cae068 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1521 microversion: 2.1 time: 0.289100 Jul 30 21:06:35.577984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 793/1546] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:35 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.584264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d896a74c-aff4-4c69-b814-da5f1e1bcc00 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d078310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.675181 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d896a74c-aff4-4c69-b814-da5f1e1bcc00 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1467 microversion: 2.1 time: 0.095753 Jul 30 21:06:35.676780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 794/1547] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Jul 30 21:06:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1467 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.682559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-199aa27b-12b9-4ee0-8950-f2b495953272 req-735c2f5b-c0e4-4b79-af88-2294f810aef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f5803-c208-4680-a8cd-11e41ddd0935", "name": "network-vif-deleted", "tag": "1aaaff94-1cd7-4aaa-95ca-522aaf313b3b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:35.697295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-199aa27b-12b9-4ee0-8950-f2b495953272 req-735c2f5b-c0e4-4b79-af88-2294f810aef1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.698032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-199aa27b-12b9-4ee0-8950-f2b495953272 req-735c2f5b-c0e4-4b79-af88-2294f810aef1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.709762 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-199aa27b-12b9-4ee0-8950-f2b495953272 req-735c2f5b-c0e4-4b79-af88-2294f810aef1 service nova] Creating event network-vif-deleted:1aaaff94-1cd7-4aaa-95ca-522aaf313b3b for instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 on nch2-master-1 Jul 30 21:06:35.716098 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-199aa27b-12b9-4ee0-8950-f2b495953272 req-735c2f5b-c0e4-4b79-af88-2294f810aef1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037991 Jul 30 21:06:35.716745 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 795/1548] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:35.725715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.726438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:35.733479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.734181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.735135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.735765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.758213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:35.920307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:35.930528 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fb6c77f-2491-4231-838b-5c47b4cda6f6 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.209377 Jul 30 21:06:35.932785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 796/1549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:35 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:35.937482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:35.938158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:35.944857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.945516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.946482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:35.948243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:35.977878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:36.162088 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21840d58-9b3f-420b-8338-033b34ff20a9 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 204 len: 0 microversion: 2.1 time: 0.227850 Jul 30 21:06:36.162929 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 797/1550] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:35 2022] DELETE /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:36.171891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.172855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:36.179183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.179688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.180487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.181841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.258148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:36.269048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:36.270706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:36.271932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a9d8c22-a50f-4bed-8144-0413f648af5e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1666 microversion: 2.25 time: 0.107424 Jul 30 21:06:36.272729 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 798/1551] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1666 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:36.277465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de720cb8-5599-49f5-be18-309844d66532 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d6d1dc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.480531 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de720cb8-5599-49f5-be18-309844d66532 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.206867 Jul 30 21:06:36.481158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 799/1552] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:36.485866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.486684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:36.509102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.509577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.510541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.510995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.602578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:36.615322 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f998b82f-9132-4ab0-b379-14b1ed83e02b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1275 microversion: 2.1 time: 0.132852 Jul 30 21:06:36.616633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 800/1553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:36.622115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.622966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:36.635427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.636512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.637320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.637789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.891633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:36.900482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e1ceeaa-42e8-46d0-98eb-0cd54987be8e tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.282534 Jul 30 21:06:36.917061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 801/1554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:36.922347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.923675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:36.939948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.940426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.943120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.943687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.971941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8740c25f-5d9b-4179-94da-47cd5333a160 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/530cb3f5-f026-4826-b18d-6678d5661029" status: 202 len: 0 microversion: 2.1 time: 3.184737 Jul 30 21:06:36.972594 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 754/1555] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:06:33 2022] DELETE /compute/v2.1/os-floating-ips/530cb3f5-f026-4826-b18d-6678d5661029 => generated 0 bytes in 3186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:36.978229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:36.979307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 9f1f5803-c208-4680-a8cd-11e41ddd0935] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:36.993694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.994500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:36.995623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:36.996624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.025753 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] HTTP exception thrown: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Request method failure captured: Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 HTTP/1.1 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zv21b3OqmWG1rd4QASk77xiO5YBFooI8ww0H_6Z5Yb0DYDfVj5V0HJvL35VZnr2aTyc87BA--ohzE5KAGAkyUe7HSGRFJPfgC200D1uMPR-AsBqegS7SVlC4xRzEY_1LPIB5EdWtdyY3Xy1bci2FOxbSSMSE52caBzMMmuNVncN9Q4 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:37.028540 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81fb262c72e0468e92246bf31d93a204", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-LiveMigrationTest-774293737 Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 96815c6776f1464a8b6350b4a52d4548 Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. Jul 30 21:06:37.029992 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '9f1f5803-c208-4680-a8cd-11e41ddd0935'} Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:37.030764 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. Jul 30 21:06:37.032428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:37.033883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Returning 404 to user: Instance 9f1f5803-c208-4680-a8cd-11e41ddd0935 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:37.033883 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-782f3670-a1f7-45c9-91bb-37607c7d1573 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935" status: 404 len: 111 microversion: 2.1 time: 0.056319 Jul 30 21:06:37.033883 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 755/1556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/servers/9f1f5803-c208-4680-a8cd-11e41ddd0935 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:37.038731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0af326a4-3e8d-488a-a952-1edb8b93b894 req-4741f6e8-02b3-4445-a812-2fda2dd78041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6baf4d-2456-4286-a493-ab0b890becf0", "name": "network-vif-deleted", "tag": "aeacf533-0e3f-4a28-8755-15ec9ab3f65c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:37.058599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0af326a4-3e8d-488a-a952-1edb8b93b894 req-4741f6e8-02b3-4445-a812-2fda2dd78041 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:37.059141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0af326a4-3e8d-488a-a952-1edb8b93b894 req-4741f6e8-02b3-4445-a812-2fda2dd78041 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.074254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0af326a4-3e8d-488a-a952-1edb8b93b894 req-4741f6e8-02b3-4445-a812-2fda2dd78041 service nova] Creating event network-vif-deleted:aeacf533-0e3f-4a28-8755-15ec9ab3f65c for instance bb6baf4d-2456-4286-a493-ab0b890becf0 on nch1-master-1 Jul 30 21:06:37.096444 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0af326a4-3e8d-488a-a952-1edb8b93b894 req-4741f6e8-02b3-4445-a812-2fda2dd78041 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063514 Jul 30 21:06:37.097439 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 756/1557] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:37.105517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2036abf9-9ccc-4ac4-affb-a979d0d559a1 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1b2ca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.206623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2036abf9-9ccc-4ac4-affb-a979d0d559a1 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.107703 Jul 30 21:06:37.211122 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 757/1558] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:37.216396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.222790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:37.224390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:37.230191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:37.230949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.233864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:37.234696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.237937 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b32d9c93-af53-491c-b807-354e95ffca77 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1527 microversion: 2.1 time: 0.319989 Jul 30 21:06:37.243788 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 802/1559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:36 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:37.252027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85872b7e-973f-4079-a9db-ca695296e865 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d5824c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.557948 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85872b7e-973f-4079-a9db-ca695296e865 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.312468 Jul 30 21:06:37.559080 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 803/1560] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:06:37.565132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0b9e8c8-d13c-4308-b4da-73a55d890b84 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '.version_select at 0x7fbb5d078310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.579203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:37.587709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78b95991-5d92-4ccd-927f-579750834e0b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.375140 Jul 30 21:06:37.594378 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 758/1561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:37.612260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ed027c9-d648-49af-975f-15dec1dab6f3 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1b2700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.621311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0b9e8c8-d13c-4308-b4da-73a55d890b84 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294741800" status: 202 len: 0 microversion: 2.1 time: 0.060449 Jul 30 21:06:37.622808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 804/1562] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294741800 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:37.630649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:37.633158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:37.667018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:37.668783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.672738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:37.673242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:37.694319 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ed027c9-d648-49af-975f-15dec1dab6f3 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd" status: 200 len: 784 microversion: 2.1 time: 0.096058 Jul 30 21:06:37.696449 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 759/1563] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd => generated 784 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:37.704858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b88a5fb1-e7b8-4417-81eb-21fa6946b700 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d2e9d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:38.110544 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b88a5fb1-e7b8-4417-81eb-21fa6946b700 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.408705 Jul 30 21:06:38.112712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 760/1564] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:38.117438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:38.118304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:38.136633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:38.138955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:38.140036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:38.140704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:38.271725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:38.288347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:38.292017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:38.294125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd3f4592-01d6-4784-86e4-e756e249f538 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 200 len: 1371 microversion: 2.25 time: 0.669949 Jul 30 21:06:38.294954 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 805/1565] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:37 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 1371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:38.301145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-429255a0-e727-4d0f-b8b6-1c4102aeaca9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0b3820>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:38.423433 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-429255a0-e727-4d0f-b8b6-1c4102aeaca9 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.127136 Jul 30 21:06:38.424144 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 806/1566] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:06:38 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:38.429092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:38.429759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:38.437223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:38.437906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:38.438716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:38.439225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:38.601921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:38.610552 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03cf8ff4-724d-40cd-9026-0522bfa9e61b tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.185071 Jul 30 21:06:38.611152 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 807/1567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:38 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:38.617347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39199f6a-5ec3-4d31-b82f-35f9aac47ff0 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d0b3160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:39.054869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:39.068861 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fdc5fc40-5847-4f5e-b273-05cd59c1d9ac tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.954980 Jul 30 21:06:39.069601 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 761/1568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:38 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:39.074383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:39.075282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:39.082001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.082947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.084768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.085879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.094084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:39.318658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:39.349303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:39.376984 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39199f6a-5ec3-4d31-b82f-35f9aac47ff0 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/340c8653-7736-4e17-9a5d-9dec0dc5f71b" status: 202 len: 0 microversion: 2.1 time: 0.764506 Jul 30 21:06:39.377688 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 808/1569] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:06:38 2022] DELETE /compute/v2.1/os-floating-ips/340c8653-7736-4e17-9a5d-9dec0dc5f71b => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:39.382524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f672574f-679f-4cf9-ac8f-5ecdf9789224 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0b34c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:39.546273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:39.554729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a548de08-89c5-4b41-b3db-abf831d24fbb tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 200 len: 1527 microversion: 2.1 time: 0.483588 Jul 30 21:06:39.555363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 762/1570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:39 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 1527 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:39.560016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:39.560640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:39.569184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.569821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.571426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.571687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.847921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f672574f-679f-4cf9-ac8f-5ecdf9789224 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c" status: 204 len: 0 microversion: 2.1 time: 0.469052 Jul 30 21:06:39.848674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 809/1571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:39 2022] DELETE /compute/v2.1/images/272810be-ed1e-42e8-85ec-9da97334450c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:39.854233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e6ecc400-a5df-43ed-ab18-68ba70fedd3f req-026d534a-2d2e-41ec-ad3b-9510c2eccdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acde74b-d13f-486b-92ed-9da11ed229af", "name": "network-vif-plugged", "status": "completed", "tag": "ca530d4a-b837-417f-8262-587ab295da34"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:39.866669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6ecc400-a5df-43ed-ab18-68ba70fedd3f req-026d534a-2d2e-41ec-ad3b-9510c2eccdce service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.867215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6ecc400-a5df-43ed-ab18-68ba70fedd3f req-026d534a-2d2e-41ec-ad3b-9510c2eccdce service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.878402 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e6ecc400-a5df-43ed-ab18-68ba70fedd3f req-026d534a-2d2e-41ec-ad3b-9510c2eccdce service nova] Creating event network-vif-plugged:ca530d4a-b837-417f-8262-587ab295da34 for instance 9acde74b-d13f-486b-92ed-9da11ed229af on nch2-master-1 Jul 30 21:06:39.883498 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e6ecc400-a5df-43ed-ab18-68ba70fedd3f req-026d534a-2d2e-41ec-ad3b-9510c2eccdce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Jul 30 21:06:39.884229 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 810/1572] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:39.889885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-521fc346-984f-4936-803e-2a74dd0fb5f2 req-31314765-9651-4c61-8bb1-e8ec327f1dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2", "tag": "ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:39.900238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-521fc346-984f-4936-803e-2a74dd0fb5f2 req-31314765-9651-4c61-8bb1-e8ec327f1dd4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.901553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-521fc346-984f-4936-803e-2a74dd0fb5f2 req-31314765-9651-4c61-8bb1-e8ec327f1dd4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.919190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-521fc346-984f-4936-803e-2a74dd0fb5f2 req-31314765-9651-4c61-8bb1-e8ec327f1dd4 service nova] Creating event network-changed:ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd for instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 on nch2-master-1 Jul 30 21:06:39.925132 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-521fc346-984f-4936-803e-2a74dd0fb5f2 req-31314765-9651-4c61-8bb1-e8ec327f1dd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038949 Jul 30 21:06:39.927329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 811/1573] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:39.931141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:39.931930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: bb6baf4d-2456-4286-a493-ab0b890becf0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:39.938580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.939036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.940145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:39.940695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:39.955807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] HTTP exception thrown: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Request method failure captured: Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 HTTP/1.1 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwKyrqVtNBnTcM3tMzjdgdgQQChdI0dcRu2Gm86sGf9h8AyaWcpS2Um4X6YcmxEBVmlbosf_HWDU49JoLP3Ab-FkH8q7dDyh94JIoRHqB2yfmAMcZqMO8P29-MVRyLjIFTnmyfQoWyx6iW-FOeB3usv4ESiWn-JovJdOidIC9EaQao Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.25 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:39.957494 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bfb74be507694713821cb1a68619f9e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 46d7264a2f63436bb8519cd8cec6d9f5 Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. Jul 30 21:06:39.959349 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'bb6baf4d-2456-4286-a493-ab0b890becf0'} Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:39.960376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. Jul 30 21:06:39.962208 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:39.964254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Returning 404 to user: Instance bb6baf4d-2456-4286-a493-ab0b890becf0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:39.964254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f0cdeb7-be44-4161-adf1-a37a6b56ad51 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0" status: 404 len: 111 microversion: 2.25 time: 0.031982 Jul 30 21:06:39.964254 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 812/1574] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:39 2022] GET /compute/v2.1/servers/bb6baf4d-2456-4286-a493-ab0b890becf0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:06:39.968369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e91f751a-34ac-4644-a2c4-aa0c57275276 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d47d1f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:40.082836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:40.098151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27f03d97-8f6f-4683-8081-c799fa23fcf1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1307 microversion: 2.1 time: 0.541790 Jul 30 21:06:40.100260 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 763/1575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:39 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1307 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:40.105207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:40.105844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:40.124251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:40.124251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:40.124991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:40.125796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:40.506554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:40.515217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37987361-1c38-432f-b52d-49bd2bb932a9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.413708 Jul 30 21:06:40.515916 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 764/1576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:40 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:40.520672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0defded7-a0b1-4bbe-859b-00f4d22d8a11 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d1bf8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:40.814352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e91f751a-34ac-4644-a2c4-aa0c57275276 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/6fee362c-fdcb-4720-955d-27570bb094e7" status: 202 len: 0 microversion: 2.1 time: 0.849371 Jul 30 21:06:40.816018 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 813/1577] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:06:39 2022] DELETE /compute/v2.1/os-floating-ips/6fee362c-fdcb-4720-955d-27570bb094e7 => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:40.823650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9398501-d56f-4500-9ce0-84112065bc2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '.version_select at 0x7fbb5cf3cca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:40.854479 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9398501-d56f-4500-9ce0-84112065bc2e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645645957" status: 204 len: 0 microversion: 2.25 time: 0.035446 Jul 30 21:06:40.858270 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 814/1578] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645645957 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:06:40.864690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:40.865453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:40.879492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:40.880230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:40.881414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:40.882098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.085636 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0defded7-a0b1-4bbe-859b-00f4d22d8a11 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40" status: 204 len: 0 microversion: 2.1 time: 0.568396 Jul 30 21:06:41.093017 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 765/1579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:40 2022] DELETE /compute/v2.1/images/68a2094b-9289-4e2c-85d2-8c562c58fb40 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:41.100336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:41.100944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:41.108742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.109319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.110299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.110925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.124151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:41.135244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e939fff-ccd6-4624-b68d-23fbecbbf48a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.275401 Jul 30 21:06:41.137640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 815/1580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:40 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:41.142602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:41.145357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:41.161657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.162342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.165814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.172208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.175858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:41.189917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 HTTP/1.1 Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:41.191506 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:06:41.193139 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'fc34ecec-a31a-43eb-ab9b-a0021285c703'} Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:41.194061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:06:41.195944 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:41.199960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:41.200842 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea1815ef-b5fb-46e2-966f-5b8fc4e00929 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 404 len: 111 microversion: 2.1 time: 0.062179 Jul 30 21:06:41.201410 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 816/1581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:41 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:41.206110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-612cc81e-6bbb-4e34-8dca-a3e044c259c7 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] Calling method '.version_select at 0x7fbb5d685160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:41.294455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99c9531b-2e55-4bb1-9258-d88a1a59ca61 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 204 len: 0 microversion: 2.1 time: 0.199427 Jul 30 21:06:41.300697 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 766/1582] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:41 2022] DELETE /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:41.308171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47dac877-03ed-45c7-8393-c308192933f8 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d0a2310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:41.865508 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47dac877-03ed-45c7-8393-c308192933f8 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf" status: 204 len: 0 microversion: 2.1 time: 0.563455 Jul 30 21:06:41.867335 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 767/1583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:41 2022] DELETE /compute/v2.1/images/4d36153d-b8bb-479f-9877-dfa0b8f9cdaf => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:41.877019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:41.878136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:41.901770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.913015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:41.913890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:41.914358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.044183 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-612cc81e-6bbb-4e34-8dca-a3e044c259c7 tempest-FloatingIPDetailsTestJSON-1809031231 tempest-FloatingIPDetailsTestJSON-1809031231-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/35410bf1-16cc-4e8c-b378-3b4cab23e042" status: 202 len: 0 microversion: 2.1 time: 0.841547 Jul 30 21:06:42.044781 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 817/1584] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:06:41 2022] DELETE /compute/v2.1/os-floating-ips/35410bf1-16cc-4e8c-b378-3b4cab23e042 => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:42.050784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:42.051455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:42.059282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.059768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.060562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.061009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.200122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:42.209317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50e98404-fe68-4f71-a4ce-3b5182145acc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1485 microversion: 2.1 time: 0.339750 Jul 30 21:06:42.209902 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 768/1585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:41 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1485 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:42.215207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-21704107", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:42.273594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] validate_networks() for [('e9b6ef4c-098f-4393-8b14-740aa6ff0b62', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:06:42.302443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:42.311359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-faf1c9b9-3d6c-413b-8a0b-1fd8226a9ba0 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1485 microversion: 2.1 time: 0.265172 Jul 30 21:06:42.312692 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 818/1586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:42 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1485 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:42.318849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:42.319651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:42.331868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.332275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.333853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.334543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.554209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:42.567180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc3f6cf6-f2df-412b-9e33-c6c19b26bf22 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.252237 Jul 30 21:06:42.568455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 819/1587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:42 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:42.575322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:42.576051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:42.585372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.586029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.587272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.587962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.634433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:42.722869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:42.748318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-092886a2-b00a-4f91-a0d7-117440d2e971 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 204 len: 0 microversion: 2.1 time: 0.177492 Jul 30 21:06:42.749353 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 820/1588] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:42 2022] DELETE /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:42.755544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc34ecec-a31a-43eb-ab9b-a0021285c703", "name": "network-vif-deleted", "tag": "c08fc2ce-c881-4919-ad5a-721b88136053"}, {"name": "network-changed", "server_uuid": "7285cf80-45b6-4068-b7e7-92f13b546ce3", "tag": "7a461caf-836e-40bc-ae3c-16d18ee3333d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:42.767416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.767877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.788939 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] Creating event network-vif-deleted:c08fc2ce-c881-4919-ad5a-721b88136053 for instance fc34ecec-a31a-43eb-ab9b-a0021285c703 on nch1-master-1 Jul 30 21:06:42.789478 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] Creating event network-changed:7a461caf-836e-40bc-ae3c-16d18ee3333d for instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 on nch1-master-1 Jul 30 21:06:42.796534 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0db1dabf-31b0-4063-a89f-504841c65a98 req-98373ebb-fed7-4589-84b1-c669f7b67bb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045600 Jul 30 21:06:42.797372 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 821/1589] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:42.802484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:42.803082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:42.810903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.811141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.811915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.812642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.817816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:42.847874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:42.951135 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7304a968-0f68-42ad-acde-dd9341f0de0e tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 204 len: 0 microversion: 2.25 time: 0.152303 Jul 30 21:06:42.951820 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 822/1590] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:06:42 2022] DELETE /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:06:42.957626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:42.958957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:42.966402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.966879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:42.967863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:42.968400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.216385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:43.230299 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be6b414d-ad75-4f5b-b84b-dd58548bc29e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.276659 Jul 30 21:06:43.243633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 823/1591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:42 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:43.243633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-94807822"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:43.243633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:43.253089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.253956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.255467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.255919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.528116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:06:43.529192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:06:43.530121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:06:43.530940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:06:43.531693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:06:43.553137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.556531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.558257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.561073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.605504 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb18d66f-dca8-4c39-acab-0609ca1023a1 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "POST /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af/action" status: 202 len: 0 microversion: 2.1 time: 0.372454 Jul 30 21:06:43.621427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 824/1592] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:43 2022] POST /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 21:06:43.623040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:06:43.629717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:43.633251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Getting quotas for user 5b51cd5eda484fad9a901893f75d1b48 and project c4671c42e59f421192dea290a355021d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:06:43.637589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:43.654062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.655393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.656473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.657176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.664226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:06:43.679164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:06:43.754449 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75eb1334-cc3a-4d35-8f82-736f8576f011 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.543270 Jul 30 21:06:43.761789 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 769/1593] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:06:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:06:43.766984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:43.767622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:43.773913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.774383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.775177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:43.775797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:43.968481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:44.088033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.103267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.108967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.110214 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-222a8e69-eb0e-44b0-9e9e-d47d49bac356 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1549 microversion: 2.25 time: 0.347381 Jul 30 21:06:44.111571 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 770/1594] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:43 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1549 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:44.112877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.124247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.124877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:44.129004 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8ed9bba1-b38e-4950-aad0-4fb37cf81b17 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1474 microversion: 2.1 time: 0.505867 Jul 30 21:06:44.132438 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 825/1595] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:43 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.134721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.139196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.140367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.140818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.141716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:44.143866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.163745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.165213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.166748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.167428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.306706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.319167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a569764f-981f-4857-b913-030297d36fc7 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 200 len: 1443 microversion: 2.1 time: 0.204976 Jul 30 21:06:44.323685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 771/1596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 1443 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.332279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39067432-f364-4317-9c19-1975d9294a26 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d1c5790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.430937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39067432-f364-4317-9c19-1975d9294a26 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780" status: 200 len: 1410 microversion: 2.1 time: 0.104788 Jul 30 21:06:44.434986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 772/1597] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 => generated 1410 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.450173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.451141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:44.460401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:44.480571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.481669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.482962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.488351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.685161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.694932 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2367d743-d64e-4bc5-b1ec-27abb3a6c204 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1227 microversion: 2.1 time: 0.257459 Jul 30 21:06:44.695550 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 773/1598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1227 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.714596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.715512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:44.722251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.723386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.724201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.724633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.736479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:44.758527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:44.766663 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3cbc3a75-18f5-42c4-8308-c6ef87d5e233 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.632025 Jul 30 21:06:44.768005 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 826/1599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.773451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59afdada-6bb4-4898-9145-b73999fd6786 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d0b3700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:44.827270 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-59afdada-6bb4-4898-9145-b73999fd6786 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780" status: 200 len: 1410 microversion: 2.1 time: 0.057952 Jul 30 21:06:44.828785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 827/1600] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 => generated 1410 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:44.837479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e122a06c-f596-4f07-8a71-0afeabaf9749", "name": "network-vif-deleted", "tag": "2814b9b0-cbb7-4f40-8a8e-39c2d8863d85"}, {"server_uuid": "c3342a77-a30b-4279-81ad-4dc2565c46bb", "name": "network-vif-deleted", "tag": "d85d36ee-c722-43a4-80db-13af2e6a562b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:44.852624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:44.853199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:44.870156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] Creating event network-vif-deleted:2814b9b0-cbb7-4f40-8a8e-39c2d8863d85 for instance e122a06c-f596-4f07-8a71-0afeabaf9749 on nch2-master-1 Jul 30 21:06:44.870950 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] Creating event network-vif-deleted:d85d36ee-c722-43a4-80db-13af2e6a562b for instance c3342a77-a30b-4279-81ad-4dc2565c46bb on nch1-master-1 Jul 30 21:06:44.880501 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ecbeb552-1f91-4b02-b24f-2ad99d895f14 req-830412d4-dc9c-4b3b-855f-58555645c585 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047920 Jul 30 21:06:44.881269 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 828/1601] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:44.886768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37e3360e-3da9-4516-abdc-9e860218d2af tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d685550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.040109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.059613 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff0ac95f-51ab-4346-82b6-d1b61a5f5df4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.350243 Jul 30 21:06:45.060221 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 774/1602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:44 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:45.138871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.141451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.147999 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37e3360e-3da9-4516-abdc-9e860218d2af tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780" status: 204 len: 0 microversion: 2.1 time: 0.264410 Jul 30 21:06:45.148767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 829/1603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:44 2022] DELETE /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:45.154508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.155386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.156547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.157246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.160826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e7c2cd4-932d-4dbe-a6d2-03608f68cd6f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d025700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.200644 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9e7c2cd4-932d-4dbe-a6d2-03608f68cd6f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Image not found. Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e7c2cd4-932d-4dbe-a6d2-03608f68cd6f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 HTTP/1.1 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:45.206872 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6e43c922-b5b5-40e1-a419-beadb75e8780'} Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:45.208673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6e43c922-b5b5-40e1-a419-beadb75e8780 Jul 30 21:06:45.209593 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:45.210724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e43c922-b5b5-40e1-a419-beadb75e8780 could not be found. Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:45.215453 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:45.221458 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.225556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e7c2cd4-932d-4dbe-a6d2-03608f68cd6f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:45.226471 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e7c2cd4-932d-4dbe-a6d2-03608f68cd6f tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780" status: 404 len: 62 microversion: 2.1 time: 0.072219 Jul 30 21:06:45.227760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 830/1604] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:45.240612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.243227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.254469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.256663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.257852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.258545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.298186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.300246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.300941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lazy-loading 'fault' on Instance uuid c3342a77-a30b-4279-81ad-4dc2565c46bb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:45.377441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.391094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.393579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.396149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79bacb14-1908-4a07-b729-87f6969ee706 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 200 len: 1352 microversion: 2.25 time: 0.263713 Jul 30 21:06:45.397357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 775/1605] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 1352 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:06:45.408149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.409383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.430502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.430717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.431630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.432327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.563001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.574042 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b220e669-6cef-404b-aad8-b1370fa2d27f tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1474 microversion: 2.1 time: 0.343448 Jul 30 21:06:45.587115 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 831/1606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:45.597880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.601580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: e122a06c-f596-4f07-8a71-0afeabaf9749] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.617928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.618394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.619197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.619717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.654303 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] HTTP exception thrown: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Request method failure captured: Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 HTTP/1.1 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zv21b3OqmWG1rd4QASk77xiO5YBFooI8ww0H_6Z5Yb0DYDfVj5V0HJvL35VZnr2aTyc87BA--ohzE5KAGAkyUe7HSGRFJPfgC200D1uMPR-AsBqegS7SVlC4xRzEY_1LPIB5EdWtdyY3Xy1bci2FOxbSSMSE52caBzMMmuNVncN9Q4 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:45.658467 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81fb262c72e0468e92246bf31d93a204", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveMigrationTest-774293737 Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 96815c6776f1464a8b6350b4a52d4548 Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. Jul 30 21:06:45.660082 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e122a06c-f596-4f07-8a71-0afeabaf9749'} Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:45.661011 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. Jul 30 21:06:45.662490 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:45.665534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Returning 404 to user: Instance e122a06c-f596-4f07-8a71-0afeabaf9749 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:45.667973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9532590d-066f-429e-a47d-be0c482a92fb tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749" status: 404 len: 111 microversion: 2.1 time: 0.078858 Jul 30 21:06:45.674555 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 832/1607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/e122a06c-f596-4f07-8a71-0afeabaf9749 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:45.683109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-70d380cf-fcfb-4d54-a887-3e25f6fbd875 req-13f06ac7-2599-487e-81c6-ce7ffae6b1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2", "name": "network-vif-plugged", "status": "completed", "tag": "ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:45.710799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70d380cf-fcfb-4d54-a887-3e25f6fbd875 req-13f06ac7-2599-487e-81c6-ce7ffae6b1f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.716280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70d380cf-fcfb-4d54-a887-3e25f6fbd875 req-13f06ac7-2599-487e-81c6-ce7ffae6b1f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.741370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.745775 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-70d380cf-fcfb-4d54-a887-3e25f6fbd875 req-13f06ac7-2599-487e-81c6-ce7ffae6b1f4 service nova] Creating event network-vif-plugged:ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd for instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 on nch2-master-1 Jul 30 21:06:45.752090 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad049623-e396-4a31-a48d-39eb6c935b3b tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1497 microversion: 2.1 time: 0.352408 Jul 30 21:06:45.752688 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 776/1608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1497 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:45.757745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.758784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.765808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.766560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.767611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.768443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.777318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-70d380cf-fcfb-4d54-a887-3e25f6fbd875 req-13f06ac7-2599-487e-81c6-ce7ffae6b1f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100940 Jul 30 21:06:45.778354 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 833/1609] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:45.790969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.792956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:45.808584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.811896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.815816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:45.815996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:45.816422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:45.969483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:45.977787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba8e52f7-03d6-4c80-999a-7ed3dcd1a432 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1293 microversion: 2.1 time: 0.198178 Jul 30 21:06:45.995016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 834/1610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:45.995016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:45.995016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.005637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea76dbd8-d310-431c-9258-d83e47b86e95 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 204 len: 0 microversion: 2.1 time: 0.250965 Jul 30 21:06:46.006441 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 777/1611] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:45 2022] DELETE /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:46.021093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.024308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.029933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.031357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.032203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.033271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.037922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.038390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.039204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.039692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.297652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:46.308984 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6bc1a10-3cad-49ee-937f-a9f52357b9bb tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.323748 Jul 30 21:06:46.310808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 835/1612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:45 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:46.316972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.318735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.327560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.328785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.335136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:46.336642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.337502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.339521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:46.345487 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b51a1c9c-04f3-4090-a8d2-1572b1263b78 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1499 microversion: 2.1 time: 0.330479 Jul 30 21:06:46.360056 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 778/1613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1499 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:46.422943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.423611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: c3342a77-a30b-4279-81ad-4dc2565c46bb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.431789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.433448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.435412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.436247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.464798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] HTTP exception thrown: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Request method failure captured: Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb HTTP/1.1 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZwKyrqVtNBnTcM3tMzjdgdgQQChdI0dcRu2Gm86sGf9h8AyaWcpS2Um4X6YcmxEBVmlbosf_HWDU49JoLP3Ab-FkH8q7dDyh94JIoRHqB2yfmAMcZqMO8P29-MVRyLjIFTnmyfQoWyx6iW-FOeB3usv4ESiWn-JovJdOidIC9EaQao Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.25 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:46.466967 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bfb74be507694713821cb1a68619f9e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 46d7264a2f63436bb8519cd8cec6d9f5 Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. Jul 30 21:06:46.468460 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c3342a77-a30b-4279-81ad-4dc2565c46bb'} Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:46.469240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. Jul 30 21:06:46.470510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:46.473041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Returning 404 to user: Instance c3342a77-a30b-4279-81ad-4dc2565c46bb could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:46.474704 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5dfb234b-9956-475f-86ea-d0a98265080c tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb" status: 404 len: 111 microversion: 2.25 time: 0.055955 Jul 30 21:06:46.475974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 779/1614] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/c3342a77-a30b-4279-81ad-4dc2565c46bb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:06:46.489548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.492247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.506144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.508930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.509990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.516214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.589996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:46.653127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:46.661867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db0cd050-0a24-4588-90f4-98a3ea93e65f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.349630 Jul 30 21:06:46.675639 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 836/1615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:46.680070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.680706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.687825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.688626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.689605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.690220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.728492 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c84d0f7-8abd-4cb7-9dff-e16f7eb055f9 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 204 len: 0 microversion: 2.25 time: 0.246521 Jul 30 21:06:46.729787 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 780/1616] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:06:46 2022] DELETE /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:06:46.733899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.734890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.735638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lazy-loading 'fault' on Instance uuid 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:46.742477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.744050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.752308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.753047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.754075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.754892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.787312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:46.796525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a076dfd-2f68-4dbb-95e6-65cdd71f8aac tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 200 len: 1308 microversion: 2.1 time: 0.120236 Jul 30 21:06:46.797116 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 837/1617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:46.802140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:46.803006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:46.811896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.812446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.813307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:46.813829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:46.979481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:46.987405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe5e09d0-a788-4058-bc13-1fe35ea9dbbd tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1503 microversion: 2.1 time: 0.188841 Jul 30 21:06:46.987990 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 838/1618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:46.993251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6e38e945-1ef1-46ae-b78b-e45837a9da20 req-ee96c117-3ae9-4720-8cc1-c68540870602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24", "name": "network-vif-deleted", "tag": "a4a7f134-088e-4bed-bba6-67d689e70a28"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:47.008160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6e38e945-1ef1-46ae-b78b-e45837a9da20 req-ee96c117-3ae9-4720-8cc1-c68540870602 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.008628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6e38e945-1ef1-46ae-b78b-e45837a9da20 req-ee96c117-3ae9-4720-8cc1-c68540870602 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.025694 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6e38e945-1ef1-46ae-b78b-e45837a9da20 req-ee96c117-3ae9-4720-8cc1-c68540870602 service nova] Creating event network-vif-deleted:a4a7f134-088e-4bed-bba6-67d689e70a28 for instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 on nch2-master-1 Jul 30 21:06:47.030673 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6e38e945-1ef1-46ae-b78b-e45837a9da20 req-ee96c117-3ae9-4720-8cc1-c68540870602 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041532 Jul 30 21:06:47.031826 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 839/1619] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:47.037121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:47.040954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:47.049517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.049978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.051259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.051740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.068926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:47.078634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:47.087404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:47.088700 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be28d8e6-c703-4b94-b79e-68d188a1a20b tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1565 microversion: 2.25 time: 0.354429 Jul 30 21:06:47.089893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 781/1620] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:46 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1565 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:47.117416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:47.126577 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a04dc00-057c-4088-bbfb-87419f337fa0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1281 microversion: 2.1 time: 0.093687 Jul 30 21:06:47.127200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 840/1621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:47 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:47.344841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:47.346071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:47.357323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.358750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.359950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.361692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.372872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:47.373544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:47.386150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.386609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.390564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.392160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.405624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:47.724750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:47.739259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-caa7b575-57d0-485f-bbd9-b0b2565b7588 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1499 microversion: 2.1 time: 0.372788 Jul 30 21:06:47.741039 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 841/1622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:47 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:47.746347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:47.747516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:47.754603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.755334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:47.756189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:47.757314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.128642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.141059 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-582bc7e3-9fc7-45f1-b424-5f94b33197ef tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.398593 Jul 30 21:06:48.163708 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 842/1623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:47 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:48.169032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.169672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.176504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.176979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.177886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.178340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.194115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] HTTP exception thrown: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Request method failure captured: Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 HTTP/1.1 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zzdohuk6WWFm0AWyYYw9yLaHE-i1bjKQVItaN_Bj1o7r8Si4yBFKbN2O7mMRqUTLj_Lk2Rh5zMVqCzw1bvNb87YkxcC-uXxXSzNce9UDycHLkz5zeitpo8YhlJ23opF0_MijSkezSzLrxF_eabDj8Vnkj0sw-W7ORnP5Hbz-GA_gzA Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3b49b328c44040f0b5ae9b929e137b55 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:48.200037 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3b49b328c44040f0b5ae9b929e137b55", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3b49b328c44040f0b5ae9b929e137b55 Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ListImageFiltersTestJSON-1572351090-project Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c8c95b7c11b24f13a2a7148a087d590e Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ListImageFiltersTestJSON-1572351090-project Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. Jul 30 21:06:48.202157 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24'} Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:48.203156 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. Jul 30 21:06:48.204654 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:48.205912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Returning 404 to user: Instance 4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:48.205912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc7cee9e-6731-4672-821f-a68411292935 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24" status: 404 len: 111 microversion: 2.1 time: 0.032604 Jul 30 21:06:48.205912 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 843/1624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:48 2022] GET /compute/v2.1/servers/4b70c2e2-27e3-422c-8ed2-1dbb9dddeb24 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:48.206724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-caeb2055-e852-45ca-84eb-251b4f4a769f req-15454d4d-5cdf-48ef-8838-d7db9f5ea8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7285cf80-45b6-4068-b7e7-92f13b546ce3", "name": "network-vif-plugged", "status": "completed", "tag": "7a461caf-836e-40bc-ae3c-16d18ee3333d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:48.217439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-caeb2055-e852-45ca-84eb-251b4f4a769f req-15454d4d-5cdf-48ef-8838-d7db9f5ea8b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.218578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-caeb2055-e852-45ca-84eb-251b4f4a769f req-15454d4d-5cdf-48ef-8838-d7db9f5ea8b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.237679 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-caeb2055-e852-45ca-84eb-251b4f4a769f req-15454d4d-5cdf-48ef-8838-d7db9f5ea8b9 service nova] Creating event network-vif-plugged:7a461caf-836e-40bc-ae3c-16d18ee3333d for instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 on nch1-master-1 Jul 30 21:06:48.242807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-caeb2055-e852-45ca-84eb-251b4f4a769f req-15454d4d-5cdf-48ef-8838-d7db9f5ea8b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039778 Jul 30 21:06:48.244554 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 844/1625] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:48.250795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.251635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.259539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.259951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.261020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.261594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.282540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.305304 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a630e25-a22f-456a-8ff9-0a4e24a83d80 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1322 microversion: 2.1 time: 0.954813 Jul 30 21:06:48.313962 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 782/1626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:47 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1322 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:48.332882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.333505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.341086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.342030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.343173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.343864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.589682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.613464 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0dfb9fd-ad40-481e-8f8c-7d20c9b14630 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1485 microversion: 2.1 time: 0.367065 Jul 30 21:06:48.632557 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 845/1627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:48 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1485 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:48.640299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.642719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.658183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.660016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.661251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.662087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.816360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.840737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.845066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.848868 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7be7a905-68ee-4ef1-8f02-77dc980fe2b6 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1565 microversion: 2.25 time: 0.520302 Jul 30 21:06:48.864693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 783/1628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:48 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1565 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:48.879221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.880085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.890674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.891056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.893361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.894290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.909127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:48.927633 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-08756bc3-0219-43a4-8525-72ff006da8fc tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.293474 Jul 30 21:06:48.931910 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 846/1629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:48 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:48.937947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:48.944097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:48.958295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.961618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:48.961812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:48.965533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:48.966143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.027599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:49.140507 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27bcfbcb-5183-4dea-8d6b-51f9213cf9b7 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 204 len: 0 microversion: 2.1 time: 0.273939 Jul 30 21:06:49.143343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 784/1630] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:48 2022] DELETE /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:49.157500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.158654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.171626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.172348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.173710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.174358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.203133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3fab2a4b-81aa-409e-aa29-2b450a0094b9 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 204 len: 0 microversion: 2.1 time: 0.269129 Jul 30 21:06:49.206295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 847/1631] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:48 2022] DELETE /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:49.220522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.221866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.241356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.242032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.243807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.244536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.411951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:49.424372 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5114d351-1925-45fe-9266-f5894cf80991 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1473 microversion: 2.1 time: 0.215439 Jul 30 21:06:49.429295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:49.438934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 848/1632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:49 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:49.444407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.445210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.452314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.452882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.453896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.454420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.468295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5d3424e-f801-4690-9954-62041c7a3074 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1457 microversion: 2.1 time: 0.324723 Jul 30 21:06:49.477154 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 785/1633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:49 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1457 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:49.491653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5437d631-43d2-4dbd-b85d-71399dfb0fbc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d0a20d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.587629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5437d631-43d2-4dbd-b85d-71399dfb0fbc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Image not found. Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5437d631-43d2-4dbd-b85d-71399dfb0fbc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 HTTP/1.1 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:49.593497 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6e43c922-b5b5-40e1-a419-beadb75e8780'} Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:49.595358 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6e43c922-b5b5-40e1-a419-beadb75e8780 to delete Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.596536 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e43c922-b5b5-40e1-a419-beadb75e8780 could not be found. Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:49.598074 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:49.599826 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:49.615850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5437d631-43d2-4dbd-b85d-71399dfb0fbc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:49.620769 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5437d631-43d2-4dbd-b85d-71399dfb0fbc tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780" status: 404 len: 62 microversion: 2.1 time: 0.142254 Jul 30 21:06:49.621541 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 786/1634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:49 2022] DELETE /compute/v2.1/images/6e43c922-b5b5-40e1-a419-beadb75e8780 => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:49.641266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.642054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.668637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.669322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.670431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.671915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.717053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:49.726386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-239e9f0d-f2fb-4678-a589-7d4141988c37 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1317 microversion: 2.1 time: 0.286117 Jul 30 21:06:49.730859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 849/1635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:49 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:49.742670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c08ba8d0-b67b-4f32-b1e1-3a81010f989a req-636d86dc-c0a5-4ca2-8af9-b07cb672376b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad15fe6-2fb7-4526-8ed1-f013530548e1", "name": "network-vif-deleted", "tag": "1460c4e5-0f29-40f5-91cf-ff3fa5ad435c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:49.755033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c08ba8d0-b67b-4f32-b1e1-3a81010f989a req-636d86dc-c0a5-4ca2-8af9-b07cb672376b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.755975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c08ba8d0-b67b-4f32-b1e1-3a81010f989a req-636d86dc-c0a5-4ca2-8af9-b07cb672376b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.778597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c08ba8d0-b67b-4f32-b1e1-3a81010f989a req-636d86dc-c0a5-4ca2-8af9-b07cb672376b service nova] Creating event network-vif-deleted:1460c4e5-0f29-40f5-91cf-ff3fa5ad435c for instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 on nch2-master-1 Jul 30 21:06:49.786516 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c08ba8d0-b67b-4f32-b1e1-3a81010f989a req-636d86dc-c0a5-4ca2-8af9-b07cb672376b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052581 Jul 30 21:06:49.787671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 850/1636] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:49.794524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.795876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.814858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.818301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.819602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.821038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.864949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:49.940629 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.api [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Instance is already in deleting state, ignoring this request Jul 30 21:06:49.941645 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c77dc26-fc72-459f-bdb0-29324288b857 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 204 len: 0 microversion: 2.1 time: 0.152622 Jul 30 21:06:49.944103 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 851/1637] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:49 2022] DELETE /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:49.953009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:49.954582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:49.963151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.963918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:49.965389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:49.966199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.023365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.024072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.024709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lazy-loading 'fault' on Instance uuid 16030f4a-b40f-49fd-827f-c09a808c0e3e {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:50.029837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.039090 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2f52d13-db3c-4aed-a597-588988541e68 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1472 microversion: 2.1 time: 0.415375 Jul 30 21:06:50.062237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 787/1638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:49 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:50.070390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.072319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.083725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.084583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.085645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.086320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.095272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.106063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.107743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d7264a2f63436bb8519cd8cec6d9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb74be507694713821cb1a68619f9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.109211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-185f6e05-2534-45d8-8329-0ab8ebf81559 tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 200 len: 1352 microversion: 2.25 time: 0.163999 Jul 30 21:06:50.110343 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 852/1639] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:49 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 1352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:06:50.129478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.136433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.149605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.150144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.151200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.151747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.337719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.349311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-965226f6-4d89-48de-b25b-e0770e0fdadf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.237307 Jul 30 21:06:50.351814 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 853/1640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:50.364312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:50.364312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.369655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.370127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.371071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.371562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.393762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.395216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lazy-loading 'flavor' on Instance uuid b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:50.402109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-335caf89-0ebf-477b-ab59-c136fe150e57 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1491 microversion: 2.1 time: 0.338040 Jul 30 21:06:50.402694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 788/1641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1491 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:50.449493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.450134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.469443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.470229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.472004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.474009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.524636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:50.543836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc61262e-edca-45ae-a24e-cca00bcc7894 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2/action" status: 202 len: 0 microversion: 2.1 time: 0.190613 Jul 30 21:06:50.544636 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 854/1642] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:50 2022] POST /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:06:50.554188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.555068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.565757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.566430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.568955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.569500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.695651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.707956 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0601c0e-b243-43ce-ba5f-4cbb46f04b5c tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1457 microversion: 2.1 time: 0.161801 Jul 30 21:06:50.717275 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 855/1643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1457 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:50.731887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.732618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.746922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.748097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.749419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.750554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.801642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:50.812135 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bff5a86c-4964-4105-9295-fbb148d69456 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1473 microversion: 2.1 time: 0.369646 Jul 30 21:06:50.813278 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 789/1644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1473 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:50.818053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ef53339c-4c59-4ac6-af04-a451265a21e5 req-e5d2b4dd-30d1-4390-94ea-990954756fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acde74b-d13f-486b-92ed-9da11ed229af", "name": "network-vif-plugged", "status": "completed", "tag": "ca530d4a-b837-417f-8262-587ab295da34"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:50.829767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef53339c-4c59-4ac6-af04-a451265a21e5 req-e5d2b4dd-30d1-4390-94ea-990954756fe8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.830738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef53339c-4c59-4ac6-af04-a451265a21e5 req-e5d2b4dd-30d1-4390-94ea-990954756fe8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.863685 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ef53339c-4c59-4ac6-af04-a451265a21e5 req-e5d2b4dd-30d1-4390-94ea-990954756fe8 service nova] Creating event network-vif-plugged:ca530d4a-b837-417f-8262-587ab295da34 for instance 9acde74b-d13f-486b-92ed-9da11ed229af on nch2-master-1 Jul 30 21:06:50.878795 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ef53339c-4c59-4ac6-af04-a451265a21e5 req-e5d2b4dd-30d1-4390-94ea-990954756fe8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064053 Jul 30 21:06:50.879986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 790/1645] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:50.888772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:50.890004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:50.903630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.905358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:50.906786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:50.907918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.073955 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-553dc9ef-9190-440a-bc35-6815e0876a3c tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1631 microversion: 2.1 time: 0.355421 Jul 30 21:06:51.074857 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 856/1646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1631 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:51.133335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:51.134034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] [instance: 16030f4a-b40f-49fd-827f-c09a808c0e3e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:51.140978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.141527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.142412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.142953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.143082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:51.151138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa6d64c3-b9d4-4783-921f-50c93201eecd tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1467 microversion: 2.1 time: 0.269435 Jul 30 21:06:51.158028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] HTTP exception thrown: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Request method failure captured: Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e HTTP/1.1 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZwKyrqVtNBnTcM3tMzjdgdgQQChdI0dcRu2Gm86sGf9h8AyaWcpS2Um4X6YcmxEBVmlbosf_HWDU49JoLP3Ab-FkH8q7dDyh94JIoRHqB2yfmAMcZqMO8P29-MVRyLjIFTnmyfQoWyx6iW-FOeB3usv4ESiWn-JovJdOidIC9EaQao Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.25 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:51.159867 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bfb74be507694713821cb1a68619f9e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfb74be507694713821cb1a68619f9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: bfb74be507694713821cb1a68619f9e2 Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-948885521 Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 46d7264a2f63436bb8519cd8cec6d9f5 Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-948885521-project Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. Jul 30 21:06:51.161807 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '16030f4a-b40f-49fd-827f-c09a808c0e3e'} Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:51.162806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. Jul 30 21:06:51.164432 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:51.165850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] Returning 404 to user: Instance 16030f4a-b40f-49fd-827f-c09a808c0e3e could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:51.165963 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 791/1647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:50 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1467 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:51.166734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40b415a7-6fad-4e52-9843-bd675bac3fad tempest-LiveAutoBlockMigrationV225Test-948885521 tempest-LiveAutoBlockMigrationV225Test-948885521-project] 10.222.0.17 "GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e" status: 404 len: 111 microversion: 2.25 time: 0.035701 Jul 30 21:06:51.170865 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 857/1648] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:06:51 2022] GET /compute/v2.1/servers/16030f4a-b40f-49fd-827f-c09a808c0e3e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:06:51.171622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:51.172268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:51.178747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.179446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.180245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.180700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.386157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:51.389478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:51.393344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8909f7f-3a72-4818-9854-ea6d3844307e tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1618 microversion: 2.1 time: 0.225348 Jul 30 21:06:51.394534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 792/1649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:51 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1618 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:51.412165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.422880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.424130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.425795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.427768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:51.428399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:51.445618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.446707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.447821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:51.448440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:51.770437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:51.785201 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aeec7aec-59ae-46bb-aa71-9ffe84633068 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1491 microversion: 2.1 time: 0.361222 Jul 30 21:06:51.786798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 793/1650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:51 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1491 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:51.796306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1290746941", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7f920502-e0cf-43aa-93ba-62d50d7905d7"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:51.870023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:06:51.974111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:51.984964 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57e740c3-5ae8-4788-98c2-d450cab0b822 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.610242 Jul 30 21:06:51.985890 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 858/1651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:51 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:51.992360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:51.993260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:52.005577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.006864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.013997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.016500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.118584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:52.127468 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63eeba6c-3abf-41de-9846-068a9eac51e1 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1296 microversion: 2.1 time: 0.140112 Jul 30 21:06:52.128182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 859/1652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:51 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:52.144429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16030f4a-b40f-49fd-827f-c09a808c0e3e", "name": "network-vif-deleted", "tag": "02cde323-6cb5-4de7-99ed-54209e847243"}, {"name": "network-changed", "server_uuid": "bc8d5fa6-cf21-4c7d-9a9e-0f13456612df", "tag": "c453e86a-8dcd-4c99-b19a-9053460a99bd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:52.156576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.156576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.170770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] Creating event network-vif-deleted:02cde323-6cb5-4de7-99ed-54209e847243 for instance 16030f4a-b40f-49fd-827f-c09a808c0e3e on nch1-master-1 Jul 30 21:06:52.171503 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] Creating event network-changed:c453e86a-8dcd-4c99-b19a-9053460a99bd for instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df on nch1-master-1 Jul 30 21:06:52.179777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c48c4cad-ac30-4580-a4d9-c42654b3d2e6 req-edd4ba8e-fcfe-4fa4-9d78-dce6f165736d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049728 Jul 30 21:06:52.182828 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 860/1653] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:52.190172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:52.191395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:52.198592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.199169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.200208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.201694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.462242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:06:52.462692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:06:52.469493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:06:52.470033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:06:52.471520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:06:52.493635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.494215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.495773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.496431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.508490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:52.517337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f3fc712-e4ca-40f8-a105-04dfe5be9fb4 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1473 microversion: 2.1 time: 0.333146 Jul 30 21:06:52.519309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:06:52.535196 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 861/1654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:52 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:52.542507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:52.542733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:06:52.545846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:52.560120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.560856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.561846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.562483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.567411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:06:52.571257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:06:52.638771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b8cc52f-34aa-4df7-9db7-a8c98d4b9897 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850214 Jul 30 21:06:52.646567 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 794/1655] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:06:52.652425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aff4eccb-26d0-45a4-8f47-6de50e10c3be tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:52.653438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aff4eccb-26d0-45a4-8f47-6de50e10c3be tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:52.793810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aff4eccb-26d0-45a4-8f47-6de50e10c3be tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:52.809915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aff4eccb-26d0-45a4-8f47-6de50e10c3be tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1217 microversion: 2.1 time: 0.161623 Jul 30 21:06:52.823509 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 795/1656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:52 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:52.828917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:52.832748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:52.848098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.851366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.853068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:52.854903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:52.860608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:52.897139 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-040de493-b4b5-47a6-8df5-7966ac766673 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1631 microversion: 2.1 time: 0.356492 Jul 30 21:06:52.898198 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 862/1657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:52 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1631 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:53.013901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:53.014561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:53.018114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:53.029029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.030182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.031703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.032206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.370565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:53.383103 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-523ab2a1-e9e6-4e53-b3ea-3026c25af5cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.373581 Jul 30 21:06:53.402666 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 863/1658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:53 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:53.402666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:53.402666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:53.415214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.417680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.421600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.422344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.505334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.505797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.506267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lazy-loading 'fault' on Instance uuid 5ad15fe6-2fb7-4526-8ed1-f013530548e1 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:53.535178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:53.551844 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20695a3f-d512-42f6-b7db-a7b92d5bb555 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1491 microversion: 2.1 time: 0.727058 Jul 30 21:06:53.552693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 796/1659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:52 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1491 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:53.561894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:53.565025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:53.583785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.597664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.598925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.599673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.623325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fb262c72e0468e92246bf31d93a204', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:53.636872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-614eade5-f56c-4bed-a343-cddd88545463 tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 200 len: 1301 microversion: 2.1 time: 0.247255 Jul 30 21:06:53.639159 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 864/1660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:53 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 1301 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:53.833437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:53.834247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:53.842725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.843176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.843995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:53.844442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:53.946759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:53.982719 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b8150b6-4483-4c49-b237-1c66ca89d8d5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1269 microversion: 2.1 time: 0.153673 Jul 30 21:06:53.984969 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 865/1661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:53 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:54.003690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:54.004728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:54.017916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.021095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.022168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.023829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.387979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d246166e-cdf3-4bb5-960b-0fa10e64df29 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1614 microversion: 2.1 time: 0.401351 Jul 30 21:06:54.388864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 866/1662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:53 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1614 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:54.411193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:54.412988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:54.442667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.443484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.444634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.445502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.605330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:54.621248 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f90f8cd-2a2d-461f-b085-0c8e1a0aaa07 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1473 microversion: 2.1 time: 1.066521 Jul 30 21:06:54.639026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 797/1663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:53 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1473 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:54.647471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:54.649999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:54.660518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.661158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.662271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.662848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.773621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:54.784119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db4f3650-8313-4ce1-9ab4-799a0821a32e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.377720 Jul 30 21:06:54.784711 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 867/1664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:54 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:54.799260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:54.799922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:54.810472 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] HTTP exception thrown: Cannot 'migrate' instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 while it is in vm_state suspended Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Request method failure captured: Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2/action HTTP/1.1 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0rU4TUlZeUPtj6cEdahCGpALwxixmEyiHErR3YnKsEzjecrM4M-SQ1C4UVSd4Nx8rmH3-4p5YBJowYfYjlC4QotZ3DrX3djr-wYnJpckpM9sdAZxTwHERFMDuy5UMwk9RYd65PHh1VlsSjKy7_uaLUUOr9aNFSNgIvrd4_6qmOSTQ Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:06:54.825433 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d0fa9f6f453a4d9c8383c84368b98970", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f71a7b16f8b4e1fa3b08b96c1705327 Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: {"migrate": {}} Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:54.827034 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'migrate' instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 while it is in vm_state suspended Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2', 'body': {'migrate': {}}} Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 in vm_state suspended. Cannot resize while the instance is in this state. Jul 30 21:06:54.828101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 while it is in vm_state suspended Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.829442 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 while it is in vm_state suspended Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.830800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Returning 409 to user: Cannot 'migrate' instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 while it is in vm_state suspended {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:54.831842 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8863a1b5-19ee-40a7-abb7-4bd71a501627 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2/action" status: 409 len: 148 microversion: 2.1 time: 0.186906 Jul 30 21:06:54.837509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.839178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 798/1665] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:54 2022] POST /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2/action => generated 148 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:54.841463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.842824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.845554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.857658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:54.858748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] [instance: 5ad15fe6-2fb7-4526-8ed1-f013530548e1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:54.871472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.871748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.872778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:54.873231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:54.911416 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] HTTP exception thrown: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Request method failure captured: Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 HTTP/1.1 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zv21b3OqmWG1rd4QASk77xiO5YBFooI8ww0H_6Z5Yb0DYDfVj5V0HJvL35VZnr2aTyc87BA--ohzE5KAGAkyUe7HSGRFJPfgC200D1uMPR-AsBqegS7SVlC4xRzEY_1LPIB5EdWtdyY3Xy1bci2FOxbSSMSE52caBzMMmuNVncN9Q4 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:54.913016 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81fb262c72e0468e92246bf31d93a204", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81fb262c72e0468e92246bf31d93a204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-LiveMigrationTest-774293737 Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 81fb262c72e0468e92246bf31d93a204 Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-LiveMigrationTest-774293737 Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 96815c6776f1464a8b6350b4a52d4548 Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-LiveMigrationTest-774293737-project Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. Jul 30 21:06:54.914783 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '5ad15fe6-2fb7-4526-8ed1-f013530548e1'} Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:54.915739 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. Jul 30 21:06:54.917674 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.918933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] Returning 404 to user: Instance 5ad15fe6-2fb7-4526-8ed1-f013530548e1 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:54.918933 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27ecd295-e1dc-4a47-9b46-725942552f6e tempest-LiveMigrationTest-774293737 tempest-LiveMigrationTest-774293737-project] 10.222.0.17 "GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1" status: 404 len: 111 microversion: 2.1 time: 0.074010 Jul 30 21:06:54.918933 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 799/1666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:54 2022] GET /compute/v2.1/servers/5ad15fe6-2fb7-4526-8ed1-f013530548e1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:54.923626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8ecca1a-2730-4002-b879-bbc4b9e33563 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8ecca1a-2730-4002-b879-bbc4b9e33563 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Request method failure captured: Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action HTTP/1.1 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 39 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0rU4TUlZeUPtj6cEdahCGpALwxixmEyiHErR3YnKsEzjecrM4M-SQ1C4UVSd4Nx8rmH3-4p5YBJowYfYjlC4QotZ3DrX3djr-wYnJpckpM9sdAZxTwHERFMDuy5UMwk9RYd65PHh1VlsSjKy7_uaLUUOr9aNFSNgIvrd4_6qmOSTQ Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:06:54.928123 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d0fa9f6f453a4d9c8383c84368b98970", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f71a7b16f8b4e1fa3b08b96c1705327 Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: {"os-resetState": {"state": "invalid"}} Jul 30 21:06:54.929855 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7e5b45b4-c802-4081-bd6c-d4b8ef1b2835', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'invalid' Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.931025 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:06:54.932721 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 30 21:06:54.934995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.936165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8ecca1a-2730-4002-b879-bbc4b9e33563 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:54.937218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8ecca1a-2730-4002-b879-bbc4b9e33563 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action" status: 400 len: 144 microversion: 2.1 time: 0.021313 Jul 30 21:06:54.937982 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 800/1667] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:54 2022] POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:06:54.952640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21183f69-99b8-401f-9013-224c30781355 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21183f69-99b8-401f-9013-224c30781355 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Request method failure captured: Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action HTTP/1.1 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 31 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0rU4TUlZeUPtj6cEdahCGpALwxixmEyiHErR3YnKsEzjecrM4M-SQ1C4UVSd4Nx8rmH3-4p5YBJowYfYjlC4QotZ3DrX3djr-wYnJpckpM9sdAZxTwHERFMDuy5UMwk9RYd65PHh1VlsSjKy7_uaLUUOr9aNFSNgIvrd4_6qmOSTQ Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:06:54.956175 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d0fa9f6f453a4d9c8383c84368b98970", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f71a7b16f8b4e1fa3b08b96c1705327 Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: {"os-resetState": {"state": 1}} Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:54.957647 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7e5b45b4-c802-4081-bd6c-d4b8ef1b2835', 'body': {'os-resetState': {'state': 1}}} Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 1 Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:54.958607 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 30 21:06:54.960834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.964967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21183f69-99b8-401f-9013-224c30781355 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:54.964967 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21183f69-99b8-401f-9013-224c30781355 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action" status: 400 len: 120 microversion: 2.1 time: 0.012138 Jul 30 21:06:54.964967 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 801/1668] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:06:54 2022] POST /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:06:54.969998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:54.972481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Failed to fetch instance by id 999 {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:06:54.973017 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Request method failure captured: Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 37 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0rU4TUlZeUPtj6cEdahCGpALwxixmEyiHErR3YnKsEzjecrM4M-SQ1C4UVSd4Nx8rmH3-4p5YBJowYfYjlC4QotZ3DrX3djr-wYnJpckpM9sdAZxTwHERFMDuy5UMwk9RYd65PHh1VlsSjKy7_uaLUUOr9aNFSNgIvrd4_6qmOSTQ Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:06:54.977270 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d0fa9f6f453a4d9c8383c84368b98970", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d0fa9f6f453a4d9c8383c84368b98970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d0fa9f6f453a4d9c8383c84368b98970 Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-441880842 Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f71a7b16f8b4e1fa3b08b96c1705327 Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-441880842-project-admin Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: {"os-resetState": {"state": "error"}} Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:54.979692 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 999 could not be found. Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:06:54.981531 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 30 21:06:54.984246 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:54.989410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:54.990711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc129c10-2484-487c-9a17-ecde016fb1b9 tempest-ServersAdminNegativeTestJSON-441880842 tempest-ServersAdminNegativeTestJSON-441880842-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022840 Jul 30 21:06:54.992590 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 802/1669] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 30 21:06:54 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:06:55.004657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:55.005443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:55.022754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.023560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.024586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.025262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.061835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:06:55.178105 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-08bd3856-1a1c-4daa-ba23-4beb3a331c5a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 204 len: 0 microversion: 2.1 time: 0.178486 Jul 30 21:06:55.179433 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 803/1670] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:54 2022] DELETE /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:55.187338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:55.188400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:55.200132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.200757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.202007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.202572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.352878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:55.387125 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b25fcc41-63c9-428d-86b2-245b72e6e0d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1275 microversion: 2.1 time: 0.205968 Jul 30 21:06:55.388763 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 804/1671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:55 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:55.409853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:55.411157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:55.420005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.422053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.423747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.424734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.474183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:55.487744 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73e0c898-dab9-4b47-83b8-d55269670674 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1491 microversion: 2.1 time: 0.700964 Jul 30 21:06:55.489009 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 868/1672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:54 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1491 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:55.650885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:55.652370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:55.660196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.660729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.661651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.662540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.920513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:55.949075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3800216b-8556-487b-8f61-43154c7e55c9 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1469 microversion: 2.1 time: 0.554263 Jul 30 21:06:55.950534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 805/1673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:55 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1469 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:55.958871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:55.963741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:55.982007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:55.984535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.985352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:55.986477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:55.987093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.060329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:56.072541 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db6c0aeb-9126-4e22-be65-53e982762226 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1473 microversion: 2.1 time: 0.427208 Jul 30 21:06:56.073061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 869/1674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:55 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:56.410159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:56.410790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:56.451061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.451659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.460358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.461044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.622209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:56.634222 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50d3a8e4-5782-435d-9d2a-90f3355c9d10 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1275 microversion: 2.1 time: 0.225465 Jul 30 21:06:56.635223 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 870/1675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:56 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:06:56.650024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:56.650704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:56.669339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.669797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.670785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.671432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.786343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379e04d2b30488387b3eefab6669768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa530811f1f43aeb7957b6cd28d4653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:56.819970 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41243926-5e6c-409e-8848-e29e988e7ead tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 200 len: 1292 microversion: 2.1 time: 0.182086 Jul 30 21:06:56.822128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 871/1676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:56 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 1292 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:56.833152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fa255579-8d59-4c8f-9db5-ed22169a1e30 req-0c077e56-d592-4241-9cce-b0e1f214eae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acde74b-d13f-486b-92ed-9da11ed229af", "name": "network-vif-deleted", "tag": "ca530d4a-b837-417f-8262-587ab295da34"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:56.854719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fa255579-8d59-4c8f-9db5-ed22169a1e30 req-0c077e56-d592-4241-9cce-b0e1f214eae7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.855683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fa255579-8d59-4c8f-9db5-ed22169a1e30 req-0c077e56-d592-4241-9cce-b0e1f214eae7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.874589 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fa255579-8d59-4c8f-9db5-ed22169a1e30 req-0c077e56-d592-4241-9cce-b0e1f214eae7 service nova] Creating event network-vif-deleted:ca530d4a-b837-417f-8262-587ab295da34 for instance 9acde74b-d13f-486b-92ed-9da11ed229af on nch2-master-1 Jul 30 21:06:56.882682 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fa255579-8d59-4c8f-9db5-ed22169a1e30 req-0c077e56-d592-4241-9cce-b0e1f214eae7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057033 Jul 30 21:06:56.884987 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 872/1677] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:56.909960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4d734dd0-2517-47be-b463-e582d07e0d77 req-83090fed-8f14-4c41-a9ca-5bd98f5d3256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8d5fa6-cf21-4c7d-9a9e-0f13456612df", "name": "network-vif-plugged", "status": "completed", "tag": "c453e86a-8dcd-4c99-b19a-9053460a99bd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:56.927839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4d734dd0-2517-47be-b463-e582d07e0d77 req-83090fed-8f14-4c41-a9ca-5bd98f5d3256 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:56.928757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4d734dd0-2517-47be-b463-e582d07e0d77 req-83090fed-8f14-4c41-a9ca-5bd98f5d3256 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:56.950813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:56.980126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4d734dd0-2517-47be-b463-e582d07e0d77 req-83090fed-8f14-4c41-a9ca-5bd98f5d3256 service nova] Creating event network-vif-plugged:c453e86a-8dcd-4c99-b19a-9053460a99bd for instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df on nch1-master-1 Jul 30 21:06:56.995992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4d734dd0-2517-47be-b463-e582d07e0d77 req-83090fed-8f14-4c41-a9ca-5bd98f5d3256 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108864 Jul 30 21:06:56.996862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 873/1678] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:57.029432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.030159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:57.058237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.059057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.060379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.062278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.169428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:57.181005 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c317b34f-650a-4819-8828-ccbcfb3b8f84 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 1.228835 Jul 30 21:06:57.182744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 806/1679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:55 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:57.188949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.189847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:57.197537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.198345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.199952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.200641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.260529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.261676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.265596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lazy-loading 'fault' on Instance uuid e91695d7-6216-4040-acf5-7ddf3498aeac {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:06:57.403582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c95b7c11b24f13a2a7148a087d590e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49b328c44040f0b5ae9b929e137b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:57.415803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64f624f7-0b19-41a1-9d91-8b64f6aac87d tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 200 len: 1308 microversion: 2.1 time: 0.231592 Jul 30 21:06:57.443830 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 807/1680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:57 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:57.510530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:57.521637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57e43107-26ac-4795-a50e-8f0e3a1fb1c6 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1469 microversion: 2.1 time: 0.522605 Jul 30 21:06:57.522417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 874/1681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:56 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1469 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:57.657476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.658785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:57.665785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.667159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.668426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.669092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.832803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:57.842415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.843039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 9acde74b-d13f-486b-92ed-9da11ed229af] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:57.845135 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f7c1e2d-b6b4-47ef-a935-742e18989497 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1275 microversion: 2.1 time: 0.192226 Jul 30 21:06:57.845742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 808/1682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:57 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:57.865277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.866156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.867087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.867801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.888966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af HTTP/1.1 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:57.892372 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '9acde74b-d13f-486b-92ed-9da11ed229af'} Jul 30 21:06:57.894168 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:57.895237 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. Jul 30 21:06:57.896814 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.899040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 9acde74b-d13f-486b-92ed-9da11ed229af could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:57.900138 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8fa7b1cb-d8da-48b8-bcb1-00845bcd29c4 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af" status: 404 len: 111 microversion: 2.1 time: 0.062107 Jul 30 21:06:57.901253 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 875/1683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:57 2022] GET /compute/v2.1/servers/9acde74b-d13f-486b-92ed-9da11ed229af => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:57.911829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a72b840-0cb9-4588-bfd1-c48510928a6c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d78f8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.944458 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2a72b840-0cb9-4588-bfd1-c48510928a6c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Image not found. Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a72b840-0cb9-4588-bfd1-c48510928a6c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 HTTP/1.1 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:57.949579 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f88c593d-1a9d-424e-bc8b-7bce0d82de87'} Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:57.951404 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f88c593d-1a9d-424e-bc8b-7bce0d82de87 to delete Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.952537 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f88c593d-1a9d-424e-bc8b-7bce0d82de87 could not be found. Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:57.954124 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:57.955795 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:57.958212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a72b840-0cb9-4588-bfd1-c48510928a6c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:57.959149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a72b840-0cb9-4588-bfd1-c48510928a6c tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87" status: 404 len: 62 microversion: 2.1 time: 0.053872 Jul 30 21:06:57.959775 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 809/1684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:57 2022] DELETE /compute/v2.1/images/f88c593d-1a9d-424e-bc8b-7bce0d82de87 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:57.968389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:57.969215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:57.978289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.978795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:57.979878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:57.980332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.003969 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 HTTP/1.1 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:58.005674 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '52d8e6b3-e409-4478-a027-a64a6e76ab67'} Jul 30 21:06:58.007125 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.008147 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.009702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.012124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.012124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bdeecc22-7925-4b93-911f-ae521d51deb7 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 404 len: 111 microversion: 2.1 time: 0.043096 Jul 30 21:06:58.019244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.019901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 52d8e6b3-e409-4478-a027-a64a6e76ab67] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.027789 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 876/1685] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:57 2022] DELETE /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:58.033532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.034001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.034959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.035644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.056498 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 HTTP/1.1 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.059214 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '52d8e6b3-e409-4478-a027-a64a6e76ab67'} Jul 30 21:06:58.061007 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.062049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. Jul 30 21:06:58.064311 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.067218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 52d8e6b3-e409-4478-a027-a64a6e76ab67 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.068400 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63acac03-36f5-4931-9f3e-69ee5c78a264 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67" status: 404 len: 111 microversion: 2.1 time: 0.054185 Jul 30 21:06:58.069461 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 810/1686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] GET /compute/v2.1/servers/52d8e6b3-e409-4478-a027-a64a6e76ab67 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:58.079363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61c939d7-233b-4676-bdce-2acdd99ac754 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d684af0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.105115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-61c939d7-233b-4676-bdce-2acdd99ac754 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Image not found. Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61c939d7-233b-4676-bdce-2acdd99ac754 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 HTTP/1.1 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:58.106949 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4d58838f-9ab1-49fd-b0ae-e09730bdc674'} Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.108437 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4d58838f-9ab1-49fd-b0ae-e09730bdc674 to delete Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.109376 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d58838f-9ab1-49fd-b0ae-e09730bdc674 could not be found. Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.110657 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61c939d7-233b-4676-bdce-2acdd99ac754 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.112027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61c939d7-233b-4676-bdce-2acdd99ac754 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674" status: 404 len: 62 microversion: 2.1 time: 0.034597 Jul 30 21:06:58.113086 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 877/1687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] DELETE /compute/v2.1/images/4d58838f-9ab1-49fd-b0ae-e09730bdc674 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:58.120014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.120831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.132948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.133674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.134964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.135526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.151469 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 HTTP/1.1 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.153404 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '5f98840b-782b-41a6-8bf2-5f3e4722d087'} Jul 30 21:06:58.154978 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.155953 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.157321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.158724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.158724 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4996c3e-ce19-486b-adf3-8999fef7dccf tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 404 len: 111 microversion: 2.1 time: 0.039545 Jul 30 21:06:58.165592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.166771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 5f98840b-782b-41a6-8bf2-5f3e4722d087] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.167455 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 811/1688] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:58 2022] DELETE /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:58.174473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.174937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.176377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.176893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.192613 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 HTTP/1.1 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:06:58.194344 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '5f98840b-782b-41a6-8bf2-5f3e4722d087'} Jul 30 21:06:58.195985 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.196875 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. Jul 30 21:06:58.198258 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.199443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 5f98840b-782b-41a6-8bf2-5f3e4722d087 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.199443 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cadf5a0a-b80d-4f81-ba72-16ab0ba569d3 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087" status: 404 len: 111 microversion: 2.1 time: 0.036055 Jul 30 21:06:58.202156 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 878/1689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] GET /compute/v2.1/servers/5f98840b-782b-41a6-8bf2-5f3e4722d087 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:58.206259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fb5e8a1-45dc-45f9-961a-54c7143abfc2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '.version_select at 0x7fbb5d700430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.207281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.207986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.214784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.215254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.216978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.217733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.259102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6fb5e8a1-45dc-45f9-961a-54c7143abfc2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Image not found. Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fb5e8a1-45dc-45f9-961a-54c7143abfc2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 HTTP/1.1 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.264402 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f971ff69-49ac-4c7b-8cb6-0ae5813a97d5'} Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.266249 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 to delete Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.268093 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 could not be found. Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.270294 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fb5e8a1-45dc-45f9-961a-54c7143abfc2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fb5e8a1-45dc-45f9-961a-54c7143abfc2 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5" status: 404 len: 62 microversion: 2.1 time: 0.064998 Jul 30 21:06:58.272655 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 812/1690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] DELETE /compute/v2.1/images/f971ff69-49ac-4c7b-8cb6-0ae5813a97d5 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:06:58.277628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.278199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.286835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.286835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.287828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.288334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.316970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 HTTP/1.1 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.319555 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '983acaf3-8025-4357-a90e-fa1c74ccc477'} Jul 30 21:06:58.321313 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.322400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.324122 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.326620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.328359 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bbba18b6-f0ff-4cee-9fab-abd2a90f3f43 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 404 len: 111 microversion: 2.1 time: 0.055574 Jul 30 21:06:58.329126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 813/1691] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:06:58 2022] DELETE /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:06:58.337464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.338997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] [instance: 983acaf3-8025-4357-a90e-fa1c74ccc477] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.345945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.346819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.347882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.349224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.365844 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] HTTP exception thrown: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Request method failure captured: Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 HTTP/1.1 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZyuNBEOcDlgroBSHWF2NV4q_iU9mrFq9tR5L50nvlNGryzCXHqMXpPNROEA706zWNqzxqKHd9K9A4l1AJWUL43DgUfbbkicY_xmAZoeNQya7onrBZl86pTIemNhYxoZK0OoAJ0a9SqA7RxLuerlFlkbB_l5RZx7R6MPz2ROUqa_ZOc Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.367944 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa530811f1f43aeb7957b6cd28d4653", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa530811f1f43aeb7957b6cd28d4653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa530811f1f43aeb7957b6cd28d4653 Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesTestJSON-565841007 Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8379e04d2b30488387b3eefab6669768 Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesTestJSON-565841007-project Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '983acaf3-8025-4357-a90e-fa1c74ccc477'} Jul 30 21:06:58.370342 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.371406 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. Jul 30 21:06:58.373298 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.375996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] Returning 404 to user: Instance 983acaf3-8025-4357-a90e-fa1c74ccc477 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.377236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a688f5d-8fe5-406a-a88b-7ba987301369 tempest-ImagesTestJSON-565841007 tempest-ImagesTestJSON-565841007-project] 10.222.0.17 "GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477" status: 404 len: 111 microversion: 2.1 time: 0.043830 Jul 30 21:06:58.378315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 814/1692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] GET /compute/v2.1/servers/983acaf3-8025-4357-a90e-fa1c74ccc477 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:06:58.438209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:58.439366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] [instance: e91695d7-6216-4040-acf5-7ddf3498aeac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:58.446432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.447254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.449242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:58.449914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:58.471178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] HTTP exception thrown: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Request method failure captured: Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac HTTP/1.1 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zzdohuk6WWFm0AWyYYw9yLaHE-i1bjKQVItaN_Bj1o7r8Si4yBFKbN2O7mMRqUTLj_Lk2Rh5zMVqCzw1bvNb87YkxcC-uXxXSzNce9UDycHLkz5zeitpo8YhlJ23opF0_MijSkezSzLrxF_eabDj8Vnkj0sw-W7ORnP5Hbz-GA_gzA Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3b49b328c44040f0b5ae9b929e137b55 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:06:58.473410 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3b49b328c44040f0b5ae9b929e137b55", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b49b328c44040f0b5ae9b929e137b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3b49b328c44040f0b5ae9b929e137b55 Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1572351090 Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListImageFiltersTestJSON-1572351090-project Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c8c95b7c11b24f13a2a7148a087d590e Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListImageFiltersTestJSON-1572351090-project Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. Jul 30 21:06:58.475199 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e91695d7-6216-4040-acf5-7ddf3498aeac'} Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:06:58.476235 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. Jul 30 21:06:58.477995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:06:58.484833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Returning 404 to user: Instance e91695d7-6216-4040-acf5-7ddf3498aeac could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:06:58.486266 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-10741b28-4daf-4c68-ae2a-8d6414231031 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac" status: 404 len: 111 microversion: 2.1 time: 0.052121 Jul 30 21:06:58.487379 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 815/1693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] GET /compute/v2.1/servers/e91695d7-6216-4040-acf5-7ddf3498aeac => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:06:58.496847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-18312b6a-7887-441f-aedc-5f865b488db0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5cee8670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:59.052937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:59.067903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45e1a2c6-8d16-4d0d-8551-4a8fdcdc6363 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1323 microversion: 2.1 time: 0.863498 Jul 30 21:06:59.083878 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 879/1694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1323 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:59.089046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:59.089915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:59.098509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:59.099229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:59.100222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:59.101036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:59.231997 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-18312b6a-7887-441f-aedc-5f865b488db0 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09" status: 204 len: 0 microversion: 2.1 time: 0.740643 Jul 30 21:06:59.232562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 816/1695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:58 2022] DELETE /compute/v2.1/images/029fab75-8ee7-421c-85dd-e2591a91af09 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:06:59.238392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:06:59.239252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:06:59.252150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:59.254686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:59.259572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:59.260639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:59.555583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:06:59.569157 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f316cc0-5df3-4a16-99c0-d12d806da218 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1469 microversion: 2.1 time: 0.484203 Jul 30 21:06:59.586096 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 880/1696] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:59 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:06:59.595173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-70fcd47d-96a0-4211-b0ab-20a945fa1451 req-0ee0cad5-9aaa-4515-b6a0-d164daa525f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91695d7-6216-4040-acf5-7ddf3498aeac", "name": "network-vif-deleted", "tag": "dde1e96c-8028-4c91-a87e-74ef59f82db8"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:06:59.605731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70fcd47d-96a0-4211-b0ab-20a945fa1451 req-0ee0cad5-9aaa-4515-b6a0-d164daa525f1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:06:59.606520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70fcd47d-96a0-4211-b0ab-20a945fa1451 req-0ee0cad5-9aaa-4515-b6a0-d164daa525f1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:06:59.636570 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-70fcd47d-96a0-4211-b0ab-20a945fa1451 req-0ee0cad5-9aaa-4515-b6a0-d164daa525f1 service nova] Creating event network-vif-deleted:dde1e96c-8028-4c91-a87e-74ef59f82db8 for instance e91695d7-6216-4040-acf5-7ddf3498aeac on nch2-master-1 Jul 30 21:06:59.644035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-70fcd47d-96a0-4211-b0ab-20a945fa1451 req-0ee0cad5-9aaa-4515-b6a0-d164daa525f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056191 Jul 30 21:06:59.645219 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 881/1697] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:06:59.654127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-65738a0b-1796-44de-aa9a-bf64cce6b3d1 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d3b0550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:00.077314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:00.113731 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3774cb8f-4927-43d6-872a-ba6c5950924a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 0.878831 Jul 30 21:07:00.121397 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 817/1698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:59 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:00.127244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-65738a0b-1796-44de-aa9a-bf64cce6b3d1 tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1" status: 204 len: 0 microversion: 2.1 time: 0.480576 Jul 30 21:07:00.129281 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 882/1699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:06:59 2022] DELETE /compute/v2.1/images/d221b16b-e495-4bd3-b7b9-b41ac13db8b1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:00.140750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67b60209-83a3-41da-8698-955cb3f81b6e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] Calling method '.version_select at 0x7fbb5d05aa60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:00.159879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:00.160887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:00.204419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:00.206623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:00.208782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:00.212979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:00.671305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67b60209-83a3-41da-8698-955cb3f81b6e tempest-ListImageFiltersTestJSON-1572351090 tempest-ListImageFiltersTestJSON-1572351090-project] 10.222.0.17 "DELETE /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681" status: 204 len: 0 microversion: 2.1 time: 0.533291 Jul 30 21:07:00.672215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 883/1700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:00 2022] DELETE /compute/v2.1/images/9f723bdd-c11a-46c7-ad38-a0ac37e63681 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:00.677575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:00.678682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:00.695564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:00.696187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:00.697126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:00.698665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:00.793025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:00.793918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:00.796699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lazy-loading 'fault' on Instance uuid b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:07:00.945264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:00.965809 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c797fea2-8b90-4e71-a7bf-8c0894169b47 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 200 len: 1312 microversion: 2.1 time: 0.280411 Jul 30 21:07:00.983425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 884/1701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:00 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:01.054547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:01.070269 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8a1f67d-fe8e-4081-95d5-ef74f2b70bda tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1520 microversion: 2.1 time: 0.919117 Jul 30 21:07:01.071213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 818/1702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:00 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1520 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:01.098679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:01.099206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:01.110189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.111928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.114864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.115583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.142092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:01.142727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:01.152848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.153051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.154067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.154701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.188003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:01.364684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8fc95975-6d67-4906-bf17-b1da5d147830 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 204 len: 0 microversion: 2.1 time: 0.265313 Jul 30 21:07:01.366216 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 885/1703] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:01 2022] DELETE /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:01.386177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:01.392137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:01.407762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.408352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.412328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.412720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.891570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:01.901771 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e25a29c-c75c-4abf-9f49-fe35b21eb6cf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1526 microversion: 2.1 time: 0.527463 Jul 30 21:07:01.902905 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 886/1704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:01 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1526 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:01.922950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1bd0b2e9-e632-42d0-a293-552896348817 req-6f2fa969-0be1-47b1-9380-6661a5c072e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2", "name": "network-vif-deleted", "tag": "ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:01.937007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1bd0b2e9-e632-42d0-a293-552896348817 req-6f2fa969-0be1-47b1-9380-6661a5c072e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:01.944451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1bd0b2e9-e632-42d0-a293-552896348817 req-6f2fa969-0be1-47b1-9380-6661a5c072e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:01.957598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1bd0b2e9-e632-42d0-a293-552896348817 req-6f2fa969-0be1-47b1-9380-6661a5c072e8 service nova] Creating event network-vif-deleted:ba2ee62e-9225-4c17-b1a6-15aa88bbe2dd for instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 on nch2-master-1 Jul 30 21:07:01.968548 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1bd0b2e9-e632-42d0-a293-552896348817 req-6f2fa969-0be1-47b1-9380-6661a5c072e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062185 Jul 30 21:07:01.969682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 887/1705] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:01.992609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:01.993739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:02.003879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.004591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.005624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.006558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.023559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] HTTP exception thrown: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Request method failure captured: Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 HTTP/1.1 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z0qrSu4u2ipMiLTZ63Qpv1n3lGU-6_mNVUjl4u3yCTNTnGXhdCcOzhjFeG6FwB11b6QHxmfjDKhAWwfRy82ggsA0me9VmEEj2kBi3iCGcjdlk8qIyE5CMDFyh1vGff-3CqLy8aaAx1i0DWM1l2R7w4MDVUY4yGWxb9yqvpMlFRGSuI Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ebe60ae219554ca1839242aa20d2bda7 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:02.025670 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebe60ae219554ca1839242aa20d2bda7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ebe60ae219554ca1839242aa20d2bda7 Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersAdminNegativeTestJSON-499889825-project Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f820053bb2d942fd968b7129b2faae47 Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-499889825-project Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. Jul 30 21:07:02.027192 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2'} Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:02.028499 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. Jul 30 21:07:02.029885 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:02.032671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Returning 404 to user: Instance b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:02.033874 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9bf3d58d-b0cd-49fa-af1d-62b6378a6ec1 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2" status: 404 len: 111 microversion: 2.1 time: 0.047382 Jul 30 21:07:02.035162 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 888/1706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:01 2022] GET /compute/v2.1/servers/b42065cd-56b2-4a0c-bfe1-a4d2c858e4c2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:07:02.046227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:02.047083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:02.054153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.055006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.056178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.057532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.092538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:02.201800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa8ae510-099c-4399-9ce9-7fd23b056cea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 204 len: 0 microversion: 2.1 time: 0.161314 Jul 30 21:07:02.202918 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 889/1707] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:02 2022] DELETE /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:07:02.213246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:02.214469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:02.222431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.223399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.224530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.225281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.354885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:02.365477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dee79026-220d-4433-9c7b-9c00b88074e2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 1.226725 Jul 30 21:07:02.369067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 819/1708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:01 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:02.667920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:02.680861 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f684c27-7fe2-41ec-8010-15760c6b5aea tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1478 microversion: 2.1 time: 0.472809 Jul 30 21:07:02.687422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 890/1709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:02 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1478 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:02.924724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:02.925365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:02.933994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:02.935432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:02.938444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.939197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:02.941979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:02.942694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:03.395558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:03.397436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:03.415545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:03.416637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:03.419681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:03.431181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:03.767158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:03.791142 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-76e9c0fe-6af8-4dee-be5b-1e410dbd7aaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1526 microversion: 2.1 time: 0.864531 Jul 30 21:07:03.791142 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 820/1710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:02 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1526 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:03.793485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:03.794124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:03.803862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:03.804348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:03.805613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:03.806975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:03.816148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:03.976853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:03.985950 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57850d9b-db8a-43dc-9909-6049476b0ef5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 0.597785 Jul 30 21:07:03.990427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 891/1711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:03 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:04.254844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-622651c4-bbbc-4b85-ad01-6fab08017d17 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb5d3b0b80>, body: {"keypair": {"name": "tempest-keypair-1629989115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEt1meERt3jjhfIOdbYsIPj3cUeWK8TkvDD6/jtyL61hMeGZcfnTQ/5UwvX1HTO25k5fJctCEHle+38XdoLKWc2nv2bG/J356TKp8UtaH5vOiIz95BqWCmxfMp2WpWTTw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.279531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-622651c4-bbbc-4b85-ad01-6fab08017d17 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:04.285726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-622651c4-bbbc-4b85-ad01-6fab08017d17 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:04.331363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-622651c4-bbbc-4b85-ad01-6fab08017d17 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.339614 Jul 30 21:07:04.332776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 892/1712] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.341860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2886efad-c77d-479a-b049-9b513ddd370b req-678a3f02-a01f-4789-bc6a-bd60932f6a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73baf45f-2d15-4e08-b2ae-2577d2b2f2c7", "tag": "2d4622ac-a465-4398-876a-4e0d1f372790"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.368765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2886efad-c77d-479a-b049-9b513ddd370b req-678a3f02-a01f-4789-bc6a-bd60932f6a32 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:04.370053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2886efad-c77d-479a-b049-9b513ddd370b req-678a3f02-a01f-4789-bc6a-bd60932f6a32 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:04.384869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2886efad-c77d-479a-b049-9b513ddd370b req-678a3f02-a01f-4789-bc6a-bd60932f6a32 service nova] Creating event network-changed:2d4622ac-a465-4398-876a-4e0d1f372790 for instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 on nch1-master-1 Jul 30 21:07:04.390456 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2886efad-c77d-479a-b049-9b513ddd370b req-678a3f02-a01f-4789-bc6a-bd60932f6a32 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056306 Jul 30 21:07:04.391698 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 893/1713] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.399533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f4112f2-d9a7-429b-a1a4-4d196c3631ed tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d08e5e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:04.438801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f4112f2-d9a7-429b-a1a4-4d196c3631ed tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1629989115" status: 200 len: 497 microversion: 2.1 time: 0.045063 Jul 30 21:07:04.440079 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 894/1714] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:07:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1629989115 => generated 497 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.450989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-108a2817-d996-436a-8cc6-c120c2a04148 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d3b0dc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:04.496602 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-108a2817-d996-436a-8cc6-c120c2a04148 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629989115" status: 202 len: 0 microversion: 2.1 time: 0.049606 Jul 30 21:07:04.499613 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 895/1715] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629989115 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:07:04.515875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-341f35e4-e961-45b6-bc36-da3e63e2f0e4 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb62921430>, body: {"keypair": {"name": "tempest-keypair-1784155804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGebF3cigSDcxdBnK8y9jSwn08bv5q2Q2Su1vrbuWo1qBRP9dnXZabFWI++qNkUr+4JpyqmlpZ1VhvnftjqiRIqGtrFfA2gcisk3EHp0dbTixdLZFRSLi7x67Pg61OpHNA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.542416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:04.555515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-341f35e4-e961-45b6-bc36-da3e63e2f0e4 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:04.562744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-341f35e4-e961-45b6-bc36-da3e63e2f0e4 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:04.577937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-19ddea38-46d6-4977-9a44-ee091d497fff tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1478 microversion: 2.1 time: 0.791546 Jul 30 21:07:04.579574 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 821/1716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:03 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1478 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:04.604516 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-341f35e4-e961-45b6-bc36-da3e63e2f0e4 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094163 Jul 30 21:07:04.605677 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 896/1717] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.616634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7f392de-68dc-4731-97fd-b1658a14ad5e tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d0eadc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:04.652488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7f392de-68dc-4731-97fd-b1658a14ad5e tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784155804" status: 202 len: 0 microversion: 2.1 time: 0.040336 Jul 30 21:07:04.653265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 822/1718] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784155804 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:07:04.662610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3b706c1f-ae28-424d-801f-87e690065d90 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb5cd41ee0>, body: {"keypair": {"name": "tempest-keypair-476982071", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.676225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:04.689602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3b706c1f-ae28-424d-801f-87e690065d90 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:04.695619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3b706c1f-ae28-424d-801f-87e690065d90 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:04.726077 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3b706c1f-ae28-424d-801f-87e690065d90 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.066890 Jul 30 21:07:04.732775 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 897/1719] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.737669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-721cc7fc-4eec-49a2-a0ce-cd474d4bc03c tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d1c5160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:04.763554 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-721cc7fc-4eec-49a2-a0ce-cd474d4bc03c tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476982071" status: 202 len: 0 microversion: 2.1 time: 0.029872 Jul 30 21:07:04.764689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 823/1720] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476982071 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:07:04.778789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8dacb8f9-b58e-4832-a30f-11aaddafc403 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb62998b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1873085240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKghUHzHmwsYDW655d//1RBCFJXs0B5c+b8nEbloc1Y7sLIH3/EAZn+bX7xQDVdyeYb42c5hdQacHpqcSC5ZlzlWh7gbwW/IrWTCTnFN+KV5sUm9QlQBhxMZw/e5X7SSIw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.799643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8dacb8f9-b58e-4832-a30f-11aaddafc403 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:04.807915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:04.809069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8dacb8f9-b58e-4832-a30f-11aaddafc403 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:04.809584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:04.820652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:04.821712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:04.824353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:04.825287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:04.872757 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8dacb8f9-b58e-4832-a30f-11aaddafc403 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.098966 Jul 30 21:07:04.874493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 898/1721] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.890778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7cda333d-cf06-494f-a2d4-ad08c6beeeaa tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb6298d0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1387311446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpAPSUYCIFNe+RRsrb3c7yE9h6MSsRHvrGD2ueaRmUzBi+13Ce92NnEB4SNXfmKWAGkO0E3RNIsUOrjJgJJDrrhnWucXRVIEV5j+z0zPZr7ThUJMjZWYzzUsb2GyOvpkw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.916763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7cda333d-cf06-494f-a2d4-ad08c6beeeaa tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:04.921952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7cda333d-cf06-494f-a2d4-ad08c6beeeaa tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:04.952859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7cda333d-cf06-494f-a2d4-ad08c6beeeaa tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.066324 Jul 30 21:07:04.963406 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 899/1722] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:04.969899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-369a7b00-443c-4398-bd46-3946ac5a58e5 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Action: 'create', calling method: .version_select at 0x7fbb6298d4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-731988995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSpdM/nt3CaLnB9qdgD2g4PKYNM582m5xCIEq5CmSNB8UXsEL81cAWjAXmGHKS64AHUgWvh7TK2IDTEx8mYmJ0i+YrSrubCjQ1pGrwjIPEzRZtVwEiSEbDRQv2HrPXhvQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:04.989818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-369a7b00-443c-4398-bd46-3946ac5a58e5 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:05.016719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-369a7b00-443c-4398-bd46-3946ac5a58e5 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Getting quotas for user 922b0134ec3644018b1ae5e2d7376639 and project 7b09f316bee54e09aa9c747e347cb71a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:05.048338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-369a7b00-443c-4398-bd46-3946ac5a58e5 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.083148 Jul 30 21:07:05.055440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 900/1723] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:07:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:05.061080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:05.062169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:05.071883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:05.073270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:05.074717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:05.077181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:05.694588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:05.706614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-949d3850-38c5-4750-844f-6e5a408decc8 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1526 microversion: 2.1 time: 0.904385 Jul 30 21:07:05.710726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 824/1724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:04 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1526 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:05.716100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0403316f-37ea-496e-97ce-c138a4c9a34b tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d1009d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:05.729838 ncdv-master-1 devstack@n-api.service[130983]: WARNING oslo_db.sqlalchemy.utils [None req-0403316f-37ea-496e-97ce-c138a4c9a34b tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:07:05.739977 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0403316f-37ea-496e-97ce-c138a4c9a34b tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.027637 Jul 30 21:07:05.740806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 825/1725] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:07:05 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:05.757911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:05.758807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:05.766201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:05.766996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:05.768031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:05.768649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:05.877719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:05.896057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-591498b8-05df-4100-85f2-c4daffcd9e89 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 0.839139 Jul 30 21:07:05.896670 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 901/1726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:05 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:05.901483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc78937a-773b-4b94-b2a6-83918442fe0b tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5cc04550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:05.947553 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc78937a-773b-4b94-b2a6-83918442fe0b tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-731988995" status: 202 len: 0 microversion: 2.1 time: 0.049680 Jul 30 21:07:05.948166 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 902/1727] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-731988995 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:07:05.956601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-585e0d30-cfcd-48b0-967c-14decbbdc7ae tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb6298d430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:06.006278 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-585e0d30-cfcd-48b0-967c-14decbbdc7ae tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1387311446" status: 202 len: 0 microversion: 2.1 time: 0.053437 Jul 30 21:07:06.006882 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 903/1728] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1387311446 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:07:06.015710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-24a15438-71c9-4d11-8628-b34e2fee43b9 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] Calling method '.version_select at 0x7fbb5d4ac940>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:06.055880 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-24a15438-71c9-4d11-8628-b34e2fee43b9 tempest-KeyPairsV2TestJSON-755764386 tempest-KeyPairsV2TestJSON-755764386-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873085240" status: 202 len: 0 microversion: 2.1 time: 0.043805 Jul 30 21:07:06.056786 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 904/1729] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Jul 30 21:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873085240 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:07:06.461163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:06.483767 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-613ac992-ee2a-48d1-839a-658f3c64165f tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1478 microversion: 2.1 time: 0.741131 Jul 30 21:07:06.486058 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 826/1730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:05 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1478 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:06.734297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:06.735108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:06.748270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:06.750708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:06.759135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:06.760434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:06.779754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a64d4f87-6bc2-450d-9d79-80978ea133cb req-fac9b202-a46c-420f-a3c5-cbbdba9c54c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8d5fa6-cf21-4c7d-9a9e-0f13456612df", "name": "network-vif-deleted", "tag": "c453e86a-8dcd-4c99-b19a-9053460a99bd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:06.810760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a64d4f87-6bc2-450d-9d79-80978ea133cb req-fac9b202-a46c-420f-a3c5-cbbdba9c54c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:06.811798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a64d4f87-6bc2-450d-9d79-80978ea133cb req-fac9b202-a46c-420f-a3c5-cbbdba9c54c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:06.832331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:06.841405 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a64d4f87-6bc2-450d-9d79-80978ea133cb req-fac9b202-a46c-420f-a3c5-cbbdba9c54c8 service nova] Creating event network-vif-deleted:c453e86a-8dcd-4c99-b19a-9053460a99bd for instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df on nch1-master-1 Jul 30 21:07:06.853825 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a64d4f87-6bc2-450d-9d79-80978ea133cb req-fac9b202-a46c-420f-a3c5-cbbdba9c54c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077631 Jul 30 21:07:06.856133 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 827/1731] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:06.920757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:06.922159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:06.929422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:06.930249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:06.932120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:06.932819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:07.180866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:07.192582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b21fc6ad-83ba-419d-b4d6-669d34b7b0f1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 0.276567 Jul 30 21:07:07.193374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 828/1732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:06 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:07.408135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-294959299", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "aaa1b780-a232-444c-be20-645a65cbe64c"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:07.429057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b51cd5eda484fad9a901893f75d1b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4671c42e59f421192dea290a355021d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:07.437419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52698653-aabb-448e-b811-5d228974b936 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 200 len: 1484 microversion: 2.1 time: 0.707091 Jul 30 21:07:07.438012 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 905/1733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:06 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 1484 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:07.505844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:07.507851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:07.517759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] validate_networks() for [('aaa1b780-a232-444c-be20-645a65cbe64c', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:07:07.543842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:07.545183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:07.546206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:07.546840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:07.729270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820053bb2d942fd968b7129b2faae47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe60ae219554ca1839242aa20d2bda7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:07.741321 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-516544fe-13c5-4291-b93f-3bf83860c5f4 tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 200 len: 1307 microversion: 2.1 time: 0.239221 Jul 30 21:07:07.741923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 906/1734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:07 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:08.218823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:08.219675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:08.255870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.258391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.262783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.268257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.290899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:08.291760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:08.292518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:08.293183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:08.293855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:08.332834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.335689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.340532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.342134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.426752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Getting quotas for project 093aa97f9ad442ba9e9b7e7ca3937bb2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:08.444985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Getting quotas for user ebad594b0ff84e0cb36d719320979476 and project 093aa97f9ad442ba9e9b7e7ca3937bb2. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:08.472316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:07:08.477053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:07:08.563661 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce59ac47-53c5-4061-97e2-4123ae1ad7f8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314753 Jul 30 21:07:08.566005 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 829/1735] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:07:08.577594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:08.578691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: bc8d5fa6-cf21-4c7d-9a9e-0f13456612df] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:08.588234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.589422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.590531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:08.591362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:08.634904 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df HTTP/1.1 Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:08.637692 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. Jul 30 21:07:08.639494 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'bc8d5fa6-cf21-4c7d-9a9e-0f13456612df'} Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:08.640482 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. Jul 30 21:07:08.642061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:08.644115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance bc8d5fa6-cf21-4c7d-9a9e-0f13456612df could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:08.645230 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a89aa784-36d4-41e7-a90e-2e54dd7e87c4 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df" status: 404 len: 111 microversion: 2.1 time: 0.077600 Jul 30 21:07:08.646458 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 830/1736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:08 2022] GET /compute/v2.1/servers/bc8d5fa6-cf21-4c7d-9a9e-0f13456612df => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:08.652612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54cf50bc-c789-4c51-95f9-ea8721dc4ae7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:08.653556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-54cf50bc-c789-4c51-95f9-ea8721dc4ae7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:08.964030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-54cf50bc-c789-4c51-95f9-ea8721dc4ae7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:08.975829 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-54cf50bc-c789-4c51-95f9-ea8721dc4ae7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1215 microversion: 2.1 time: 0.327971 Jul 30 21:07:08.976674 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 831/1737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:08 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:08.994968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea21e293-f195-403a-93a6-0c626b5081fa tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb5d7e3af0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.034549 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ea21e293-f195-403a-93a6-0c626b5081fa tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Image not found. Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea21e293-f195-403a-93a6-0c626b5081fa tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c HTTP/1.1 Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:09.036619 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c'} Jul 30 21:07:09.038164 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c to delete Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.039085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c could not be found. Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:09.040428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea21e293-f195-403a-93a6-0c626b5081fa tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:09.042649 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea21e293-f195-403a-93a6-0c626b5081fa tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c" status: 404 len: 62 microversion: 2.1 time: 0.055067 Jul 30 21:07:09.043773 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 832/1738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:08 2022] DELETE /compute/v2.1/images/d1b4b16f-f0ca-441e-8ac8-3a0fc3d0ff6c => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:09.054665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.055628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] [instance: 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:09.072695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.073325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.074319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.076333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.114136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] HTTP exception thrown: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Request method failure captured: Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 HTTP/1.1 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z0qrSu4u2ipMiLTZ63Qpv1n3lGU-6_mNVUjl4u3yCTNTnGXhdCcOzhjFeG6FwB11b6QHxmfjDKhAWwfRy82ggsA0me9VmEEj2kBi3iCGcjdlk8qIyE5CMDFyh1vGff-3CqLy8aaAx1i0DWM1l2R7w4MDVUY4yGWxb9yqvpMlFRGSuI Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: ebe60ae219554ca1839242aa20d2bda7 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:09.117055 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebe60ae219554ca1839242aa20d2bda7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebe60ae219554ca1839242aa20d2bda7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: ebe60ae219554ca1839242aa20d2bda7 Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-499889825 Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-499889825-project Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f820053bb2d942fd968b7129b2faae47 Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-499889825-project Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. Jul 30 21:07:09.118566 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7e5b45b4-c802-4081-bd6c-d4b8ef1b2835'} Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:09.119952 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. Jul 30 21:07:09.121305 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.124817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] Returning 404 to user: Instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:09.124817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82d1603d-c25b-4952-8e31-6da41d37148a tempest-ServersAdminNegativeTestJSON-499889825 tempest-ServersAdminNegativeTestJSON-499889825-project] 10.222.0.17 "GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835" status: 404 len: 111 microversion: 2.1 time: 0.082684 Jul 30 21:07:09.124817 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 833/1739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:09 2022] GET /compute/v2.1/servers/7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:09.137004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.137536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:09.150125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.150606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.151452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.151912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.191986 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 HTTP/1.1 Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:09.200906 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.202648 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'fc34ecec-a31a-43eb-ab9b-a0021285c703'} Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:09.203778 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.205396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.207009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:09.207009 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13743e13-1fef-4d8a-8e94-e7f0f00a4d48 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 404 len: 111 microversion: 2.1 time: 0.077065 Jul 30 21:07:09.207009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 834/1740] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:09 2022] DELETE /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:09.214243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-08832c71-2cf8-4271-8a38-99686fd3ac2a req-5c21f567-bf65-470d-9b09-418a1bd478dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b45b4-c802-4081-bd6c-d4b8ef1b2835", "name": "network-vif-deleted", "tag": "4bed58a6-7dad-4d35-b3a9-9589ef49c7a7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:09.252336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-08832c71-2cf8-4271-8a38-99686fd3ac2a req-5c21f567-bf65-470d-9b09-418a1bd478dc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.253357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-08832c71-2cf8-4271-8a38-99686fd3ac2a req-5c21f567-bf65-470d-9b09-418a1bd478dc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.291724 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-08832c71-2cf8-4271-8a38-99686fd3ac2a req-5c21f567-bf65-470d-9b09-418a1bd478dc service nova] Creating event network-vif-deleted:4bed58a6-7dad-4d35-b3a9-9589ef49c7a7 for instance 7e5b45b4-c802-4081-bd6c-d4b8ef1b2835 on nch1-master-1 Jul 30 21:07:09.310172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-08832c71-2cf8-4271-8a38-99686fd3ac2a req-5c21f567-bf65-470d-9b09-418a1bd478dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104087 Jul 30 21:07:09.313544 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 835/1741] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:09.332958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.332958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: fc34ecec-a31a-43eb-ab9b-a0021285c703] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:09.359732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.360401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.361662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:09.363990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:09.392655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 HTTP/1.1 Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:09.399882 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.401841 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'fc34ecec-a31a-43eb-ab9b-a0021285c703'} Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:09.402678 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. Jul 30 21:07:09.404062 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:09.405295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance fc34ecec-a31a-43eb-ab9b-a0021285c703 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:09.405295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2d58d848-c067-4423-89da-20baae21ad96 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703" status: 404 len: 111 microversion: 2.1 time: 0.085585 Jul 30 21:07:09.405881 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 836/1742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:09 2022] GET /compute/v2.1/servers/fc34ecec-a31a-43eb-ab9b-a0021285c703 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:09.415105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d5a8650-ef9a-445c-ac5b-8b0326eebeaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb5d719b80>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.468669 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d5a8650-ef9a-445c-ac5b-8b0326eebeaf tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371140701" status: 202 len: 0 microversion: 2.1 time: 0.061298 Jul 30 21:07:09.472694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 837/1743] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371140701 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:07:09.651931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:09.664415 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f15b8e5-f3f2-463c-90d8-9bc663253fca tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 1.450399 Jul 30 21:07:09.669196 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 907/1744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:08 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:09.998807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:09.999632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:10.016444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:10.017499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:10.018844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:10.022782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:10.298545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:10.317836 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4010dac8-98a6-482d-b7cd-150606d7e09d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1267 microversion: 2.1 time: 0.322821 Jul 30 21:07:10.319000 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 838/1745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:09 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1267 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:10.690862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:10.691697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:10.705903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:10.706791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:10.707768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:10.710718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:11.065168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3050735f-f6d4-4034-a738-b008d6930f6b req-ac2bfbb3-6ff3-47cd-9887-b9a3ac67546f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73baf45f-2d15-4e08-b2ae-2577d2b2f2c7", "name": "network-vif-plugged", "status": "completed", "tag": "2d4622ac-a465-4398-876a-4e0d1f372790"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:11.086408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3050735f-f6d4-4034-a738-b008d6930f6b req-ac2bfbb3-6ff3-47cd-9887-b9a3ac67546f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:11.100355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3050735f-f6d4-4034-a738-b008d6930f6b req-ac2bfbb3-6ff3-47cd-9887-b9a3ac67546f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:11.152111 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3050735f-f6d4-4034-a738-b008d6930f6b req-ac2bfbb3-6ff3-47cd-9887-b9a3ac67546f service nova] Creating event network-vif-plugged:2d4622ac-a465-4398-876a-4e0d1f372790 for instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 on nch1-master-1 Jul 30 21:07:11.169801 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3050735f-f6d4-4034-a738-b008d6930f6b req-ac2bfbb3-6ff3-47cd-9887-b9a3ac67546f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109154 Jul 30 21:07:11.172274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 839/1746] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:07:11.344179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:11.345266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:11.358665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:11.359463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:11.360394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:11.360849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:11.743019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:11.757499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:11.782397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-769d1293-6a9e-49f1-ab6b-c1b1563d5223 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1273 microversion: 2.1 time: 0.442799 Jul 30 21:07:11.784034 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 840/1747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:11 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1273 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:11.797874 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55e0f710-db32-40fc-a391-23f3909fe686 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1317 microversion: 2.1 time: 1.111319 Jul 30 21:07:11.822455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 908/1748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:10 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1317 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:12.264738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:12.267320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.267974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.268966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.269632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.316674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22b010b9-0030-4eb1-8503-be4ab07f46d5 tempest-AZV2TestJSON-1075720463 tempest-AZV2TestJSON-1075720463-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.529361 Jul 30 21:07:12.317912 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 841/1749] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 30 21:07:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:07:12.745951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a20e7ac-508a-4b83-a9c2-393d125c781b tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '.version_select at 0x7fbb6299b040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:12.776863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3a20e7ac-508a-4b83-a9c2-393d125c781b tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Image not found. Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a20e7ac-508a-4b83-a9c2-393d125c781b tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/images/219cfbe1-5f42-4fe6-b799-09e9a9de2466 HTTP/1.1 Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:12.780884 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '219cfbe1-5f42-4fe6-b799-09e9a9de2466'} Jul 30 21:07:12.782725 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 219cfbe1-5f42-4fe6-b799-09e9a9de2466 to delete Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:12.783824 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 219cfbe1-5f42-4fe6-b799-09e9a9de2466 could not be found. Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:12.785348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:12.786896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.790446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a20e7ac-508a-4b83-a9c2-393d125c781b tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:12.792638 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a20e7ac-508a-4b83-a9c2-393d125c781b tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/images/219cfbe1-5f42-4fe6-b799-09e9a9de2466" status: 404 len: 62 microversion: 2.1 time: 0.051349 Jul 30 21:07:12.805969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:12.806835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:12.814792 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 909/1750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:12 2022] DELETE /compute/v2.1/images/219cfbe1-5f42-4fe6-b799-09e9a9de2466 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:12.841952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.844250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:12.845571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.848071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.848738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.852725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:12.885515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.885999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.886843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.889282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.896069 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 HTTP/1.1 Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:12.897799 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:12.902679 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2'} Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:12.903645 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:12.905258 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:12.908798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:12.908798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b3e3fe3-38ea-4889-93fa-15a53d72a1c0 tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 404 len: 111 microversion: 2.1 time: 0.098073 Jul 30 21:07:12.934433 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 842/1751] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:12 2022] DELETE /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:12.953543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:12.965334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:12.993151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:12.993644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:12.994499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:13.009853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:13.401765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:13.428495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8ebc545-3520-4b19-bad5-b155ec45c818 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.596461 Jul 30 21:07:13.431411 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 910/1752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:12 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:13.462380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:13.466024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] [instance: 0a1c2085-7678-42d9-bc8e-9c26adfd49f2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:13.484021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:13.484405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:13.486368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:13.490339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:13.557773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] HTTP exception thrown: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Request method failure captured: Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 HTTP/1.1 Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Zz2wPfwrJL0ybs_Vi_85xTXAjLnrUfi5ayjyBTQ2NhwK2hxsR_KBDOicwmTJDgW-wdhfTGeMw6lYG_D8bMx0KbAhwWNBFcjzWbNEfja_rno2HDQybFyWpya49P8Q1iyR3jMimSGc-bCPMxZeeh0OI9ATVkcdB71XDQGvuoOM2Hv0wE Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:13.559397 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c4671c42e59f421192dea290a355021d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c4671c42e59f421192dea290a355021d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c4671c42e59f421192dea290a355021d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c4671c42e59f421192dea290a355021d Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-996040052 Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5b51cd5eda484fad9a901893f75d1b48 Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-996040052-project Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:13.560957 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0a1c2085-7678-42d9-bc8e-9c26adfd49f2'} Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:13.561830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. Jul 30 21:07:13.563184 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:13.566207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] Returning 404 to user: Instance 0a1c2085-7678-42d9-bc8e-9c26adfd49f2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:13.566207 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-410af5fa-0ee5-4c20-9d89-0eccbd08e07e tempest-ImagesOneServerNegativeTestJSON-996040052 tempest-ImagesOneServerNegativeTestJSON-996040052-project] 10.222.0.17 "GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2" status: 404 len: 111 microversion: 2.1 time: 0.128321 Jul 30 21:07:13.566207 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 911/1753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:13 2022] GET /compute/v2.1/servers/0a1c2085-7678-42d9-bc8e-9c26adfd49f2 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:14.371110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:14.394611 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-96dd4550-8ab4-4861-88b9-f6d8001251f6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1466 microversion: 2.1 time: 1.453726 Jul 30 21:07:14.415485 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 843/1754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:12 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1466 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:14.420723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:14.421356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:14.430689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:14.432369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:14.433695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:14.434677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:14.451538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:14.452175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:14.464510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:14.465789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:14.469100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:14.469719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:14.846080 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60fda6f1-1202-4d4d-8535-8c814a7e2983 tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1617 microversion: 2.1 time: 0.429017 Jul 30 21:07:14.846920 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 912/1755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:14 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1617 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:15.119400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1406526534", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7f920502-e0cf-43aa-93ba-62d50d7905d7"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:15.132470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:15.137262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=24 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:15.172798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95afc965-4d3d-4686-9aa8-5c1c4152c654 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.722831 Jul 30 21:07:15.179485 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 844/1756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:14 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:15.215410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:07:15.735612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:15.737325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:15.738242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:15.738894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:15.739776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:15.764531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:15.765461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:15.766295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:15.766751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:15.785372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:15.790387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Getting quotas for user d20ab89ea13c4611904cec244d37ba25 and project 3a50eb5e4a334562a71d4116fa94fbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:15.805761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:07:15.810493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:07:15.926567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb6cf18c-f242-484d-9f9e-c4a71adc8bc6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813103 Jul 30 21:07:15.938299 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 913/1757] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:07:15.941997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fd5df754-cb9f-43e7-81c8-1def8dadbb07 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:15.942984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fd5df754-cb9f-43e7-81c8-1def8dadbb07 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:16.199859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:16.200697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:16.211875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:16.215146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:16.217924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:16.218852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:16.243374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd5df754-cb9f-43e7-81c8-1def8dadbb07 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:16.265677 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fd5df754-cb9f-43e7-81c8-1def8dadbb07 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1217 microversion: 2.1 time: 0.328164 Jul 30 21:07:16.266278 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 845/1758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:15 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:17.140766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:17.152412 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b271b0f-a37b-48d8-b4e1-971aada55575 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.957279 Jul 30 21:07:17.169043 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 914/1759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:16 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:17.254030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-54846a6d-7d77-4efe-9bd9-9b65f65639ce req-73b6e814-bb61-4d4a-a105-7876a6ec23fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42691c7-8e46-4eeb-b111-f971efd1e3da", "tag": "29bf00d0-d6c6-42cf-af7c-f1510c35a042"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:17.265191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:17.278068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-54846a6d-7d77-4efe-9bd9-9b65f65639ce req-73b6e814-bb61-4d4a-a105-7876a6ec23fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:17.278613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-54846a6d-7d77-4efe-9bd9-9b65f65639ce req-73b6e814-bb61-4d4a-a105-7876a6ec23fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:17.286550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:17.286819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:17.302862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:17.303367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:17.304143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:17.304593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:17.323184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-54846a6d-7d77-4efe-9bd9-9b65f65639ce req-73b6e814-bb61-4d4a-a105-7876a6ec23fc service nova] Creating event network-changed:29bf00d0-d6c6-42cf-af7c-f1510c35a042 for instance c42691c7-8e46-4eeb-b111-f971efd1e3da on nch2-master-1 Jul 30 21:07:17.328373 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-54846a6d-7d77-4efe-9bd9-9b65f65639ce req-73b6e814-bb61-4d4a-a105-7876a6ec23fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077850 Jul 30 21:07:17.328971 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 846/1760] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:07:17.498811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:17.507132 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51e52403-7234-483d-a61f-36fae2634823 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1269 microversion: 2.1 time: 0.224846 Jul 30 21:07:17.508459 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 915/1761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:17 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:18.176067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:18.177539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:18.191827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:18.195617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:18.196576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:18.198505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:18.530146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:18.530795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:18.547280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:18.547887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:18.548586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:18.549035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:18.749520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:18.763057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2cb8c86b-0a54-470b-af2f-a898d12efa4c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1275 microversion: 2.1 time: 0.237432 Jul 30 21:07:18.764003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 916/1762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:18 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:19.126444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1258969396", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:19.177866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:19.185471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:07:19.189408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-760acae9-bd0e-480a-99d1-991e7f5aa84c tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 1.016091 Jul 30 21:07:19.190045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 847/1763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:18 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:19.788803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:19.789867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:19.797343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:19.798099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:19.799088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:19.799725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:19.823490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:19.824101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:19.824666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:19.825191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:19.825754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:19.831251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:19.844235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:19.845108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:19.846180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:19.846866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:19.872540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:19.877676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:19.894794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:07:19.897217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:07:19.955980 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf050b50-41bb-4280-8f7a-fde80774fb1b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000424 Jul 30 21:07:19.957406 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 917/1764] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:07:19.974939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25227db7-b676-4b5c-8389-15140384ec8e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:19.976183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-25227db7-b676-4b5c-8389-15140384ec8e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:20.017492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:20.028485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7820fd2-9f25-43e1-a4c7-68f94244cbf4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1275 microversion: 2.1 time: 0.243453 Jul 30 21:07:20.041966 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 848/1765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:19 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:20.071100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-25227db7-b676-4b5c-8389-15140384ec8e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:20.082112 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25227db7-b676-4b5c-8389-15140384ec8e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1213 microversion: 2.1 time: 0.111491 Jul 30 21:07:20.083349 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 918/1766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:19 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:20.217679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:20.219448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:20.233504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:20.234296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:20.238382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:20.239824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:21.052228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:21.053044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:21.067283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:21.070159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:21.073553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:21.079626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:21.080530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:21.081744 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0033cfc2-38da-4df6-ad1b-090d4c3bf94d tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.873548 Jul 30 21:07:21.085135 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 849/1767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:20 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:21.108525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:21.109476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:21.126922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:21.130175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:21.131620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:21.132563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:21.296576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:21.309161 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-513568cd-13fc-4776-af3e-d9914ae9d8d2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1275 microversion: 2.1 time: 0.261178 Jul 30 21:07:21.309915 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 919/1768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:21 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:21.436070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:21.456302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce7c2128-77e6-4c7c-acea-0451876e2ffa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1265 microversion: 2.1 time: 0.354122 Jul 30 21:07:21.470241 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 850/1769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:21 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:22.109538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:22.110288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:22.130634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.135826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.136987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.137709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.345054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:22.345054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:22.358213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:22.370239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.370719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.388621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.388621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.894385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:22.911346 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-beae3243-cec5-4aa4-84c7-e57e1870c80b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 0.580377 Jul 30 21:07:22.913289 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 851/1770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:22 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:22.915587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:22.922574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:22.923220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:22.932350 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff1ed7ff-d506-441f-974e-31972b9a563a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.818450 Jul 30 21:07:22.933377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 920/1771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:22 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:22.941545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.942003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.942821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:22.943522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:22.950975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:23.131009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:23.144360 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e1dcd25-55c9-40bf-8308-289f81d028e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1271 microversion: 2.1 time: 0.228844 Jul 30 21:07:23.164345 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 852/1772] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:22 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:23.933717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:23.939761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:23.948113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:23.948991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:23.952229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:23.952964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:23.955208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:23.956047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:23.975229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:23.978739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:23.981940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:23.982544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:24.324880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:24.334717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f8e52b8c-08ac-4515-9a49-38392a969cd8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.384893 Jul 30 21:07:24.338739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 853/1773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:23 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:24.348283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:24.349246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:24.360104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:24.362931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:24.369716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:24.372124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:24.479199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:24.494493 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-91cb561a-8311-4d8e-8b2c-36905b447232 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1271 microversion: 2.1 time: 0.149324 Jul 30 21:07:24.509861 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 854/1774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:24 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:25.024306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:25.037120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc6d9ce3-5a35-4975-abc3-56a9f6e09eab tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 1.107398 Jul 30 21:07:25.044869 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 921/1775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:23 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:25.358679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:25.359347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:25.367507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:25.368332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:25.369418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:25.370123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:25.517789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:25.518482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:25.527713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:25.528185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:25.528987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:25.529444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:25.915224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:25.929891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-571936a1-2c8d-4027-a6dd-42f7b5b764da tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.574977 Jul 30 21:07:25.939531 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 855/1776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:25 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:26.063994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:26.065024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:26.080611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:26.083825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:26.086666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:26.089605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:26.265966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:27.116945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:27.174227 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2df6f4b-3c17-4773-9afe-cdd67b08ea1a tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 1.085165 Jul 30 21:07:27.177525 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 856/1777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:26 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:27.202336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:27.203004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:27.236403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:27.247360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:27.248867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:27.249347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:27.597796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:27.606328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb73b8bd-5a1a-4c12-a508-ddc3ef90d5f3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 2.093358 Jul 30 21:07:27.619203 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 922/1778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:25 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:27.631645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-08bfe299-e9f2-416e-a35a-1adcb2db5b17 req-25e10b0b-f134-4db3-9395-4cbd6a035043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c0d1bf-4026-4468-8f65-f0ca63466cfe", "tag": "3e5bf196-b748-42a1-96ed-433bbe18d8d5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:27.658411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-08bfe299-e9f2-416e-a35a-1adcb2db5b17 req-25e10b0b-f134-4db3-9395-4cbd6a035043 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:27.660812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-08bfe299-e9f2-416e-a35a-1adcb2db5b17 req-25e10b0b-f134-4db3-9395-4cbd6a035043 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:27.687124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-08bfe299-e9f2-416e-a35a-1adcb2db5b17 req-25e10b0b-f134-4db3-9395-4cbd6a035043 service nova] Creating event network-changed:3e5bf196-b748-42a1-96ed-433bbe18d8d5 for instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe on nch2-master-1 Jul 30 21:07:27.696568 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-08bfe299-e9f2-416e-a35a-1adcb2db5b17 req-25e10b0b-f134-4db3-9395-4cbd6a035043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074880 Jul 30 21:07:27.698036 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 923/1779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:28.200833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:28.201566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:28.205719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:28.220731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:28.221221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:28.225233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:28.226864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:28.275279 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15adf733-728f-4430-9ac0-3d74f094093b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 1.086738 Jul 30 21:07:28.277760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 857/1780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:27 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:28.638404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:28.639060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:28.679155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:28.682941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:28.684073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:28.684617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:29.216982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:29.231787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-675f5c56-ce20-4240-8893-fa80dac5add0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.602967 Jul 30 21:07:29.253456 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 858/1781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:28 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:29.281066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:29.316139 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fa9ca9e-0d1b-4829-b6bf-ab1b75186ab1 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 1.119821 Jul 30 21:07:29.323769 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 924/1782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:28 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:29.334684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:29.335670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:29.366418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:29.368679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:29.370356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:29.371019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:29.818490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f87c487-4387-43f1-a5f5-6dc0b9a9c5f4 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] Calling method '.version_select at 0x7fbb5d7190d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:29.820527 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:29.820527 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:07:29.855408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f87c487-4387-43f1-a5f5-6dc0b9a9c5f4 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.596570 Jul 30 21:07:29.856738 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 859/1783] 10.222.0.17 () {60 vars in 1226 bytes} [Sat Jul 30 21:07:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:29.863588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:29.867991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-25d8ee7f-45cb-46af-81c9-548b6776d04a tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d719b80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:29.875210 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:29.875210 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:07:30.077081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=14 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:30.194562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-25d8ee7f-45cb-46af-81c9-548b6776d04a tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.330523 Jul 30 21:07:30.195659 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 860/1784] 10.222.0.17 () {62 vars in 1247 bytes} [Sat Jul 30 21:07:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:30.387784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bfb222cf-db43-424d-be07-560804e1d55c tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] Calling method '.version_select at 0x7fbb5d100040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:30.489768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bfb222cf-db43-424d-be07-560804e1d55c tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] 10.222.0.17 "GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd" status: 200 len: 784 microversion: 2.1 time: 0.292667 Jul 30 21:07:30.502441 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 861/1785] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:07:30 2022] GET /compute/v2.1/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd => generated 784 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:30.508546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26a02930-3312-4b9c-ba46-384c8fd357a6 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] Calling method '.version_select at 0x7fbb5d8cb3a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:30.523265 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26a02930-3312-4b9c-ba46-384c8fd357a6 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019087 Jul 30 21:07:30.524480 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 862/1786] 10.222.0.17 () {60 vars in 1226 bytes} [Sat Jul 30 21:07:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:30.530215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:30.531804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:30.540852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:30.542405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:30.543987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:30.544764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:30.747450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:30.758588 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49fe36de-0386-40fd-8472-67da74476920 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 1.430112 Jul 30 21:07:30.760232 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 925/1787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:29 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:30.779566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4b9b3762-7dac-44de-845a-96f283c27fa7 req-6f6a276f-0fda-4d3c-919b-b1e00b5daf97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42691c7-8e46-4eeb-b111-f971efd1e3da", "name": "network-vif-plugged", "status": "completed", "tag": "29bf00d0-d6c6-42cf-af7c-f1510c35a042"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:30.807016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4b9b3762-7dac-44de-845a-96f283c27fa7 req-6f6a276f-0fda-4d3c-919b-b1e00b5daf97 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:30.816686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4b9b3762-7dac-44de-845a-96f283c27fa7 req-6f6a276f-0fda-4d3c-919b-b1e00b5daf97 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:30.843630 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4b9b3762-7dac-44de-845a-96f283c27fa7 req-6f6a276f-0fda-4d3c-919b-b1e00b5daf97 service nova] Creating event network-vif-plugged:29bf00d0-d6c6-42cf-af7c-f1510c35a042 for instance c42691c7-8e46-4eeb-b111-f971efd1e3da on nch2-master-1 Jul 30 21:07:30.855522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4b9b3762-7dac-44de-845a-96f283c27fa7 req-6f6a276f-0fda-4d3c-919b-b1e00b5daf97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091136 Jul 30 21:07:30.856151 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 926/1788] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:30.898942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:30.907185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:30.918684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:30.922214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:30.923950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:30.924728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:30.949274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:30.958168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23ad049b-6341-4ab0-a34c-eda5c65e0873 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.432190 Jul 30 21:07:30.961382 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 863/1789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:30 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:30.972197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:30.975896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b1ff983-7c7c-4542-8f73-063b0823554a tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] Calling method '.version_select at 0x7fbb5d8cb670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:31.059629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b1ff983-7c7c-4542-8f73-063b0823554a tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] 10.222.0.17 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.096906 Jul 30 21:07:31.064643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 864/1790] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:30 2022] GET /compute/v2.1/images => generated 445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:31.088412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-073abfec-367e-42d5-b8db-7cabc06233c3 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] Action: 'update', calling method: .version_select at 0x7fbb5d100430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:31.094582 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:31.094582 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:07:31.217062 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-073abfec-367e-42d5-b8db-7cabc06233c3 tempest-QuotaClassesAdmin257Test-1050652694 tempest-QuotaClassesAdmin257Test-1050652694-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.151177 Jul 30 21:07:31.217675 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 865/1791] 10.222.0.17 () {62 vars in 1247 bytes} [Sat Jul 30 21:07:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:31.357529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5f50e3fe-b1f4-405a-ac1d-ddeaf2b983f6 tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Calling method '.version_select at 0x7fbb62ab1c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:31.424763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5f50e3fe-b1f4-405a-ac1d-ddeaf2b983f6 tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.199556 Jul 30 21:07:31.426276 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 866/1792] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:07:31 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:07:31.432688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4a18772-f147-4d25-b1f7-d17bd395b3e8 tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] Calling method '.version_select at 0x7fbb5d656940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:31.508469 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4a18772-f147-4d25-b1f7-d17bd395b3e8 tempest-ListImagesTestJSON-2109142088 tempest-ListImagesTestJSON-2109142088-project] 10.222.0.17 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.080764 Jul 30 21:07:31.508922 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 867/1793] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:07:31 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:31.531910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f103a417-ddab-470a-881c-6c0054836791 req-b3e27432-46a5-4d7c-809c-3bad8d63e50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:31.532579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:31.548304 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-638f2bb1-d791-411c-8b03-3d4dca833e39 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 0.685726 Jul 30 21:07:31.550383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 927/1794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:30 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:31.567744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-144d2d56-8493-4080-b6c4-05fc4c3d8f6b tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Action: 'create', calling method: .version_select at 0x7fbb62921b80>, body: {"pool": "non_exist_pool"} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:31.610444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f103a417-ddab-470a-881c-6c0054836791 req-b3e27432-46a5-4d7c-809c-3bad8d63e50e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:31.612371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f103a417-ddab-470a-881c-6c0054836791 req-b3e27432-46a5-4d7c-809c-3bad8d63e50e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:31.655349 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f103a417-ddab-470a-881c-6c0054836791 req-b3e27432-46a5-4d7c-809c-3bad8d63e50e service nova] Creating event network-changed:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch1-master-1 Jul 30 21:07:31.669853 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f103a417-ddab-470a-881c-6c0054836791 req-b3e27432-46a5-4d7c-809c-3bad8d63e50e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159009 Jul 30 21:07:31.677049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 868/1795] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:31.784726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:31.785557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:31.801578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:31.801578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:31.806834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:31.807611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:31.953154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-144d2d56-8493-4080-b6c4-05fc4c3d8f6b tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] HTTP exception thrown: Floating IP pool not found. Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-144d2d56-8493-4080-b6c4-05fc4c3d8f6b tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Request method failure captured: Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 26 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2SigFJMIf2vSj9oEhvb3gUrFTwgwX4GNoo63OmpV30mzbnw-Rfx3lKgsy0L7y9xIen9ZcFwfs0Ab8gDhljOofmR0BiWs8SB_k7uK3nSxbm4ni1iESpntLvlUcfw58fTM6qhuGAfRxYzLhsSMP3u-tnjZ-vI6lihCwrEGIoiir0idY Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d7f8aac4d7bc44abb0d86e5a72bdaff1 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:31.955001 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7f8aac4d7bc44abb0d86e5a72bdaff1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d7f8aac4d7bc44abb0d86e5a72bdaff1 Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsNegativeTestJSON-1678611144-project Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 26bab5a783244ca9aa9668dd106e373f Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1678611144-project Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: {"pool": "non_exist_pool"} Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: exception: Floating IP pool not found. Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 30 21:07:31.957007 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:31.958345 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:31.960097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-144d2d56-8493-4080-b6c4-05fc4c3d8f6b tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Returning 404 to user: Floating IP pool not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:31.964122 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-144d2d56-8493-4080-b6c4-05fc4c3d8f6b tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.405481 Jul 30 21:07:31.966976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 928/1796] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:07:31 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:31.974156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Calling method '.version_select at 0x7fbb6298dd30>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:32.206314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 056c8ef1-c4db-4a3a-99f2-28246b43e7fb could not be found", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:07:32.207232 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] HTTP exception thrown: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Request method failure captured: Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-floating-ips/056c8ef1-c4db-4a3a-99f2-28246b43e7fb HTTP/1.1 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2SigFJMIf2vSj9oEhvb3gUrFTwgwX4GNoo63OmpV30mzbnw-Rfx3lKgsy0L7y9xIen9ZcFwfs0Ab8gDhljOofmR0BiWs8SB_k7uK3nSxbm4ni1iESpntLvlUcfw58fTM6qhuGAfRxYzLhsSMP3u-tnjZ-vI6lihCwrEGIoiir0idY Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d7f8aac4d7bc44abb0d86e5a72bdaff1 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:32.209253 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7f8aac4d7bc44abb0d86e5a72bdaff1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7f8aac4d7bc44abb0d86e5a72bdaff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d7f8aac4d7bc44abb0d86e5a72bdaff1 Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1678611144 Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsNegativeTestJSON-1678611144-project Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 26bab5a783244ca9aa9668dd106e373f Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1678611144-project Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: exception: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '056c8ef1-c4db-4a3a-99f2-28246b43e7fb'} Jul 30 21:07:32.211037 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:07:32.212149 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 056c8ef1-c4db-4a3a-99f2-28246b43e7fb could not be found Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bf49788-108b-4530-a197-eb64ce726380'] Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb. Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:32.213755 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:32.215417 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:32.217300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb Jul 30 21:07:32.217300 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:32.217502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:32.219335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] Returning 404 to user: Floating IP not found for ID 056c8ef1-c4db-4a3a-99f2-28246b43e7fb {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:32.219335 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11b5d79c-1b4c-43a0-9b84-bd3551b988dc tempest-FloatingIPsNegativeTestJSON-1678611144 tempest-FloatingIPsNegativeTestJSON-1678611144-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/056c8ef1-c4db-4a3a-99f2-28246b43e7fb" status: 404 len: 111 microversion: 2.1 time: 0.251143 Jul 30 21:07:32.224377 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb77fa36-ca4f-4d38-8ce9-9cde54058aeb tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1315 microversion: 2.1 time: 0.443275 Jul 30 21:07:32.225075 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 929/1797] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:07:31 2022] DELETE /compute/v2.1/os-floating-ips/056c8ef1-c4db-4a3a-99f2-28246b43e7fb => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:32.228341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 869/1798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:31 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:32.233230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:32.234392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:32.255143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:32.255941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:32.257650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:32.259539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:32.577070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:32.577738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:32.592938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:32.593828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:32.594717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:32.595243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:33.268774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:33.283487 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9320fc4-206e-4b46-a56b-3fe5c359a621 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 1.056410 Jul 30 21:07:33.299675 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 930/1799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:32 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:33.305090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:33.316807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:33.333562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:33.336479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:33.345767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:33.346564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:33.919431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:33.931506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-170ff93e-ee78-421e-a30f-8493713af363 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 1.359310 Jul 30 21:07:33.945406 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 870/1800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:32 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:33.967689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:33.989034 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0945f28-f6f9-46c2-a959-9028e087909e tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1503 microversion: 2.1 time: 0.687387 Jul 30 21:07:33.991398 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 931/1801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:33 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1503 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:34.014256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:34.014780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:34.028454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.028933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.032264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.032726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.089434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:34.258626 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9c7c5f8-9eef-427c-bc5e-8e50f659749f tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 204 len: 0 microversion: 2.1 time: 0.248139 Jul 30 21:07:34.258626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 871/1802] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:34 2022] DELETE /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:34.266926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:34.267879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:34.276681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.277352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.277993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.278525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.321391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:34.323311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:34.336683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.339022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.342422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.344900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.638276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:34.650834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ca24516-c8d2-4af5-a4e0-0655aa29fa75 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.332498 Jul 30 21:07:34.652396 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 872/1803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:34 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:34.952925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:34.953677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:34.957357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:34.970061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.984093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:34.990107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:34.991404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:35.169257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:35.181958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f918f0eb-f70a-492f-b751-06c4a40aee8a tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1509 microversion: 2.1 time: 0.917608 Jul 30 21:07:35.201542 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 932/1804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:34 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1509 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:35.674700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:35.675433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:35.691138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:35.691696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:35.692481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:35.692907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:35.805648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:35.815597 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b44e1c97-347b-435c-ab00-8f03e27567f2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 0.866666 Jul 30 21:07:35.819085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 873/1805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:34 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:35.876222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-af12943c-8a97-48f9-a2a6-7dbab895d072 req-8b2e791a-f227-48bb-b0ed-6f2b1a1bd31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c0d1bf-4026-4468-8f65-f0ca63466cfe", "name": "network-vif-plugged", "status": "completed", "tag": "3e5bf196-b748-42a1-96ed-433bbe18d8d5"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:35.899543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-af12943c-8a97-48f9-a2a6-7dbab895d072 req-8b2e791a-f227-48bb-b0ed-6f2b1a1bd31e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:35.900371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-af12943c-8a97-48f9-a2a6-7dbab895d072 req-8b2e791a-f227-48bb-b0ed-6f2b1a1bd31e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:35.918328 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-af12943c-8a97-48f9-a2a6-7dbab895d072 req-8b2e791a-f227-48bb-b0ed-6f2b1a1bd31e service nova] Creating event network-vif-plugged:3e5bf196-b748-42a1-96ed-433bbe18d8d5 for instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe on nch2-master-1 Jul 30 21:07:35.925332 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-af12943c-8a97-48f9-a2a6-7dbab895d072 req-8b2e791a-f227-48bb-b0ed-6f2b1a1bd31e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054421 Jul 30 21:07:35.926483 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 874/1806] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:07:36.211901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:36.213289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:36.227253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:36.229434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:36.230561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:36.233454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:36.338644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:36.351185 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-292ef5af-0aaf-46e4-9ba9-293dcd65b359 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.676338 Jul 30 21:07:36.353995 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 933/1807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:35 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:36.971501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] Calling method '.version_select at 0x7fbb62956700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:36.990082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:36.990966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:36.992003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:36.992766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:37.022116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9fdebc1-748e-4f0b-bdf9-fdfa053e4b2e tempest-AbsoluteLimitsTestJSON-1421612836 tempest-AbsoluteLimitsTestJSON-1421612836-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.272277 Jul 30 21:07:37.026181 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 934/1808] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:07:36 2022] GET /compute/v2.1/limits => generated 511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:37.161192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1239593593", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "e18630d2-267b-48ad-955d-1514746d6c6c"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:37.265233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] validate_networks() for [('e18630d2-267b-48ad-955d-1514746d6c6c', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:07:37.356927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:37.368298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-19d08c81-3dec-452e-9656-bdb4d21d94a8 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1509 microversion: 2.1 time: 1.160060 Jul 30 21:07:37.369726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 875/1809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:36 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1509 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:37.380362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:37.383065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:37.399250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:37.400235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:37.401299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:37.404447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:37.479904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:37.972272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:37.976308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:37.978291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:37.979567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:37.980594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:38.027604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.029235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.030274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.030888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.051441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:38.059251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for user 2517a20b0358424480784b0003512d50 and project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:38.075665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:07:38.079127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:07:38.164830 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-477d7064-510e-4f80-8f43-6d6b6cc6ecf5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137208 Jul 30 21:07:38.177585 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 935/1810] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:07:38.182624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:38.183377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:38.193352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.194221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.197206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.197846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.539086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:38.558010 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fbc81cd1-567d-457a-95ae-7f4d11bc30f8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1317 microversion: 2.1 time: 1.180650 Jul 30 21:07:38.558685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 876/1811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:37 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1317 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:38.574913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:38.579132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c73845e0-da9f-412e-9f01-33428342ed95 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:38.581645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c73845e0-da9f-412e-9f01-33428342ed95 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:38.585746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81cad471-bbd3-45ca-b0e4-586b3f9f90cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.408512 Jul 30 21:07:38.588869 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 936/1812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:38 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:38.604854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:38.605521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:38.631081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.637164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.659957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:38.661881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:38.837576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:38.847507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f9f95fc6-c28f-4273-9172-46c895d098a6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1467 microversion: 2.1 time: 0.257267 Jul 30 21:07:38.848122 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 937/1813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:38 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:38.941190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c73845e0-da9f-412e-9f01-33428342ed95 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:38.976300 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c73845e0-da9f-412e-9f01-33428342ed95 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1218 microversion: 2.1 time: 0.410783 Jul 30 21:07:38.978658 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 877/1814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:38 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:39.122063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-76c08608-b1d7-45de-a525-bbc3578c3126 req-1575600f-dd03-4b8e-bc1f-aa131aad2e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42691c7-8e46-4eeb-b111-f971efd1e3da", "name": "network-vif-deleted", "tag": "29bf00d0-d6c6-42cf-af7c-f1510c35a042"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:39.146350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-76c08608-b1d7-45de-a525-bbc3578c3126 req-1575600f-dd03-4b8e-bc1f-aa131aad2e19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.146725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-76c08608-b1d7-45de-a525-bbc3578c3126 req-1575600f-dd03-4b8e-bc1f-aa131aad2e19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.200426 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-76c08608-b1d7-45de-a525-bbc3578c3126 req-1575600f-dd03-4b8e-bc1f-aa131aad2e19 service nova] Creating event network-vif-deleted:29bf00d0-d6c6-42cf-af7c-f1510c35a042 for instance c42691c7-8e46-4eeb-b111-f971efd1e3da on nch2-master-1 Jul 30 21:07:39.206182 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-76c08608-b1d7-45de-a525-bbc3578c3126 req-1575600f-dd03-4b8e-bc1f-aa131aad2e19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090918 Jul 30 21:07:39.207521 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 938/1815] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:07:39.271911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9ed95d78-c790-4616-8ede-6229ab6efb99 req-23508433-cdb5-46d8-a1c7-54166e451bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "name": "network-vif-plugged", "status": "completed", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:39.293467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9ed95d78-c790-4616-8ede-6229ab6efb99 req-23508433-cdb5-46d8-a1c7-54166e451bbf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.295406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9ed95d78-c790-4616-8ede-6229ab6efb99 req-23508433-cdb5-46d8-a1c7-54166e451bbf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.332981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9ed95d78-c790-4616-8ede-6229ab6efb99 req-23508433-cdb5-46d8-a1c7-54166e451bbf service nova] Creating event network-vif-plugged:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch1-master-1 Jul 30 21:07:39.350621 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9ed95d78-c790-4616-8ede-6229ab6efb99 req-23508433-cdb5-46d8-a1c7-54166e451bbf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078738 Jul 30 21:07:39.359533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 878/1816] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:39.581499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:39.582714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:39.594536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.598050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.599116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.600396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.610810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:39.612385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:39.624355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.624827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.629661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:39.630532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:39.941416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:39.957695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ddb781f9-f234-43a5-bd27-58ce73c4b161 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1467 microversion: 2.1 time: 0.380785 Jul 30 21:07:39.979773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 939/1817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:39 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1467 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:39.992933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:39.994024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:40.010323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.016171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.017226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.017791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.098827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.099682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.100673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lazy-loading 'fault' on Instance uuid c42691c7-8e46-4eeb-b111-f971efd1e3da {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:07:40.171654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:40.185580 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e76ed75-54c3-4e4a-9cbf-8eec374246eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1313 microversion: 2.1 time: 0.579030 Jul 30 21:07:40.188368 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 879/1818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:39 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:40.204854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:40.205898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:40.215900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad594b0ff84e0cb36d719320979476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093aa97f9ad442ba9e9b7e7ca3937bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:40.226181 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05b5a25b-a9f3-45ad-b6db-35faf3c94bb6 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 200 len: 1305 microversion: 2.1 time: 0.242036 Jul 30 21:07:40.226812 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 940/1819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:39 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:40.232777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.234894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:40.235509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.235930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:40.236389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.236854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.244254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.245090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.246823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.247575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.356857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:40.364930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2d1fab0e-8334-4d6f-801b-04733ae59a23 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1270 microversion: 2.1 time: 0.135875 Jul 30 21:07:40.365526 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 941/1820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:40 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:40.790674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da8f7c38-859a-4564-bd0c-11c5c25756bb tempest-ServersOnMultiNodesTest-601744848 tempest-ServersOnMultiNodesTest-601744848-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1618 microversion: 2.1 time: 0.599982 Jul 30 21:07:40.791632 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 880/1821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:40 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1618 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:40.816845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:40.817658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:40.827590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.828069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.828888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:40.829376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:40.892651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:41.065328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0e997c4-de04-4427-9d1d-008251f29470 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 204 len: 0 microversion: 2.1 time: 0.252178 Jul 30 21:07:41.068937 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 942/1822] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:40 2022] DELETE /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:41.079157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:41.080044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:41.100859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.101861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.104867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.109266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.315225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9aba5e5b-9d68-42a5-a03f-8c748b9c2d0d tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] Calling method '.version_select at 0x7fbb5d38e700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:41.317793 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:41.317793 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:07:41.336965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9aba5e5b-9d68-42a5-a03f-8c748b9c2d0d tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.197504 Jul 30 21:07:41.338061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 943/1823] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:07:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:41.343362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:41.344280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:41.352339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.353522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.354422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.354977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.534239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:41.554491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df906a80-409a-48e1-bdd9-dc6421ad0e52 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1462 microversion: 2.1 time: 0.213936 Jul 30 21:07:41.555401 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 944/1824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:41 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1462 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:41.563700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:41.566435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:41.584343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.596775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.597821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.599608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.625057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da HTTP/1.1 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:41.627117 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:41.629119 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'c42691c7-8e46-4eeb-b111-f971efd1e3da'} Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:41.630259 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:41.632101 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:41.635729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:41.636612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2317c02-ca15-4b3b-9206-7d5cc49815ad tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 404 len: 111 microversion: 2.1 time: 0.079341 Jul 30 21:07:41.640552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 945/1825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:41 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:41.642244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11df9155-673b-4eee-98c8-f8cda1faaeb4 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] Action: 'update', calling method: .version_select at 0x7fbb6298d4c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:41.649129 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:41.649129 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:07:41.718657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:41.896686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:41.909847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92def03f-e9bc-4416-b44e-6f76da454e4d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1473 microversion: 2.1 time: 0.839216 Jul 30 21:07:41.911060 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 881/1826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:41 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1473 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:41.918781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:41.919653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:41.942257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.942734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:41.943569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:41.944027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.054419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11df9155-673b-4eee-98c8-f8cda1faaeb4 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.415719 Jul 30 21:07:42.059212 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 946/1827] 10.222.0.17 () {60 vars in 1206 bytes} [Sat Jul 30 21:07:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:42.127570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:42.136480 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be21c996-f9eb-4f84-9162-77f7d22f97d6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1276 microversion: 2.1 time: 0.223526 Jul 30 21:07:42.136928 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 882/1828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:41 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:42.154767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1722299716", "metadata": {"image_type": "test"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:42.163488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:42.177996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.178792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.181985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.182730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.214431 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da/action HTTP/1.1 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 112 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.219280 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1722299716", "metadata": {"image_type": "test"}}} Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.221264 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c42691c7-8e46-4eeb-b111-f971efd1e3da', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1722299716', 'metadata': {'image_type': 'test'}}}} Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.222368 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.224019 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.225707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.225707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.225707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.225707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.233181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.234317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b98727c7-9eef-40a6-9bfa-ef7152121270 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "POST /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da/action" status: 404 len: 111 microversion: 2.1 time: 0.096194 Jul 30 21:07:42.238538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 883/1829] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 30 21:07:42 2022] POST /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:42.263219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6dd738ef-f704-4013-8540-4127ebfeacb7 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] Calling method '.version_select at 0x7fbb62a99820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:42.264629 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:42.264629 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:07:42.278083 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6dd738ef-f704-4013-8540-4127ebfeacb7 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.036945 Jul 30 21:07:42.279456 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 884/1830] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:07:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:42.286714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1093268192", "metadata": {"image_type": "test"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:42.292165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Failed to fetch instance by id tempest-invalid-1159847172 {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:07:42.293022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance tempest-invalid-1159847172 could not be found. Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/tempest-invalid-1159847172/action HTTP/1.1 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 112 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.294736 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1093268192", "metadata": {"image_type": "test"}}} Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.296548 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance tempest-invalid-1159847172 could not be found. Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'tempest-invalid-1159847172', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1093268192', 'metadata': {'image_type': 'test'}}}} Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1159847172 could not be found. Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.297627 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1159847172 could not be found. Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1159847172 could not be found. Jul 30 21:07:42.299240 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.301711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance tempest-invalid-1159847172 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.301711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d49b1261-2128-4f8d-80f5-b13d82a7a384 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "POST /compute/v2.1/servers/tempest-invalid-1159847172/action" status: 404 len: 101 microversion: 2.1 time: 0.015676 Jul 30 21:07:42.311970 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 885/1831] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 30 21:07:42 2022] POST /compute/v2.1/servers/tempest-invalid-1159847172/action => generated 101 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:42.318123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4331abb1-8316-4e53-82b9-f9e66f484217 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] Action: 'update', calling method: .version_select at 0x7fbb62a6ec10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:42.323532 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:07:42.323532 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:07:42.489564 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4331abb1-8316-4e53-82b9-f9e66f484217 tempest-QuotaClassesAdminTestJSON-773694872 tempest-QuotaClassesAdminTestJSON-773694872-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.175262 Jul 30 21:07:42.490386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 886/1832] 10.222.0.17 () {60 vars in 1206 bytes} [Sat Jul 30 21:07:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:42.516094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-699856540"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:42.523461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:07:42.524370 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 56 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.526360 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: {"createImage": {"name": "tempest-test-snap-699856540"}} Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.528214 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-699856540'}}} Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.529284 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.530891 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.533097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:42.533746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:42.534876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.536028 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a4b51b2-5d1e-40da-9ca7-14d537a9b6c0 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.044165 Jul 30 21:07:42.538781 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 887/1833] 10.222.0.17 () {60 vars in 1275 bytes} [Sat Jul 30 21:07:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:42.550804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-607303496"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:42.554444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:07:42.555158 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 56 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.557836 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: {"createImage": {"name": "tempest-test-snap-607303496"}} Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.559372 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-607303496'}}} Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.560318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 30 21:07:42.561722 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.563966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.565167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fdd163e-24eb-448b-9c68-eb63047866c7 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020344 Jul 30 21:07:42.566125 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 888/1834] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Jul 30 21:07:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:42.574070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.574645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.578790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:42.579594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:42.581689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.582178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.589519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.590182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.591354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.591966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.616992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da HTTP/1.1 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.620076 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.621572 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c42691c7-8e46-4eeb-b111-f971efd1e3da'} Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.622530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.624262 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.626683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.627980 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-704acda7-a3df-4985-b54e-e64eb431214b tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 404 len: 111 microversion: 2.1 time: 0.055098 Jul 30 21:07:42.633186 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 889/1835] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:42 2022] DELETE /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:42.642623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:42.643714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] [instance: c42691c7-8e46-4eeb-b111-f971efd1e3da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:42.651474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.651935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.652936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:42.653727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:42.679161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] HTTP exception thrown: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Request method failure captured: Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da HTTP/1.1 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z17Y_e6pT0uhiIoEtW8JJd0-AIcGd1LFbUrnd48Kg8eJ1MvWYdCHoEKkKLmjkDIBLen6VWoRVWOeS7dFWxVC6-skdlhBAgdebitdwLEad1uFC4gY4NHGjoiurlq9Mi87RL7g0O_rtBIMMZGqwwYLlYRgpJMdRb4hXgvIrNRDEss9Qc Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:42.682385 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_093aa97f9ad442ba9e9b7e7ca3937bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/093aa97f9ad442ba9e9b7e7ca3937bb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 093aa97f9ad442ba9e9b7e7ca3937bb2 Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-491914045 Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ebad594b0ff84e0cb36d719320979476 Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesNegativeTestJSON-491914045-project Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.684119 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c42691c7-8e46-4eeb-b111-f971efd1e3da'} Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:42.685203 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. Jul 30 21:07:42.687043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:42.688792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] Returning 404 to user: Instance c42691c7-8e46-4eeb-b111-f971efd1e3da could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:42.688792 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f0a7c92-418f-4709-b870-3e38a23e7118 tempest-ImagesNegativeTestJSON-491914045 tempest-ImagesNegativeTestJSON-491914045-project] 10.222.0.17 "GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da" status: 404 len: 111 microversion: 2.1 time: 0.049024 Jul 30 21:07:42.688792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 890/1836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:42 2022] GET /compute/v2.1/servers/c42691c7-8e46-4eeb-b111-f971efd1e3da => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:43.286804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df5e22d9-feb0-47a8-be97-05dda68dd297 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb62a91550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2132436070", "description": "tempest-description-1983658084"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:43.484369 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c2c6054-dd2e-4eb6-9c5e-92919252082c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1613 microversion: 2.1 time: 1.425113 Jul 30 21:07:43.501655 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 947/1837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:42 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1613 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:43.520164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:43.521224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:43.535853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:43.537734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:43.538917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:43.539579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.027386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:44.031612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:44.044563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d030e08f-7229-4771-ba4f-fd5308c5a548 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 200 len: 1473 microversion: 2.1 time: 0.541415 Jul 30 21:07:44.046618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 948/1838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:43 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 1473 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:44.068517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:44.069583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:44.077385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:44.078172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.079149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:44.079856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.345501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df5e22d9-feb0-47a8-be97-05dda68dd297 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.546115 Jul 30 21:07:44.346178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 891/1839] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:07:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:44.362803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:44.363755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:44.383230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:44.385299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.388767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:44.389900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.465487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '042c41b5f14d4a87979147530adccda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b34535abfb4f5d86e5091998a6823b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:44.466433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] flavor_id is None. Assuming migration. {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 30 21:07:44.468176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:07:44.866942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:44.876700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e04f5040-822d-4fc5-bd5d-f13188d42d5c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1276 microversion: 2.1 time: 0.816039 Jul 30 21:07:44.880996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 949/1840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:44 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1276 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:44.886954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-29eeddcd-b5bc-4060-9d5c-a33b8863bec5 req-ed4776b7-2166-41fe-bc87-dce820952708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c0d1bf-4026-4468-8f65-f0ca63466cfe", "name": "network-vif-deleted", "tag": "3e5bf196-b748-42a1-96ed-433bbe18d8d5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:44.917189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-29eeddcd-b5bc-4060-9d5c-a33b8863bec5 req-ed4776b7-2166-41fe-bc87-dce820952708 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:44.921138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-29eeddcd-b5bc-4060-9d5c-a33b8863bec5 req-ed4776b7-2166-41fe-bc87-dce820952708 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:44.985961 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-29eeddcd-b5bc-4060-9d5c-a33b8863bec5 req-ed4776b7-2166-41fe-bc87-dce820952708 service nova] Creating event network-vif-deleted:3e5bf196-b748-42a1-96ed-433bbe18d8d5 for instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe on nch2-master-1 Jul 30 21:07:45.028689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-29eeddcd-b5bc-4060-9d5c-a33b8863bec5 req-ed4776b7-2166-41fe-bc87-dce820952708 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145475 Jul 30 21:07:45.032844 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 950/1841] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:45.050542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf258c5a-3e5f-42af-a32a-79971aa0cd1d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb628eb5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1077356209", "description": "tempest-description-1458448853"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:45.122066 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-17303579-9aea-4dc5-a034-26003eeeef70 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9/action" status: 202 len: 0 microversion: 2.1 time: 0.764949 Jul 30 21:07:45.128515 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 892/1842] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:07:44 2022] POST /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:07:45.137395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:45.138128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: c8c0d1bf-4026-4468-8f65-f0ca63466cfe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:45.159246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.160230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.161379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.162776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.194788 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe HTTP/1.1 Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:45.196631 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. Jul 30 21:07:45.198227 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c8c0d1bf-4026-4468-8f65-f0ca63466cfe'} Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:45.200376 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. Jul 30 21:07:45.202708 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:45.205721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance c8c0d1bf-4026-4468-8f65-f0ca63466cfe could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:45.205721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22468e84-9fc6-4ff7-b6fe-c49e0f70c3ea tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe" status: 404 len: 111 microversion: 2.1 time: 0.066924 Jul 30 21:07:45.205721 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 893/1843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:45 2022] GET /compute/v2.1/servers/c8c0d1bf-4026-4468-8f65-f0ca63466cfe => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:45.206188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:45.206793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:45.226175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.226520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.227213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.228240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.619084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:45.632568 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c6bbbbe-5c51-452f-b772-a16e450a687a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1471 microversion: 2.1 time: 0.429406 Jul 30 21:07:45.637810 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 894/1844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:45 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:45.648420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:45.653758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:45.680068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.684316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.692022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:45.695066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:45.819941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:46.094763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3384810d-96d0-4fcf-9b97-7371010a0589 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 204 len: 0 microversion: 2.1 time: 0.454069 Jul 30 21:07:46.098385 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 895/1845] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:45 2022] DELETE /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:46.114616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:46.116643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:46.146254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:46.149351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:46.155233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:46.156062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:46.387039 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf258c5a-3e5f-42af-a32a-79971aa0cd1d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.351410 Jul 30 21:07:46.390785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 951/1846] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:07:45 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:46.416914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:46.422470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:46.470036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:46.474862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:46.475773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:46.476235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:46.754143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:46.776576 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5100b4b6-8028-43f9-9d7d-bb593c22eab5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 0.673712 Jul 30 21:07:46.777629 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 896/1847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:46 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:46.787581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1580899094", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "6e933f29-0529-47aa-8c1a-d8e3316823fc"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:46.941228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] validate_networks() for [('6e933f29-0529-47aa-8c1a-d8e3316823fc', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:07:47.393556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:47.409927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-543822ce-85a8-4f61-aa52-045de4057c2d tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1472 microversion: 2.1 time: 1.017916 Jul 30 21:07:47.423348 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 952/1848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:46 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1472 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:47.423348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:47.423348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:47.445155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:47.445755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:47.446923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:47.448790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.043955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:48.173920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:48.202691 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-510f291e-f8be-4d75-9b5e-4cba73901004 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1471 microversion: 2.1 time: 0.788192 Jul 30 21:07:48.224798 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 953/1849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:47 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1471 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:48.263763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-48b99072-7320-48d6-9161-cb1b54ff66b7 req-90fac53a-c07e-4c51-bf37-26bf4f921db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d028aca0-d3d0-4caf-8b0c-615ab599b649", "tag": "e782bd19-ee42-40ec-b554-e87a125812a1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:48.287024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:48.287590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:48.288279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:48.288962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:48.291508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:48.317015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.317536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-48b99072-7320-48d6-9161-cb1b54ff66b7 req-90fac53a-c07e-4c51-bf37-26bf4f921db7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.318849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.319943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-48b99072-7320-48d6-9161-cb1b54ff66b7 req-90fac53a-c07e-4c51-bf37-26bf4f921db7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.327549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.330033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.372790 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-48b99072-7320-48d6-9161-cb1b54ff66b7 req-90fac53a-c07e-4c51-bf37-26bf4f921db7 service nova] Creating event network-changed:e782bd19-ee42-40ec-b554-e87a125812a1 for instance d028aca0-d3d0-4caf-8b0c-615ab599b649 on nch2-master-1 Jul 30 21:07:48.387947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Getting quotas for project 6193b7fd6d224f328a2b4c561edb89ea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:07:48.390067 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-48b99072-7320-48d6-9161-cb1b54ff66b7 req-90fac53a-c07e-4c51-bf37-26bf4f921db7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163916 Jul 30 21:07:48.394536 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 954/1850] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:48.414275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:48.415014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Getting quotas for user eeb3ffbaef3347de8d9ad6b2bdfa19bc and project 6193b7fd6d224f328a2b4c561edb89ea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:07:48.415156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:48.437157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.438885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.441752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.442274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.446052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:07:48.450162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:07:48.643958 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f6c1ea0-b0f5-48c2-a058-b194a71cca7f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.861044 Jul 30 21:07:48.648315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 897/1851] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:07:48.662637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:48.663713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:48.678444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.684471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:48.686274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:48.687138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:49.184921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:49.201914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:49.208631 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-481335e6-b45f-428d-ac98-2818ecbadf0e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1472 microversion: 2.1 time: 0.558806 Jul 30 21:07:49.215995 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2d4d3d77-3837-40e6-9150-ef7cb679ce0b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 0.819702 Jul 30 21:07:49.218274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 955/1852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:48 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:49.229337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7387a963-3aa7-4265-b837-b02ad93fdaa9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:49.230352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7387a963-3aa7-4265-b837-b02ad93fdaa9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:49.231088 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 898/1853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:48 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1472 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:49.250953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:49.252199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:49.280560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:49.281075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:49.281899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:49.282359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:49.792177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7387a963-3aa7-4265-b837-b02ad93fdaa9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:49.801522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7387a963-3aa7-4265-b837-b02ad93fdaa9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1216 microversion: 2.1 time: 0.581953 Jul 30 21:07:49.807074 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 956/1854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:49 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1216 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:50.101842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:50.117836 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-974317cb-3ff0-4946-9270-255ecc2d3085 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1471 microversion: 2.1 time: 0.880761 Jul 30 21:07:50.152990 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 899/1855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:49 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1471 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:50.241229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:50.244024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:50.244663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:50.247775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:50.275262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.275764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.276586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.277045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.282387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.287685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.288820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.289849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.581517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:50.599876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba910bde-f3ad-4326-a06a-4d4fd63c2e18 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 200 len: 1430 microversion: 2.1 time: 0.366636 Jul 30 21:07:50.600505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 957/1856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:50 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 1430 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:50.639771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f9693e27-71b4-419d-8e80-26ffbf985d2c req-52ca0885-8059-4658-9abd-58e282531788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73baf45f-2d15-4e08-b2ae-2577d2b2f2c7", "name": "network-vif-deleted", "tag": "2d4622ac-a465-4398-876a-4e0d1f372790"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:50.690388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f9693e27-71b4-419d-8e80-26ffbf985d2c req-52ca0885-8059-4658-9abd-58e282531788 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.690866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f9693e27-71b4-419d-8e80-26ffbf985d2c req-52ca0885-8059-4658-9abd-58e282531788 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.749594 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f9693e27-71b4-419d-8e80-26ffbf985d2c req-52ca0885-8059-4658-9abd-58e282531788 service nova] Creating event network-vif-deleted:2d4622ac-a465-4398-876a-4e0d1f372790 for instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 on nch1-master-1 Jul 30 21:07:50.764676 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f9693e27-71b4-419d-8e80-26ffbf985d2c req-52ca0885-8059-4658-9abd-58e282531788 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141094 Jul 30 21:07:50.765458 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 958/1857] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:50.830996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:50.835213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:50.849363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.851448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:50.854928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:50.856280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:51.507818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:51.518036 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3568777-424e-4696-88a9-c915504f483e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1274 microversion: 2.1 time: 0.691481 Jul 30 21:07:51.534706 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 959/1858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:50 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1274 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:51.625541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:51.633399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:51.649871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a42095b-aaf1-42de-9681-2d2171ffc3d7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 1.412461 Jul 30 21:07:51.656471 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 900/1859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:50 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:51.672189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:51.676946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:51.713332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:51.715828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:51.719307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:51.722438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:51.930756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Action: 'update', calling method: .version_select at 0x7fbb628eb9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:52.202762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.204251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.205202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.205666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.363057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c01092b8-4974-4731-ab99-3f96b3747a8d tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2" status: 200 len: 240 microversion: 2.36 time: 0.826771 Jul 30 21:07:52.368983 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 960/1860] 10.222.0.17 () {62 vars in 1303 bytes} [Sat Jul 30 21:07:51 2022] PUT /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2 => generated 240 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:52.378418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.379265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:52.397984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.398702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.399759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.400450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.435537 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 HTTP/1.1 Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:52.437784 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. Jul 30 21:07:52.439742 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '73baf45f-2d15-4e08-b2ae-2577d2b2f2c7'} Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:52.440631 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. Jul 30 21:07:52.442083 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.444887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:52.445974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-547f7765-2ade-477d-abae-969a54caa200 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7" status: 404 len: 111 microversion: 2.1 time: 0.075654 Jul 30 21:07:52.450531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 961/1861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:52 2022] GET /compute/v2.1/servers/73baf45f-2d15-4e08-b2ae-2577d2b2f2c7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:52.475616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:52.496840 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81d6a9d2-9d13-4961-b855-64a567cc42db tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1471 microversion: 2.1 time: 0.839206 Jul 30 21:07:52.497466 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 901/1862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:51 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1471 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:52.523305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Calling method '.version_select at 0x7fbb62979790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.671900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1ff3d41-c84b-4477-988c-ec3d012f74a6 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Calling method '.version_select at 0x7fbb6291f820>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.700390 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a1ff3d41-c84b-4477-988c-ec3d012f74a6 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1ff3d41-c84b-4477-988c-ec3d012f74a6 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/images/190064bc-1128-42e3-902f-57367edef117/metadata/os_distro HTTP/1.1 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:52.707125 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'image_id': '190064bc-1128-42e3-902f-57367edef117', 'id': 'os_distro'} Jul 30 21:07:52.708775 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:52.709750 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 190064bc-1128-42e3-902f-57367edef117 Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:52.711539 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 190064bc-1128-42e3-902f-57367edef117 could not be found. Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:52.713495 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:52.714807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1ff3d41-c84b-4477-988c-ec3d012f74a6 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:52.718149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1ff3d41-c84b-4477-988c-ec3d012f74a6 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "DELETE /compute/v2.1/images/190064bc-1128-42e3-902f-57367edef117/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.256667 Jul 30 21:07:52.718149 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 962/1863] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:07:52 2022] DELETE /compute/v2.1/images/190064bc-1128-42e3-902f-57367edef117/metadata/os_distro => generated 62 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:52.726209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.727910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:52.743404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.743900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.744719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.748019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.770276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.779639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.782604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.784076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.790224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:52.830782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:52.859772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b8c1b6a-724d-435f-b154-b6d35921d05a tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2/detail" status: 200 len: 672 microversion: 2.36 time: 0.358717 Jul 30 21:07:52.863834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 902/1864] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Jul 30 21:07:52 2022] GET /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2/detail => generated 672 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:52.876747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.877901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:52.900636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.903955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.907970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.908811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.929024 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf28f7f3-5d64-4720-b9e5-b9dde2f5ff84 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 204 len: 0 microversion: 2.1 time: 0.209622 Jul 30 21:07:52.933715 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 963/1865] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:52 2022] DELETE /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:52.941569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:52.942601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:52.952788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.953441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:52.954671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:52.955487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.263945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:53.309647 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7ba9691-8c40-4bc2-b58d-1b6bca680827 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 0.371561 Jul 30 21:07:53.310302 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 964/1866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:52 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:53.341289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bd6560b-6d1f-4019-9522-611453e550fd tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Calling method '.version_select at 0x7fbb5d3b08b0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:53.388975 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3bd6560b-6d1f-4019-9522-611453e550fd tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bd6560b-6d1f-4019-9522-611453e550fd tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/images/232a6f98-db3a-4062-b3ce-40c8a82e8101/metadata/os_version HTTP/1.1 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:53.391328 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'image_id': '232a6f98-db3a-4062-b3ce-40c8a82e8101', 'id': 'os_version'} Jul 30 21:07:53.393159 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:53.394240 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 232a6f98-db3a-4062-b3ce-40c8a82e8101 Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:53.395798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 232a6f98-db3a-4062-b3ce-40c8a82e8101 could not be found. Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:53.398116 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.400580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bd6560b-6d1f-4019-9522-611453e550fd tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:53.403801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bd6560b-6d1f-4019-9522-611453e550fd tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "GET /compute/v2.1/images/232a6f98-db3a-4062-b3ce-40c8a82e8101/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.079395 Jul 30 21:07:53.403801 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 965/1867] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:07:53 2022] GET /compute/v2.1/images/232a6f98-db3a-4062-b3ce-40c8a82e8101/metadata/os_version => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:53.405981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:53.409147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:53.429259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.429720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.430553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.431054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.478022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:53.492788 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fb4c7a9-a1b0-473e-9ae3-05f7f0c40c8b tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1274 microversion: 2.1 time: 0.625147 Jul 30 21:07:53.503886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 903/1868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:52 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1274 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:53.516007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Action: 'update', calling method: .version_select at 0x7fbb629dc820>, body: {"quota_set": {"ram": "2048"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:53.634545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.635215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.637656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.639248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.718520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.719273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.723231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.724822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.815993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:53.830546 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20ea8c76-171d-4df5-a3c0-e13b50ad5088 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1473 microversion: 2.1 time: 0.430038 Jul 30 21:07:53.832192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 966/1869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:53 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:53.840321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffab491c-42be-4c74-9bfb-abdd462d2bf7 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Calling method '.version_select at 0x7fbb628e75e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:53.876732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d22253c-6632-4cf6-9b57-dd6d9e463a45 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2?user_id=0ecb3c0646de417582d3780b478dcf83" status: 200 len: 240 microversion: 2.36 time: 0.370484 Jul 30 21:07:53.878812 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 904/1870] 10.222.0.17 () {62 vars in 1384 bytes} [Sat Jul 30 21:07:53 2022] PUT /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2?user_id=0ecb3c0646de417582d3780b478dcf83 => generated 240 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:53.894393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:53.895973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ffab491c-42be-4c74-9bfb-abdd462d2bf7 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:53.896147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffab491c-42be-4c74-9bfb-abdd462d2bf7 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/images/c0f83df6-e33d-480d-9723-bced4e50ba3a/metadata HTTP/1.1 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:53.899368 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'image_id': 'c0f83df6-e33d-480d-9723-bced4e50ba3a'} Jul 30 21:07:53.900912 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:53.901813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c0f83df6-e33d-480d-9723-bced4e50ba3a Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:53.903055 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0f83df6-e33d-480d-9723-bced4e50ba3a could not be found. Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:53.904493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:53.905768 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:53.909042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffab491c-42be-4c74-9bfb-abdd462d2bf7 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:53.910171 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ffab491c-42be-4c74-9bfb-abdd462d2bf7 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "GET /compute/v2.1/images/c0f83df6-e33d-480d-9723-bced4e50ba3a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.076206 Jul 30 21:07:53.911462 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 967/1871] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:07:53 2022] GET /compute/v2.1/images/c0f83df6-e33d-480d-9723-bced4e50ba3a/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:53.922517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eca31c9d-2c1d-41d3-9a8a-e28b57e92a13 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] Calling method '.version_select at 0x7fbb628e70d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:53.930025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.931062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:53.934775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:53.935253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:54.133195 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eca31c9d-2c1d-41d3-9a8a-e28b57e92a13 tempest-QuotasAdminTestV236-1974983997 tempest-QuotasAdminTestV236-1974983997-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2?user_id=0ecb3c0646de417582d3780b478dcf83" status: 200 len: 282 microversion: 2.36 time: 0.220164 Jul 30 21:07:54.134553 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 968/1872] 10.222.0.17 () {60 vars in 1364 bytes} [Sat Jul 30 21:07:53 2022] GET /compute/v2.1/os-quota-sets/27f025408e2d4f4e855f02d2be5cc7c2?user_id=0ecb3c0646de417582d3780b478dcf83 => generated 282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:07:54.160016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62e8b1ef-0f49-4ece-a7f0-6e32f3c6a8ab tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Action: 'update_all', calling method: .version_select at 0x7fbb6298d670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:54.219746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-62e8b1ef-0f49-4ece-a7f0-6e32f3c6a8ab tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62e8b1ef-0f49-4ece-a7f0-6e32f3c6a8ab tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/images/52bbe9db-a197-43a8-8fe0-00ab4eaee8e5/metadata HTTP/1.1 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 57 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:54.222836 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:54.224684 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'image_id': '52bbe9db-a197-43a8-8fe0-00ab4eaee8e5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.225839 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 52bbe9db-a197-43a8-8fe0-00ab4eaee8e5 Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.228313 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52bbe9db-a197-43a8-8fe0-00ab4eaee8e5 could not be found. Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:54.231185 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:54.233929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.240783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62e8b1ef-0f49-4ece-a7f0-6e32f3c6a8ab tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:54.240783 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-62e8b1ef-0f49-4ece-a7f0-6e32f3c6a8ab tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "PUT /compute/v2.1/images/52bbe9db-a197-43a8-8fe0-00ab4eaee8e5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.098409 Jul 30 21:07:54.240783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 969/1873] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:07:54 2022] PUT /compute/v2.1/images/52bbe9db-a197-43a8-8fe0-00ab4eaee8e5/metadata => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:54.263239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-943bc40c-3b74-4567-b6cf-6a122f488265 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Action: 'update', calling method: .version_select at 0x7fbb628e79d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:54.323834 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-943bc40c-3b74-4567-b6cf-6a122f488265 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-943bc40c-3b74-4567-b6cf-6a122f488265 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/images/21092a1a-d4da-43d2-85a9-585bf0a11eb8/metadata/os_distro HTTP/1.1 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 30 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:07:54.326308 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: {"meta": {"os_distro": "alt"}} Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:07:54.327919 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'image_id': '21092a1a-d4da-43d2-85a9-585bf0a11eb8', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.329051 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 21092a1a-d4da-43d2-85a9-585bf0a11eb8 Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.330298 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21092a1a-d4da-43d2-85a9-585bf0a11eb8 could not be found. Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:54.331665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:54.332954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.334394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-943bc40c-3b74-4567-b6cf-6a122f488265 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:54.334394 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-943bc40c-3b74-4567-b6cf-6a122f488265 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "PUT /compute/v2.1/images/21092a1a-d4da-43d2-85a9-585bf0a11eb8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.083399 Jul 30 21:07:54.334394 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 970/1874] 10.222.0.17 () {60 vars in 1310 bytes} [Sat Jul 30 21:07:54 2022] PUT /compute/v2.1/images/21092a1a-d4da-43d2-85a9-585bf0a11eb8/metadata/os_distro => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:54.340132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:54.340760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:54.358219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:UPDATE=11,nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:54.405194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:54.405676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:54.409065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:54.411983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:54.531607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:54.539820 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1951610c-9850-4239-862c-2c29e7e02daf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.659609 Jul 30 21:07:54.560098 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 905/1875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:53 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:54.575243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc82b2b0-525c-4322-8ec4-a81483f787b2 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Action: 'create', calling method: .version_select at 0x7fbb62a6e9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:54.628945 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-cc82b2b0-525c-4322-8ec4-a81483f787b2 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] HTTP exception thrown: Image not found. Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc82b2b0-525c-4322-8ec4-a81483f787b2 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Request method failure captured: Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/images/146f1adb-1c56-417f-ba50-2e1d639ca7de/metadata HTTP/1.1 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 57 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2n6516UKjjUFgnj6lBEtUKn-Wf7vHCG9kiFTEKiXSJtO4_DJ4J6kUt7YhFBlF8_Xz5lYaYN8GRi77o-bEcoFflZG1iGtBrAdkWZkU_uEqnDrNQmdBgm5FPLSbfb-2HATOBJJG7pHRr9voCk1hokZQcYj2_qnY2WM77wPF-x0qTz7s Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:54.631432 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b89b4ac33c224340841a65250343d643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b89b4ac33c224340841a65250343d643", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b89b4ac33c224340841a65250343d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b89b4ac33c224340841a65250343d643 Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991 Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d7c534dcb896486ab003d91ab6623449 Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1538933991-project Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:07:54.633222 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'image_id': '146f1adb-1c56-417f-ba50-2e1d639ca7de', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.634433 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 146f1adb-1c56-417f-ba50-2e1d639ca7de Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:07:54.636842 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 146f1adb-1c56-417f-ba50-2e1d639ca7de could not be found. Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:54.639571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:07:54.647438 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:54.654145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc82b2b0-525c-4322-8ec4-a81483f787b2 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:54.654145 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc82b2b0-525c-4322-8ec4-a81483f787b2 tempest-ImagesMetadataNegativeTestJSON-1538933991 tempest-ImagesMetadataNegativeTestJSON-1538933991-project] 10.222.0.17 "POST /compute/v2.1/images/146f1adb-1c56-417f-ba50-2e1d639ca7de/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071729 Jul 30 21:07:54.654145 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 906/1876] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Jul 30 21:07:54 2022] POST /compute/v2.1/images/146f1adb-1c56-417f-ba50-2e1d639ca7de/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:07:54.654145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:54.654145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:54.658822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:54.659303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:54.666932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:54.670245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:55.067251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:55.077541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64278548-2999-4705-b1c1-355bb1e48417 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.442454 Jul 30 21:07:55.080054 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 907/1877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:54 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:55.093888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:55.094826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:55.109961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:55.110639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:55.112805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:55.113457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:55.309550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:55.318257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e84529a1-db42-407d-8560-e8c001efd514 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 0.988383 Jul 30 21:07:55.318843 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 971/1878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:54 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:55.483942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e1f41d0b-25fa-4bc4-85e8-5f8774566aed req-8b5fe491-8eeb-46d6-99f9-f511ca873622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d028aca0-d3d0-4caf-8b0c-615ab599b649", "name": "network-vif-plugged", "status": "completed", "tag": "e782bd19-ee42-40ec-b554-e87a125812a1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:55.506655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1f41d0b-25fa-4bc4-85e8-5f8774566aed req-8b5fe491-8eeb-46d6-99f9-f511ca873622 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:55.507661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1f41d0b-25fa-4bc4-85e8-5f8774566aed req-8b5fe491-8eeb-46d6-99f9-f511ca873622 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:55.538778 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e1f41d0b-25fa-4bc4-85e8-5f8774566aed req-8b5fe491-8eeb-46d6-99f9-f511ca873622 service nova] Creating event network-vif-plugged:e782bd19-ee42-40ec-b554-e87a125812a1 for instance d028aca0-d3d0-4caf-8b0c-615ab599b649 on nch2-master-1 Jul 30 21:07:55.545621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e1f41d0b-25fa-4bc4-85e8-5f8774566aed req-8b5fe491-8eeb-46d6-99f9-f511ca873622 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065543 Jul 30 21:07:55.546539 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 972/1879] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:55.568818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:55.580147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:55.583207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:55.592027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-229dfa39-d837-45a4-b027-b14700aa9498 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1473 microversion: 2.1 time: 0.502526 Jul 30 21:07:55.599665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 908/1880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:55 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1473 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:55.602057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:55.603554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:55.608346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:55.609026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.101863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:56.102441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:56.123651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.124737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.125883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.126513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.159139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:56.168512 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1979bcba-a971-4dca-9a5d-cf45c7f628ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.598063 Jul 30 21:07:56.177132 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 973/1881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:55 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:56.311577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bd1eebeb-dba6-4dbb-89fa-0344ac95817b req-f827ccb1-e57a-4933-885a-625d52a4cfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7285cf80-45b6-4068-b7e7-92f13b546ce3", "name": "network-vif-deleted", "tag": "7a461caf-836e-40bc-ae3c-16d18ee3333d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:56.333653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bd1eebeb-dba6-4dbb-89fa-0344ac95817b req-f827ccb1-e57a-4933-885a-625d52a4cfbc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.334426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bd1eebeb-dba6-4dbb-89fa-0344ac95817b req-f827ccb1-e57a-4933-885a-625d52a4cfbc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.360369 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bd1eebeb-dba6-4dbb-89fa-0344ac95817b req-f827ccb1-e57a-4933-885a-625d52a4cfbc service nova] Creating event network-vif-deleted:7a461caf-836e-40bc-ae3c-16d18ee3333d for instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 on nch1-master-1 Jul 30 21:07:56.370177 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bd1eebeb-dba6-4dbb-89fa-0344ac95817b req-f827ccb1-e57a-4933-885a-625d52a4cfbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062210 Jul 30 21:07:56.370802 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 974/1882] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:07:56.378462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:56.388484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:56.396438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.397187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.398189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.399915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.704559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:56.730806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85da9da0-9f7a-419a-8f38-1cb6c246dec2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1318 microversion: 2.1 time: 0.358630 Jul 30 21:07:56.734812 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 975/1883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:56 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:56.756641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:56.757721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:56.777065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.777819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.778704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.779229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.814128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:56.858187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:56.865772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:56.867222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lazy-loading 'fault' on Instance uuid 7285cf80-45b6-4068-b7e7-92f13b546ce3 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:07:56.946769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:56.958341 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4ece1e3-0eaa-463f-8c93-6f540cf23310 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 200 len: 1307 microversion: 2.1 time: 0.222234 Jul 30 21:07:56.959531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 976/1884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:56 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:57.120386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:57.140659 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fdcc2ef5-599a-430a-860c-8bc2b6c79678 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 1.042553 Jul 30 21:07:57.151427 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 909/1885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:56 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:07:57.206710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:57.207870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:57.220745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:57.239615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:57.250146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:57.250985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:57.468662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:57.481945 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06e9b0e1-f87d-406d-8474-cfa2125bceb8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.280378 Jul 30 21:07:57.484322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 977/1886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:57 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:57.543281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-589a7d8a-0b9f-43c9-8e92-4f05aec90b49 req-058f83d1-83ea-4a51-b50b-2660eb1c2f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561203ad-288a-4c80-89db-2ce51050e79a", "tag": "7ff07390-6321-4183-b433-44a7d336f921"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:57.564704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-589a7d8a-0b9f-43c9-8e92-4f05aec90b49 req-058f83d1-83ea-4a51-b50b-2660eb1c2f3b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:57.568670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-589a7d8a-0b9f-43c9-8e92-4f05aec90b49 req-058f83d1-83ea-4a51-b50b-2660eb1c2f3b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:57.594991 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-589a7d8a-0b9f-43c9-8e92-4f05aec90b49 req-058f83d1-83ea-4a51-b50b-2660eb1c2f3b service nova] Creating event network-changed:7ff07390-6321-4183-b433-44a7d336f921 for instance 561203ad-288a-4c80-89db-2ce51050e79a on nch2-master-1 Jul 30 21:07:57.606896 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-589a7d8a-0b9f-43c9-8e92-4f05aec90b49 req-058f83d1-83ea-4a51-b50b-2660eb1c2f3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069898 Jul 30 21:07:57.608357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 910/1887] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:07:57.762936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:57.763807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:57.771237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:57.771937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:57.773924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:57.775676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:57.997860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:58.010667 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b96f3343-6fe1-4690-acbf-c607a9e81259 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1509 microversion: 2.1 time: 0.259425 Jul 30 21:07:58.010963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.011767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7285cf80-45b6-4068-b7e7-92f13b546ce3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.022037 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 978/1888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:57 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:58.031013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.033713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.038472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.038472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.064802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.065620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.067523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.069372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.071711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.081694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.093321 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 HTTP/1.1 Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:07:58.095007 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. Jul 30 21:07:58.096648 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7285cf80-45b6-4068-b7e7-92f13b546ce3'} Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:07:58.097534 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. Jul 30 21:07:58.100617 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:07:58.103970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 7285cf80-45b6-4068-b7e7-92f13b546ce3 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:07:58.103970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e6c17f39-c428-457c-bf08-8c3f1c8478a6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3" status: 404 len: 111 microversion: 2.1 time: 0.119796 Jul 30 21:07:58.103970 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 911/1889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:57 2022] GET /compute/v2.1/servers/7285cf80-45b6-4068-b7e7-92f13b546ce3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:07:58.106351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.106938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.155742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.157604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.159955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.161169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.198695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:58.296857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:58.308907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0d11587-02fe-4a85-a0f8-4f3fd702aec1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1509 microversion: 2.1 time: 0.279490 Jul 30 21:07:58.330805 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 979/1890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:58 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:58.341687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.356789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.367586 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb0a0096-0e16-4915-96f7-71a44e1b077f tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 204 len: 0 microversion: 2.1 time: 0.264396 Jul 30 21:07:58.370203 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 912/1891] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:58 2022] DELETE /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:58.380815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.381919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.385956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.387259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:07:58.387645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.394713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.412225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.413139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.414133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.414885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.536405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:07:58.537340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:07:58.539048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:07:58.540078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:07:58.542138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:07:58.648150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.663687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.666493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.667503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.668937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.716502 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30fdaef6-883a-4667-b8b4-9798c2b5d100 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "POST /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649/action" status: 202 len: 1111 microversion: 2.1 time: 0.343685 Jul 30 21:07:58.717529 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 913/1892] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:07:58 2022] POST /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649/action => generated 1111 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 30 21:07:58.723735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.724717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.733688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.734859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.736776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.737443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.744603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:58.757891 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d116791-b2e2-4a1a-a99d-47401d1dbf03 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.423798 Jul 30 21:07:58.759815 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 980/1893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:58 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:58.773881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:58.776030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:58.793019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.793856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.794990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:58.797657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:58.855092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:07:59.033541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15884adc-b3b8-4866-a438-808f3bfdd59c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 204 len: 0 microversion: 2.1 time: 0.314420 Jul 30 21:07:59.037675 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 914/1894] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:07:58 2022] DELETE /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:07:59.044144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:59.044868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:59.057439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.057691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:59.058513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.059042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:59.103496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:59.201431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:59.212049 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20a1c26e-18b1-4a64-99b4-99b8cb902331 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.450732 Jul 30 21:07:59.231419 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 981/1895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:58 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:59.236568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:59.237526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:59.245006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.245797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:59.246805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.247451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:59.414008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:59.431131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e06c0f78-7e5a-4538-82c2-2e2c51c08a1f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.391520 Jul 30 21:07:59.436120 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 915/1896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:59 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:59.481645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:07:59.490689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0d6c7c7-ba42-457a-982e-cb082387951c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 200 len: 1474 microversion: 2.1 time: 0.257883 Jul 30 21:07:59.491673 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 982/1897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:59 2022] GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:07:59.784731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:07:59.785537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:07:59.793149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.793618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:07:59.794419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:07:59.794940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.271089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:00.287774 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ca21724-c8f1-40e5-864d-09f4b31031cb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.507754 Jul 30 21:08:00.290965 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 916/1898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:07:59 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:00.304099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:00.309342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:00.315939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.317895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.323127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.323854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.352713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7c0532e-bb54-4ab9-92ef-03280de0f703 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb628e7af0>, body: {"keypair": {"name": "tempest-keypair-1201494170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlTD3yDg4iOf/03+GXbf6k/2JiKrH+/japdUTLFcb+pd9tQlKmddiMPXeroY6fIlvTUDlctEeFUWyk+/YbalTu2E7USNc8h7jrv0dDr8pD3jgysCddTo5aVJnANQEfIBQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:00.407328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=7 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:00.409004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f7c0532e-bb54-4ab9-92ef-03280de0f703 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:00.439424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f7c0532e-bb54-4ab9-92ef-03280de0f703 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:00.495058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7c0532e-bb54-4ab9-92ef-03280de0f703 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.571620 Jul 30 21:08:00.496033 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 983/1899] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:07:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 573 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 30 21:08:00.501305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:00.501942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:00.523481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.523951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.524994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.525645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.641085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:00.651158 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-40ad57c2-632f-4811-90bd-f62cf381d4a7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.359005 Jul 30 21:08:00.651941 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 917/1900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:00 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:00.673753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-897f5e9e-4d41-4f88-ac14-05ba4b2d133f tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb62994280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:00.704308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-897f5e9e-4d41-4f88-ac14-05ba4b2d133f tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1201494170" status: 200 len: 513 microversion: 2.2 time: 0.048643 Jul 30 21:08:00.706237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 918/1901] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 30 21:08:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1201494170 => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:00.719518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:00.720438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:00.733120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.733731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.735361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:00.736140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:00.952441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:00.963272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0e109f0-432f-4a12-8d2a-701c2d1e764a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.466121 Jul 30 21:08:00.964870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:00.965487 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 984/1902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:00 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:00.970252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb5a2c29-5b5a-473e-a133-7903b099239b tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb628eb3a0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:00.984064 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3311d3c5-d85f-4b7d-bd56-9fcdeacd5373 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 200 len: 1474 microversion: 2.1 time: 0.275360 Jul 30 21:08:00.985381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 919/1903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:00 2022] GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:01.033671 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb5a2c29-5b5a-473e-a133-7903b099239b tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201494170" status: 204 len: 0 microversion: 2.2 time: 0.066424 Jul 30 21:08:01.035001 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 985/1904] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 30 21:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201494170 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:01.050520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf3bf261-4275-475f-bf3b-bbb94d74f8e2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb62986040>, body: {"keypair": {"name": "tempest-keypair-1015262121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkWugCJPLspl6C8siIVv0/9S41M1ySDNKoUbT8orCTDxxmXDOeHHO/2rTXTFdBf7K0xqrrYnSqlE5ulv7F8F6DxSLCjusBbu4k2mPfnZ5kM2O4XzzKTjABO7p41TJLv5w=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:01.083142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=56,nova_cell0:UPDATE=7 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:01.093448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cf3bf261-4275-475f-bf3b-bbb94d74f8e2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:01.114689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cf3bf261-4275-475f-bf3b-bbb94d74f8e2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:01.183173 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf3bf261-4275-475f-bf3b-bbb94d74f8e2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.139078 Jul 30 21:08:01.190516 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 920/1905] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:08:01.195837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7aa0baa7-885d-4794-9077-81d296f4cdad tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb628d0c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:01.233434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7aa0baa7-885d-4794-9077-81d296f4cdad tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015262121" status: 204 len: 0 microversion: 2.2 time: 0.042532 Jul 30 21:08:01.250707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b533918-82bc-4840-82db-214ff3667b7e tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb629dcf70>, body: {"keypair": {"name": "tempest-keypair-1845632747", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:01.258604 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 986/1906] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 30 21:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015262121 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:01.312013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:01.313136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:01.316523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8b533918-82bc-4840-82db-214ff3667b7e tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:01.333411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8b533918-82bc-4840-82db-214ff3667b7e tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:01.339990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:01.340665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:01.342547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:01.344014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:01.401120 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b533918-82bc-4840-82db-214ff3667b7e tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.155247 Jul 30 21:08:01.402422 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 921/1907] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:01 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:08:01.413716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3bae82c-bcb4-4435-a7b2-0ffa57c6d44b tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb62945430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:01.439994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:01.455213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3bae82c-bcb4-4435-a7b2-0ffa57c6d44b tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845632747" status: 204 len: 0 microversion: 2.2 time: 0.046091 Jul 30 21:08:01.461337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 922/1908] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 30 21:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845632747 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:08:01.476167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca1ca9d-f7e0-447c-97eb-0ff78a0b3fee tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb62994ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2145125969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lEHYKMViB5fVXdsX05cytmcq7zWDOQJzCkxFsaL9GYMF0DuMGNYlimKpp9/A0MDMCn32lcSwNlI5M46S39O8zWMrILl4EVbKa7IYwGnif1zevqryazr6aK08lRbo3SA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:01.498427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8ca1ca9d-f7e0-447c-97eb-0ff78a0b3fee tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:01.512249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8ca1ca9d-f7e0-447c-97eb-0ff78a0b3fee tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:01.554050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ca1ca9d-f7e0-447c-97eb-0ff78a0b3fee tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.084124 Jul 30 21:08:01.557781 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 923/1909] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 30 21:08:01.857162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: .version_select at 0x7fbb5d100310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-334341293", "policies": ["affinity"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:01.960477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:01.988725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:02.094353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:02.100145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:02.114618 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2477311-8a0e-4409-b9be-46ed819f495a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.555409 Jul 30 21:08:02.123189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 924/1910] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Jul 30 21:08:01 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:02.130025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e60587f-af17-4299-bfcb-98ba15821182 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb62a91160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-386612724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhpVwqT26IY3w3mfxis1Ar3KfN8z2w9dbSuQw27l1Tv4YaShnJ58LKHE/FPiuOyJir6pmOCvvr6TNoJc4x1a2ryK8DW847q7XksVHb+TlVEBFTLgrKSFacpi0cQGkuCVA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:02.208351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4e60587f-af17-4299-bfcb-98ba15821182 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:02.233441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:02.234105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4e60587f-af17-4299-bfcb-98ba15821182 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:02.277750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:02.289202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96efbc7c-1953-4ac0-9def-11bb60f6c6e3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.981746 Jul 30 21:08:02.308637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e60587f-af17-4299-bfcb-98ba15821182 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.191172 Jul 30 21:08:02.310534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 925/1911] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:08:02.316138 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 987/1912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:01 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:02.323209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:02.324172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:02.336014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.336485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.337325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.337779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.341673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:02.345709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:02.357978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.359148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.359836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.360631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.719988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:02.729956 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e2c3fdc-21af-42d8-9ca9-ab8a4f79c664 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.412549 Jul 30 21:08:02.731375 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 988/1913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:02 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:02.736693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4170fc4d-db7f-4bc5-9b27-437e11f16699 req-7566b91b-05a6-4464-8998-aecffcf15668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef", "name": "network-vif-deleted", "tag": "df19c8c3-fc29-439b-85fd-bfa6dd84b0df"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:02.749087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4170fc4d-db7f-4bc5-9b27-437e11f16699 req-7566b91b-05a6-4464-8998-aecffcf15668 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.749839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4170fc4d-db7f-4bc5-9b27-437e11f16699 req-7566b91b-05a6-4464-8998-aecffcf15668 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.762788 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4170fc4d-db7f-4bc5-9b27-437e11f16699 req-7566b91b-05a6-4464-8998-aecffcf15668 service nova] Creating event network-vif-deleted:df19c8c3-fc29-439b-85fd-bfa6dd84b0df for instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef on nch1-master-1 Jul 30 21:08:02.769263 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4170fc4d-db7f-4bc5-9b27-437e11f16699 req-7566b91b-05a6-4464-8998-aecffcf15668 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Jul 30 21:08:02.770507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 989/1914] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:02.778787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:02.779757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:02.786266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:02.795510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-130a0089-a15c-4732-b59f-b0ff45bc8aea tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.483571 Jul 30 21:08:02.799323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.800505 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 926/1915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:02 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:02.805913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.807590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:02.808324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:02.812835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: .version_select at 0x7fbb629450d0>, body: {"server_group": {"name": "tempest-server-group-577842359", "policies": ["affinity"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:02.844307 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef HTTP/1.1 Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:02.851887 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. Jul 30 21:08:02.854473 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd979b26b-3d99-4bb4-b59d-3c94ff6bc1ef'} Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:02.855477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. Jul 30 21:08:02.857985 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:02.860417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:02.861485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b5fa49f-aca3-4ab8-9885-017a27363dd7 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef" status: 404 len: 111 microversion: 2.1 time: 0.089628 Jul 30 21:08:02.863110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 990/1916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:02 2022] GET /compute/v2.1/servers/d979b26b-3d99-4bb4-b59d-3c94ff6bc1ef => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:02.868353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:02.874565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f8cde20-d65e-466f-b29a-b819a7f02254 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb628e7040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-240339949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB09UKs3J1uqsgkak7JaK5/rjx36lKLPX3gT/W1v17bF9IjsbhUkovTHmDMl/G79nxYSkBg1yuqzM7L8M3+x+pq7/MLlYBPofeRSvqpqk9O6JVnqposuL/oaHvRUUSso8A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:02.878188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:02.902087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7f8cde20-d65e-466f-b29a-b819a7f02254 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:02.916122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7f8cde20-d65e-466f-b29a-b819a7f02254 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:02.966018 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f8cde20-d65e-466f-b29a-b819a7f02254 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.101608 Jul 30 21:08:02.967096 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 991/1917] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:08:02.976434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:02.986515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:03.027702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b22b50ec-5b91-4e49-a890-ca9ab45f8d78 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.225872 Jul 30 21:08:03.035379 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 927/1918] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:08:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.040004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.041093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:03.051404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.056723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.059320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.064949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.194971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:03.216817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c532005-6d03-4d6b-b2dc-5053ece2800e tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 200 len: 1431 microversion: 2.1 time: 0.181126 Jul 30 21:08:03.242445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 928/1919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 1431 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:03.257183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c09116c-7326-47ac-937c-8ddb94f6bdc8 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb6292a940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.262643 ncdv-master-1 devstack@n-api.service[130983]: WARNING oslo_db.sqlalchemy.utils [None req-9c09116c-7326-47ac-937c-8ddb94f6bdc8 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:08:03.270153 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c09116c-7326-47ac-937c-8ddb94f6bdc8 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.025057 Jul 30 21:08:03.270876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 929/1920] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:03.277748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: .version_select at 0x7fbb5d719d30>, body: {"server_group": {"name": "tempest-server-group-577842359", "policies": ["affinity"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:03.299806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:03.308704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:03.316566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.321711 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:03.321711 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:08:03.323308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.323911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.324851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.325410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.333617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:03.366312 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c06c498-33db-4d28-a53a-95d105a81434 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.398010 Jul 30 21:08:03.375222 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 992/1921] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:08:02 2022] GET /compute/v2.1/os-services => generated 947 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.381578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:03.382008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bea01c24-533f-4564-8774-b3a99d7d42e5 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb5d3fd1f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.389833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:03.408126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bea01c24-533f-4564-8774-b3a99d7d42e5 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-240339949" status: 204 len: 0 microversion: 2.2 time: 0.031094 Jul 30 21:08:03.408873 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 993/1922] 10.222.0.17 () {60 vars in 1318 bytes} [Sat Jul 30 21:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-240339949 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:03.413803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.419765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:03.424054 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98e8f738-b264-48bd-8778-cad9d8bb1524 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.152069 Jul 30 21:08:03.425249 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 930/1923] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:08:03 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.430251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.431585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.435362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5db1fdb2-bfd0-440f-b653-636a0d0f26ba req-0cd36bd3-3801-4d9c-99ed-19a8442174d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c19afe9-9429-4bf5-8aa6-fe6975c184ec", "name": "network-vif-deleted", "tag": "f5923a26-4789-4405-a2a2-faffb61f9b0d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:03.436518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.439943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.450531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5db1fdb2-bfd0-440f-b653-636a0d0f26ba req-0cd36bd3-3801-4d9c-99ed-19a8442174d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.452181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5db1fdb2-bfd0-440f-b653-636a0d0f26ba req-0cd36bd3-3801-4d9c-99ed-19a8442174d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.466221 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5db1fdb2-bfd0-440f-b653-636a0d0f26ba req-0cd36bd3-3801-4d9c-99ed-19a8442174d1 service nova] Creating event network-vif-deleted:f5923a26-4789-4405-a2a2-faffb61f9b0d for instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec on nch2-master-1 Jul 30 21:08:03.471709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5db1fdb2-bfd0-440f-b653-636a0d0f26ba req-0cd36bd3-3801-4d9c-99ed-19a8442174d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044934 Jul 30 21:08:03.472912 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 931/1924] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.478168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.481046 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:03.481046 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:08:03.482668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.483477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.484538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.485223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.514177 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63407c16-3364-498f-ad57-fda407c95ec1 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039810 Jul 30 21:08:03.522678 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 932/1925] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.527046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e959c5dd-8b62-448c-9821-d58c453679c9 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb62986040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.551216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e959c5dd-8b62-448c-9821-d58c453679c9 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-386612724" status: 204 len: 0 microversion: 2.2 time: 0.030387 Jul 30 21:08:03.556646 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 933/1926] 10.222.0.17 () {60 vars in 1318 bytes} [Sat Jul 30 21:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-386612724 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:03.569563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37ef15e7-1610-41f6-acc2-5439bc3dfd4d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.610108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37ef15e7-1610-41f6-acc2-5439bc3dfd4d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/f10e771e-7c71-4e33-bfd9-633160804a9e" status: 204 len: 0 microversion: 2.1 time: 0.051946 Jul 30 21:08:03.615178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 934/1927] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:03 2022] DELETE /compute/v2.1/os-server-groups/f10e771e-7c71-4e33-bfd9-633160804a9e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:03.624290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.627734 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:03.627734 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:08:03.629492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.630153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.631244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.631918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.636196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:03.645906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e36c65e6-5717-4c3a-970c-728cea3d4672 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.235574 Jul 30 21:08:03.647066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 994/1928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:03.653200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c325fe4f-a8ee-4c52-9f50-d5340b8db222 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb6291fb80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.676410 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fee8e5c-a0b0-489c-9bef-88e705ea9c67 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.059581 Jul 30 21:08:03.676996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c325fe4f-a8ee-4c52-9f50-d5340b8db222 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2145125969" status: 204 len: 0 microversion: 2.2 time: 0.028270 Jul 30 21:08:03.677759 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 995/1929] 10.222.0.17 () {60 vars in 1321 bytes} [Sat Jul 30 21:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2145125969 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:03.685711 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 935/1930] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-services => generated 947 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.689738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6f63456-0d0d-4ac6-ad50-8a0e3a88d721 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.690848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.694288 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:03.694288 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:08:03.697198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.697859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.698886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.700124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.714634 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6f63456-0d0d-4ac6-ad50-8a0e3a88d721 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.034872 Jul 30 21:08:03.715483 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 996/1931] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.722410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71079e04-f132-4796-9ed3-f80c94f0336c tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb628e7160>, body: {"keypair": {"name": "tempest-keypair-1918077196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbaAIQfRnfxOP3CyqsygJEw6NUtiotRF8eogb9FohWZJB5r+fS9aPwSGTStAIkQFMqg0214N2F18B97Y4+lV1WV7+pges+HV1GpaOZkC1ntkJycairmnqeC3p3jarBewg=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:03.746433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f117b03-b9ae-4615-b05d-781d1e5e7df8 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.059178 Jul 30 21:08:03.754907 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 936/1932] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:08:03.760890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70010701-3a14-404f-9066-e2d48c188f73 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.763938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-71079e04-f132-4796-9ed3-f80c94f0336c tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:03.779502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-71079e04-f132-4796-9ed3-f80c94f0336c tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:03.795637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70010701-3a14-404f-9066-e2d48c188f73 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/7b47f27d-460d-4f60-9866-c40c4db62fed" status: 204 len: 0 microversion: 2.1 time: 0.039221 Jul 30 21:08:03.796313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 937/1933] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:03 2022] DELETE /compute/v2.1/os-server-groups/7b47f27d-460d-4f60-9866-c40c4db62fed => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:03.806766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.807581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:03.817109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.817109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.817394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.817807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.843260 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71079e04-f132-4796-9ed3-f80c94f0336c tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.126606 Jul 30 21:08:03.844524 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 997/1934] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 30 21:08:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:08:03.851787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.857319 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:03.857319 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:08:03.861553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.865198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.866243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:03.870400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:03.913408 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4bcb1887-a59f-47af-9e3d-b6e498bc96a2 tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.067694 Jul 30 21:08:03.914287 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 998/1935] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-services => generated 947 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.949467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d12bbd4f-674e-4528-8514-74463afc160d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.959140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:03.971878 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d12bbd4f-674e-4528-8514-74463afc160d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.047659 Jul 30 21:08:03.980934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 999/1936] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:03.987712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:03.988752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:04.002370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.003046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.009919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.009919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.163188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:04.172719 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-36e62afc-4fbb-4635-9a67-f20079082f19 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.190266 Jul 30 21:08:04.174011 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1000/1937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:04.178864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:04.190737 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ba35e6b-f51a-487c-ae74-1030a169ab05 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.389465 Jul 30 21:08:04.193655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-838641e9-8f79-4dc8-8c31-4c6492ad1cb2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb628d9310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.194485 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 938/1938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:03 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:04.202690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.205276 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:04.205276 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:08:04.205552 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-838641e9-8f79-4dc8-8c31-4c6492ad1cb2 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1918077196" status: 200 len: 513 microversion: 2.2 time: 0.030032 Jul 30 21:08:04.206278 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1001/1939] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1918077196 => generated 513 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:04.206520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.206996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.208366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.212092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: .version_select at 0x7fbb62919670>, body: {"server_group": {"name": "tempest-server-group-553383444", "policies": ["affinity"]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:04.225572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.230623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:04.243134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:04.259757 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ba38588-90ed-4376-a34f-2144f06980dc tempest-ServicesAdminNegativeTestJSON-1360144096 tempest-ServicesAdminNegativeTestJSON-1360144096-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.063865 Jul 30 21:08:04.268907 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 939/1940] 10.222.0.17 () {58 vars in 1198 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:08:04.273931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-89034655-26ef-42ac-a059-9256f96fbacc tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb5d1001f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.278513 ncdv-master-1 devstack@n-api.service[130983]: WARNING oslo_db.sqlalchemy.utils [None req-89034655-26ef-42ac-a059-9256f96fbacc tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:08:04.284002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-89034655-26ef-42ac-a059-9256f96fbacc tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013916 Jul 30 21:08:04.296255 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 940/1941] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:04.307656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.308311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 6c19afe9-9429-4bf5-8aa6-fe6975c184ec] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:04.316735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.317197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.318087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.318594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.326413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:04.332139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:04.340514 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec HTTP/1.1 Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:04.344018 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. Jul 30 21:08:04.345709 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6c19afe9-9429-4bf5-8aa6-fe6975c184ec'} Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:04.346564 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. Jul 30 21:08:04.349218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.351727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 6c19afe9-9429-4bf5-8aa6-fe6975c184ec could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:04.351876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba4191e2-61b2-4bf6-9d61-5ac45378f538 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.142969 Jul 30 21:08:04.351876 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1002/1942] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:08:04 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:04.353027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fdd75213-718f-4f8d-b288-53803e621a82 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec" status: 404 len: 111 microversion: 2.1 time: 0.054909 Jul 30 21:08:04.356776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 941/1943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/servers/6c19afe9-9429-4bf5-8aa6-fe6975c184ec => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:04.362153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5126afc-0c08-456e-b739-66fc10fe9957 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb5d100820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.384138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5126afc-0c08-456e-b739-66fc10fe9957 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918077196" status: 204 len: 0 microversion: 2.2 time: 0.025599 Jul 30 21:08:04.387527 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 942/1944] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 30 21:08:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918077196 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:04.395238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8fcf1ded-2c67-4775-822c-6bf3991c1be8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.447915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8fcf1ded-2c67-4775-822c-6bf3991c1be8 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/0bbfb402-6390-47ca-a78d-fbea5b1ba88a" status: 204 len: 0 microversion: 2.1 time: 0.058938 Jul 30 21:08:04.448928 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 943/1945] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:04 2022] DELETE /compute/v2.1/os-server-groups/0bbfb402-6390-47ca-a78d-fbea5b1ba88a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:04.458804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc08e36f-420a-4f8f-804f-81607fbd110b tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.499370 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc08e36f-420a-4f8f-804f-81607fbd110b tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/2cf78093-e38a-454d-8bac-791b0dc2bfa8" status: 204 len: 0 microversion: 2.1 time: 0.045104 Jul 30 21:08:04.500404 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 944/1946] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:04 2022] DELETE /compute/v2.1/os-server-groups/2cf78093-e38a-454d-8bac-791b0dc2bfa8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:04.511721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9cdd5b93-21f3-44b6-b553-ec6993adcbec tempest-ServicesAdminNegativeTestJSON-1957104652 tempest-ServicesAdminNegativeTestJSON-1957104652-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.512009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Action: 'create', calling method: .version_select at 0x7fbb62a26dc0>, body: {"keypair": {"name": "tempest-keypair-2127635783", "type": "x509"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:04.514835 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:08:04.514835 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:08:04.516949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9cdd5b93-21f3-44b6-b553-ec6993adcbec tempest-ServicesAdminNegativeTestJSON-1957104652 tempest-ServicesAdminNegativeTestJSON-1957104652-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ff63f203723043ee8acaae1b08d0e32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76392eb8a3a4a95a0d9c4d356802ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9cdd5b93-21f3-44b6-b553-ec6993adcbec tempest-ServicesAdminNegativeTestJSON-1957104652 tempest-ServicesAdminNegativeTestJSON-1957104652-project] Request method failure captured: Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2w2HsN0vVsdJcCrWcadMbGL1aE60N8H0uNOKkiqi5TTHP3GaXte6zLHrA_W-3VgSX9Jc_sbDyRjqLCjVW1VpHgkjhaDC3dUClS7mEndtiOOWdq9bj8qbg-mDFc9w-QFoIAXM_Jz3lflbyYw5Sue4-BObTDiK195VkqCog5umb8Ozk Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d76392eb8a3a4a95a0d9c4d356802ddf Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1957104652 Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:04.519615 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d76392eb8a3a4a95a0d9c4d356802ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d76392eb8a3a4a95a0d9c4d356802ddf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d76392eb8a3a4a95a0d9c4d356802ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d76392eb8a3a4a95a0d9c4d356802ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1957104652 Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d76392eb8a3a4a95a0d9c4d356802ddf Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1957104652 Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServicesAdminNegativeTestJSON-1957104652-project Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: ff63f203723043ee8acaae1b08d0e32b Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1957104652-project Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:08:04.521449 ncdv-master-1 devstack@n-api.service[130984]: action_args: {} Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 30 21:08:04.522520 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 30 21:08:04.524108 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:04.526745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9cdd5b93-21f3-44b6-b553-ec6993adcbec tempest-ServicesAdminNegativeTestJSON-1957104652 tempest-ServicesAdminNegativeTestJSON-1957104652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:04.527764 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9cdd5b93-21f3-44b6-b553-ec6993adcbec tempest-ServicesAdminNegativeTestJSON-1957104652 tempest-ServicesAdminNegativeTestJSON-1957104652-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.170968 Jul 30 21:08:04.528836 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1003/1947] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:04.534497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.536113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:04.539568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:04.544313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.545048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.546256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.546940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.548641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:04.569262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.processutils [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1uwun7m9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1uwun7m9/temp.key -subj /CN=759702e0f5de493cb1aa8a79983d5599 -extensions v3_req_client {{(pid=130983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:08:04.576836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:04.688336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abe050ec-cf60-4bbb-a317-51a9e605695b tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 204 len: 0 microversion: 2.1 time: 0.157541 Jul 30 21:08:04.693302 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1004/1948] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:04 2022] DELETE /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:04.707637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-456f8c85-a437-4b3a-9f73-eeb4b3e79be7 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.728745 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-456f8c85-a437-4b3a-9f73-eeb4b3e79be7 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.033899 Jul 30 21:08:04.730609 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1005/1949] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:04.742634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:04.747268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:04.765999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.768336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:04.770352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:04.772730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.022632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.processutils [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1uwun7m9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1uwun7m9/temp.key -subj /CN=759702e0f5de493cb1aa8a79983d5599 -extensions v3_req_client" returned: 0 in 0.453s {{(pid=130983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:08:05.024853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.processutils [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1uwun7m9/temp.key -password pass: {{(pid=130983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:08:05.038131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:05.043401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:05.048242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82798f1c-0289-464f-a524-4253c80c0824 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.314999 Jul 30 21:08:05.050605 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1006/1950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:04 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:05.061771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.062663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:05.071601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.072505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.073894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.074582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.096747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.processutils [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1uwun7m9/temp.key -password pass:" returned: 0 in 0.071s {{(pid=130983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:08:05.104038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:05.167611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:05.176199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Getting quotas for user 759702e0f5de493cb1aa8a79983d5599 and project 41d28fba915445daa4e83bf039331e48. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:05.209656 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff2f4cb8-e6ae-4c83-af6b-ba536daa2d61 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.707500 Jul 30 21:08:05.219507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 945/1951] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 30 21:08:04 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 718 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:05.229346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: .version_select at 0x7fbb5d100820>, body: {"server_group": {"name": "tempest-server-group-465770156", "policies": ["anti-affinity"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:05.245095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=14,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:05.247855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c569acc-1fb2-4244-be7e-e601685ed9d6 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 204 len: 0 microversion: 2.1 time: 0.195244 Jul 30 21:08:05.253861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1007/1952] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:05 2022] DELETE /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:05.264465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:05.266686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.268205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:05.273979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:05.288452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.290625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.296143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.296973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.346198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:05.355513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_groups'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:05.382399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1be0bf54-8daa-4281-9d99-e18ac541a3bc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.159384 Jul 30 21:08:05.383419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 946/1953] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:08:05 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:05.392591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.393511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:05.402171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.402985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.404026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.404680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.631603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:05.646961 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76ced192-7460-4b0c-98b7-363478fa6975 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.391309 Jul 30 21:08:05.648305 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1008/1954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:05.658380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf86fa6e-9970-4c53-93a4-968a295bd4cb tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb628d0550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.672088 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf86fa6e-9970-4c53-93a4-968a295bd4cb tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-2127635783" status: 200 len: 1534 microversion: 2.2 time: 0.020360 Jul 30 21:08:05.679130 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1009/1955] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2127635783 => generated 1534 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:05.680130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.681092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:05.691170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:05.709557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.710242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.712586 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f59237b3-8dc5-48f6-9050-e9bb7532560e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.324536 Jul 30 21:08:05.714913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:05.715857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 947/1956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:05.717361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:05.738897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e929b7cd-1126-4f80-aec5-e0fe528658ea tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.808435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e929b7cd-1126-4f80-aec5-e0fe528658ea tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/dac0a70f-e10f-4a45-9e40-a73d5c0ed460" status: 204 len: 0 microversion: 2.1 time: 0.089960 Jul 30 21:08:05.810281 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 948/1957] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:05 2022] DELETE /compute/v2.1/os-server-groups/dac0a70f-e10f-4a45-9e40-a73d5c0ed460 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:05.818978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c85c4621-c8f6-461c-8d62-dc2d38ebefa9 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb62a26c10>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.823335 ncdv-master-1 devstack@n-api.service[130983]: WARNING oslo_db.sqlalchemy.utils [None req-c85c4621-c8f6-461c-8d62-dc2d38ebefa9 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:08:05.829966 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c85c4621-c8f6-461c-8d62-dc2d38ebefa9 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015688 Jul 30 21:08:05.831011 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 949/1958] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:05.835716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81086316-ae42-4f62-b1a1-75ae315a1134 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.868187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81086316-ae42-4f62-b1a1-75ae315a1134 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035993 Jul 30 21:08:05.868785 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 950/1959] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:05.880896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d5ee810-9ad5-4e08-b3b4-2a5f9b686a78 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] Calling method '.version_select at 0x7fbb62a269d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:05.929902 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d5ee810-9ad5-4e08-b3b4-2a5f9b686a78 tempest-KeyPairsV22TestJSON-2146293432 tempest-KeyPairsV22TestJSON-2146293432-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127635783" status: 204 len: 0 microversion: 2.2 time: 0.056303 Jul 30 21:08:05.937195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 951/1960] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 30 21:08:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127635783 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:06.049806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-668146941", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "6a13a92f-86d8-4c2c-8c10-fe81e6d4d3e5"}]}, "os:scheduler_hints": {"group": "2e367f57-e0c8-4a18-9cd6-2ef96a1756b0"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:06.176717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] validate_networks() for [('6a13a92f-86d8-4c2c-8c10-fe81e6d4d3e5', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:06.194680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:06.233934 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b88b4493-ecc8-41e6-8e43-44c5279a3baa tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1473 microversion: 2.1 time: 0.555384 Jul 30 21:08:06.239173 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1010/1961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:05 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:06.266541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:06.270367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:06.292955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:06.293399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:06.294271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:06.294670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:07.351627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:07.366591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28b9cd67-603c-4b28-9471-51aca338a7c2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 1.124688 Jul 30 21:08:07.371384 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1011/1962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:06 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:07.382317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:07.384912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:07.397876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:07.401880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:07.406572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:07.407824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:07.584816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:07.586127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:07.587538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:07.588175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:07.588729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:07.624105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:07.624736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:07.625688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:07.627691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:07.675713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:07.683916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:07.724577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:07.727543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:07.860386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:07.881038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:07.960153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for project a502ca105b1344babf2e8d590de18198. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:07.975464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Getting quotas for user 8027664b7857430494e38fa27da60c75 and project a502ca105b1344babf2e8d590de18198. Resources: {'server_group_members'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:08.101131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b48cd0e4-d3e9-48a2-9d4d-45e199f52a0c tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048230 Jul 30 21:08:08.111728 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 952/1963] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:08.128079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:08.129595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:08.138357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:08.139706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:08.141016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:08.141906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:08.534877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:08.554006 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-04880dca-6eb7-48e4-856b-d1e2350e898f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 1.177932 Jul 30 21:08:08.554840 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1012/1964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:07 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:08.573368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-26d3d26c-e877-46a7-bea0-887cc3bcdcee req-591d3e7b-0771-4ef2-853a-ff2b9a782316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561203ad-288a-4c80-89db-2ce51050e79a", "name": "network-vif-plugged", "status": "completed", "tag": "7ff07390-6321-4183-b433-44a7d336f921"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:08.597996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-26d3d26c-e877-46a7-bea0-887cc3bcdcee req-591d3e7b-0771-4ef2-853a-ff2b9a782316 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:08.599112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-26d3d26c-e877-46a7-bea0-887cc3bcdcee req-591d3e7b-0771-4ef2-853a-ff2b9a782316 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:08.625055 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-26d3d26c-e877-46a7-bea0-887cc3bcdcee req-591d3e7b-0771-4ef2-853a-ff2b9a782316 service nova] Creating event network-vif-plugged:7ff07390-6321-4183-b433-44a7d336f921 for instance 561203ad-288a-4c80-89db-2ce51050e79a on nch2-master-1 Jul 30 21:08:08.642698 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-26d3d26c-e877-46a7-bea0-887cc3bcdcee req-591d3e7b-0771-4ef2-853a-ff2b9a782316 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082046 Jul 30 21:08:08.644565 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1013/1965] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:08.659506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:08.660558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:08.694196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:08.694723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:08.699856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:08.700545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:08.758016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:08.769821 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7f31533-bafe-4d61-b1ea-9d657087fdfd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.656330 Jul 30 21:08:08.770930 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 953/1966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:08 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:08.776943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0fa4ea6a-8ee9-49e6-a449-5640192bae44 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:08.778352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0fa4ea6a-8ee9-49e6-a449-5640192bae44 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:08.977706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0fa4ea6a-8ee9-49e6-a449-5640192bae44 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:08.991127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0fa4ea6a-8ee9-49e6-a449-5640192bae44 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1212 microversion: 2.1 time: 0.217587 Jul 30 21:08:08.994968 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 954/1967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:08 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:09.006914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:09.009313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:09.026581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.027839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:09.028902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.031442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:09.329191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:09.344588 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ad13fbd-6312-46ef-a68b-d54f084b0a12 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1316 microversion: 2.1 time: 0.348236 Jul 30 21:08:09.365777 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 955/1968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:08 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:09.480739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:09.499507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5004ae40-5ba0-4d72-92da-2cc5948490e9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1473 microversion: 2.1 time: 0.853292 Jul 30 21:08:09.502278 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1014/1969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:08 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1473 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:09.579850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:09.580494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:09.589428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.594279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:09.595577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.596299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:09.785757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:09.795391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:09.797691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:09.810036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.811809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-44a9221e-d096-4147-8277-634ff562ec53 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.235966 Jul 30 21:08:09.814179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:09.815866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:09.816233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 956/1970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:09 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:09.818215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:10.027232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:10.028272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:10.041136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:10.041877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:10.042938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:10.068460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:10.414149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:10.432327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eba4b9c4-939a-4e0e-9102-f74f9a96f1e8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1264 microversion: 2.1 time: 0.416624 Jul 30 21:08:10.433741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 957/1971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:10 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1264 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:10.453932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:10.455337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:10.483678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:10.484145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:10.487271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:10.487767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.036864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:11.059339 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-365f4c68-d7c5-42b4-8fed-84d7c344354b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 1.267687 Jul 30 21:08:11.060285 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1015/1972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:09 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:08:11.066782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:11.088341 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39610498-c866-4c1a-9892-4cd9e17fabdb tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1504 microversion: 2.1 time: 0.653400 Jul 30 21:08:11.089040 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 958/1973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:10 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:11.121434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:11.122120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:11.142629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:11.152031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.154433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.156862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.157331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.379570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:11.392608 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb0c3ef4-7235-4de5-8124-b35f41017503 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 200 len: 1303 microversion: 2.1 time: 0.302422 Jul 30 21:08:11.396253 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 959/1974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:11 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 1303 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:11.403182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60f0009d-a9a8-4b9d-802e-ed491fb94f9e tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1708118780", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:11.405622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-192c7db7-91c2-46e1-8263-5c35d37568f3 req-8a929718-4864-4d19-9116-9c8dae764879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946868a8-2e74-4fe6-bb0d-94b638c3ebb2", "name": "network-vif-deleted", "tag": "1e9100f3-43be-47fe-8736-4a19079b8b5e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:11.406701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-60f0009d-a9a8-4b9d-802e-ed491fb94f9e tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] HTTP exception thrown: min_count must be <= max_count Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60f0009d-a9a8-4b9d-802e-ed491fb94f9e tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Request method failure captured: Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 184 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z26YiLWSf0lQOuPP5-JXpO5swgRg4IjOv8z74CTVrrXXFqpWMRAMcqzmGIx5Kd9cJs-ijV4t8LJurY6b7HbhtoTV8jfJrEpgTT6nQzy3TNarjwtOCPCYhAoH9qFSDizvwTmaTq9cV3W240S89BNPkkGH8PT_8ahH_SUaWvlHehRWRU Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:11.408305 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/104c18938daf48a585c72a3072616758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_104c18938daf48a585c72a3072616758", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 21aec407a6e04e4f8a0379061bab8a69 Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:08:11.409863 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1708118780", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: exception: min_count must be <= max_count Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1708118780', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:08:11.411081 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:11.412683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60f0009d-a9a8-4b9d-802e-ed491fb94f9e tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Returning 400 to user: min_count must be <= max_count {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:11.413643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60f0009d-a9a8-4b9d-802e-ed491fb94f9e tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.348272 Jul 30 21:08:11.414125 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1016/1975] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:11 2022] POST /compute/v2.1/servers => generated 74 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:08:11.428438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:11.431966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:11.450654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.452629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.454512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-192c7db7-91c2-46e1-8263-5c35d37568f3 req-8a929718-4864-4d19-9116-9c8dae764879 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.456944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.458022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.462844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-192c7db7-91c2-46e1-8263-5c35d37568f3 req-8a929718-4864-4d19-9116-9c8dae764879 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.503392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-192c7db7-91c2-46e1-8263-5c35d37568f3 req-8a929718-4864-4d19-9116-9c8dae764879 service nova] Creating event network-vif-deleted:1e9100f3-43be-47fe-8736-4a19079b8b5e for instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 on nch1-master-1 Jul 30 21:08:11.523252 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-192c7db7-91c2-46e1-8263-5c35d37568f3 req-8a929718-4864-4d19-9116-9c8dae764879 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121510 Jul 30 21:08:11.524173 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 960/1976] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:11.551915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2132436070"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:11.552666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:11.576604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.576604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.576604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.577241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.628913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:11.797123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:11.808511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-97d142b6-ea04-41a7-9792-12915748c66d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.389417 Jul 30 21:08:11.826301 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1017/1977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:11 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:11.837951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:11.839094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:11.847493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.848153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.849525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:11.850194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:11.972120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:11.984004 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8fc094ca-4abf-4c47-8a91-612055eabebb tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1270 microversion: 2.1 time: 0.155988 Jul 30 21:08:11.989282 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1018/1978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:11 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:12.003246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4260c3ca-a9a3-4c34-80bc-cde761611c7d tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-194944567", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "max_count": 0}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4260c3ca-a9a3-4c34-80bc-cde761611c7d tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Request method failure captured: Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 167 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z26YiLWSf0lQOuPP5-JXpO5swgRg4IjOv8z74CTVrrXXFqpWMRAMcqzmGIx5Kd9cJs-ijV4t8LJurY6b7HbhtoTV8jfJrEpgTT6nQzy3TNarjwtOCPCYhAoH9qFSDizvwTmaTq9cV3W240S89BNPkkGH8PT_8ahH_SUaWvlHehRWRU Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.013130 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/104c18938daf48a585c72a3072616758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_104c18938daf48a585c72a3072616758", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 21aec407a6e04e4f8a0379061bab8a69 Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-194944567", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "max_count": 0}} Jul 30 21:08:12.015126 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-194944567', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'max_count': 0}}} Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 0 Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.017066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.019308 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.020962 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:08:12.020962 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:08:12.020962 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.020962 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.021680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4260c3ca-a9a3-4c34-80bc-cde761611c7d tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.023359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4260c3ca-a9a3-4c34-80bc-cde761611c7d tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.032678 Jul 30 21:08:12.025078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1019/1979] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:08:12.084168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73eb4d45-cf38-420d-a191-5f7f11cfbc08 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1572231672", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "max_count": 2.5}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73eb4d45-cf38-420d-a191-5f7f11cfbc08 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Request method failure captured: Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 170 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z26YiLWSf0lQOuPP5-JXpO5swgRg4IjOv8z74CTVrrXXFqpWMRAMcqzmGIx5Kd9cJs-ijV4t8LJurY6b7HbhtoTV8jfJrEpgTT6nQzy3TNarjwtOCPCYhAoH9qFSDizvwTmaTq9cV3W240S89BNPkkGH8PT_8ahH_SUaWvlHehRWRU Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.091013 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/104c18938daf48a585c72a3072616758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_104c18938daf48a585c72a3072616758", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 21aec407a6e04e4f8a0379061bab8a69 Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1572231672", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "max_count": 2.5}} Jul 30 21:08:12.092810 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1572231672', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'max_count': 2.5}}} Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 2.5 Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.093815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.095666 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.097266 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:08:12.097266 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:08:12.097266 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.097266 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.108552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73eb4d45-cf38-420d-a191-5f7f11cfbc08 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.108552 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73eb4d45-cf38-420d-a191-5f7f11cfbc08 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022331 Jul 30 21:08:12.109265 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1020/1980] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:08:12.117519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:12.118422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:12.129730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.130347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.135178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.140271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.169178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Adding security group a81851b1-f980-4ca6-bf9b-089f7745d70d to port 7ff07390-6321-4183-b433-44a7d336f921 Jul 30 21:08:12.653868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:12.663816 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c1a7ae6-e51a-4fbb-ae1c-b353d870fca9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.552398 Jul 30 21:08:12.675454 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1021/1981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:12 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:12.680608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-522f5b76-5f88-4902-b771-35f3edc6d4e6 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1131821738", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 0}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-522f5b76-5f88-4902-b771-35f3edc6d4e6 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Request method failure captured: Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 168 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z26YiLWSf0lQOuPP5-JXpO5swgRg4IjOv8z74CTVrrXXFqpWMRAMcqzmGIx5Kd9cJs-ijV4t8LJurY6b7HbhtoTV8jfJrEpgTT6nQzy3TNarjwtOCPCYhAoH9qFSDizvwTmaTq9cV3W240S89BNPkkGH8PT_8ahH_SUaWvlHehRWRU Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.685416 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/104c18938daf48a585c72a3072616758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_104c18938daf48a585c72a3072616758", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 21aec407a6e04e4f8a0379061bab8a69 Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1131821738", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 0}} Jul 30 21:08:12.687659 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1131821738', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'min_count': 0}}} Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 0 Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.688778 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.690655 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.692385 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:08:12.692385 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:08:12.692385 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 30 21:08:12.692385 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.693527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-522f5b76-5f88-4902-b771-35f3edc6d4e6 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.694560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-522f5b76-5f88-4902-b771-35f3edc6d4e6 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017956 Jul 30 21:08:12.695316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1022/1982] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:12 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:08:12.707997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:12.708801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 74aa1223-14ce-4f65-a00a-032dcb87adb7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:12.717159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.717925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.719029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.719729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.739096 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 HTTP/1.1 Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.742683 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. Jul 30 21:08:12.744578 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '74aa1223-14ce-4f65-a00a-032dcb87adb7'} Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.745603 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. Jul 30 21:08:12.747262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.749096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.749880 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e565382c-d1e6-4882-9a00-d6e32c462bc5 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7" status: 404 len: 111 microversion: 2.1 time: 0.052819 Jul 30 21:08:12.753848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1023/1983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:12 2022] GET /compute/v2.1/servers/74aa1223-14ce-4f65-a00a-032dcb87adb7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:12.761429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:12.762139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 946868a8-2e74-4fe6-bb0d-94b638c3ebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:12.768915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.769773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.770953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.771665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.787628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 HTTP/1.1 Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.789758 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. Jul 30 21:08:12.791468 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '946868a8-2e74-4fe6-bb0d-94b638c3ebb2'} Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.792374 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. Jul 30 21:08:12.793776 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.798226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 946868a8-2e74-4fe6-bb0d-94b638c3ebb2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.799477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-142e6947-20b1-49ad-b566-b8e1d419dacc tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2" status: 404 len: 111 microversion: 2.1 time: 0.044143 Jul 30 21:08:12.800842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1024/1984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:12 2022] GET /compute/v2.1/servers/946868a8-2e74-4fe6-bb0d-94b638c3ebb2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:12.806296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-725ecf0e-a05c-426e-9fa3-1803f4ba3834 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-801890617", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 2.5}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-725ecf0e-a05c-426e-9fa3-1803f4ba3834 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Request method failure captured: Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 169 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z26YiLWSf0lQOuPP5-JXpO5swgRg4IjOv8z74CTVrrXXFqpWMRAMcqzmGIx5Kd9cJs-ijV4t8LJurY6b7HbhtoTV8jfJrEpgTT6nQzy3TNarjwtOCPCYhAoH9qFSDizvwTmaTq9cV3W240S89BNPkkGH8PT_8ahH_SUaWvlHehRWRU Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:12.810467 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/104c18938daf48a585c72a3072616758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_104c18938daf48a585c72a3072616758", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/104c18938daf48a585c72a3072616758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 104c18938daf48a585c72a3072616758 Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-718374272 Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 21aec407a6e04e4f8a0379061bab8a69 Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-718374272-project Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-801890617", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 2.5}} Jul 30 21:08:12.812294 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-801890617', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'min_count': 2.5}}} Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 2.5 Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.817594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:12.822348 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-725ecf0e-a05c-426e-9fa3-1803f4ba3834 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-725ecf0e-a05c-426e-9fa3-1803f4ba3834 tempest-MultipleCreateNegativeTestJSON-718374272 tempest-MultipleCreateNegativeTestJSON-718374272-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010093 Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1025/1985] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:08:12.825396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14ce0095-4650-4212-8f98-a2ec8d16814c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:12.877907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14ce0095-4650-4212-8f98-a2ec8d16814c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/0859b13a-4963-4424-9588-1e36ab291a74" status: 204 len: 0 microversion: 2.1 time: 0.063871 Jul 30 21:08:12.879347 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1026/1986] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:12 2022] DELETE /compute/v2.1/os-server-groups/0859b13a-4963-4424-9588-1e36ab291a74 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:12.885716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:12.886787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:12.896215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.896949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:12.898052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:12.898823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.048742 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1d013731-5cb4-40a4-bec1-4dcd2741a01a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/action" status: 202 len: 0 microversion: 2.1 time: 1.523452 Jul 30 21:08:13.049545 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 961/1987] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:08:11 2022] POST /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/action => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:08:13.055900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:13.056492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:13.074890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.075637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.080156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.081233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.165127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:13.265066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:13.277987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0486f95a-61ce-4734-9664-865dbdbd9674 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1476 microversion: 2.1 time: 0.394987 Jul 30 21:08:13.280767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1027/1988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:12 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:13.290155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:13.293086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:13.311242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.312382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.315683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.318211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.325487 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c3a3273d-639c-49eb-883f-369726b63ba2 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 204 len: 0 microversion: 2.1 time: 0.274032 Jul 30 21:08:13.330933 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 962/1989] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:13 2022] DELETE /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:13.346647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1077356209"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:13.359334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:13.377130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.377658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.378482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.384483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.755618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:13.779111 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ab9b81f-cbd6-43c4-aa59-cf474e5e2f18 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 0.495215 Jul 30 21:08:13.780192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1028/1990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:13 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:13.799694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8a2e4397-2c38-44b4-ac3c-0e4706135731 req-176fd7bc-e088-47ef-9de1-48197b5fa176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561203ad-288a-4c80-89db-2ce51050e79a", "tag": "7ff07390-6321-4183-b433-44a7d336f921"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:13.841977 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Adding security group 5bed8bed-2143-436e-be81-d51067d5230c to port 7ff07390-6321-4183-b433-44a7d336f921 Jul 30 21:08:13.842638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a2e4397-2c38-44b4-ac3c-0e4706135731 req-176fd7bc-e088-47ef-9de1-48197b5fa176 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.845544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a2e4397-2c38-44b4-ac3c-0e4706135731 req-176fd7bc-e088-47ef-9de1-48197b5fa176 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.884745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:13.916791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8a2e4397-2c38-44b4-ac3c-0e4706135731 req-176fd7bc-e088-47ef-9de1-48197b5fa176 service nova] Creating event network-changed:7ff07390-6321-4183-b433-44a7d336f921 for instance 561203ad-288a-4c80-89db-2ce51050e79a on nch2-master-1 Jul 30 21:08:13.930185 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8a2e4397-2c38-44b4-ac3c-0e4706135731 req-176fd7bc-e088-47ef-9de1-48197b5fa176 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144516 Jul 30 21:08:13.934147 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1029/1991] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:13.951622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:13.953382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:13.974945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.976924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:13.979971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:13.981966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:14.343588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=19 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:14.354439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:14.378078 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-647aabf3-d06d-444e-8934-85d91c4ffda9 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1471 microversion: 2.1 time: 0.440779 Jul 30 21:08:14.379450 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1030/1992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:13 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:14.387902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d166d299-6fba-47aa-b1cd-1f2686334ce6 req-1ee21586-bad8-4eb7-8601-c4bf5a2c5d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aa1223-14ce-4f65-a00a-032dcb87adb7", "name": "network-vif-deleted", "tag": "5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:14.413898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d166d299-6fba-47aa-b1cd-1f2686334ce6 req-1ee21586-bad8-4eb7-8601-c4bf5a2c5d81 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:14.414874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d166d299-6fba-47aa-b1cd-1f2686334ce6 req-1ee21586-bad8-4eb7-8601-c4bf5a2c5d81 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:14.440147 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d166d299-6fba-47aa-b1cd-1f2686334ce6 req-1ee21586-bad8-4eb7-8601-c4bf5a2c5d81 service nova] Creating event network-vif-deleted:5e7b8c9a-e7f9-423d-ad34-c8ba5e946ca9 for instance 74aa1223-14ce-4f65-a00a-032dcb87adb7 on nch1-master-1 Jul 30 21:08:14.457205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d166d299-6fba-47aa-b1cd-1f2686334ce6 req-1ee21586-bad8-4eb7-8601-c4bf5a2c5d81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074158 Jul 30 21:08:14.458923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1031/1993] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:14.475752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:14.478080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:14.489459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:14.490411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:14.491575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:14.493079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:14.501586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:14.909235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:14.917578 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0ff9f40-4b2d-4c91-a4da-2bc6d6f6ff33 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.455644 Jul 30 21:08:14.923420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1032/1994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:14 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:14.932407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:14.936209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:14.939826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:14.961961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:14.962458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:14.963217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:14.971490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:15.620310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:15.633018 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-341b9fc2-48c0-4566-8283-0b7bac52a125 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1475 microversion: 2.1 time: 0.708168 Jul 30 21:08:15.638777 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1033/1995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:14 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:15.655550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:15.657384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:15.673217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:15.673682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:15.682860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:15.683416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.062374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:16.079885 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9fbbe044-b320-48a3-9fca-0497b5afaad2 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 0.438934 Jul 30 21:08:16.093763 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1034/1996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:15 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:16.098176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:16.098807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:16.109692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.110164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.110968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.120019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.362896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ab89ea13c4611904cec244d37ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a50eb5e4a334562a71d4116fa94fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:16.374249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14debf99-7a81-40ed-b0e4-fe1038f7f8d4 tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 200 len: 1429 microversion: 2.1 time: 0.285378 Jul 30 21:08:16.384174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1035/1997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:16 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 1429 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:16.389238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:16.389866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:16.406229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.406693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.420572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.421851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.479099 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d3066e9-813a-4643-9049-8e9a798e32c7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/action" status: 202 len: 0 microversion: 2.1 time: 3.144956 Jul 30 21:08:16.480843 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 963/1998] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:08:13 2022] POST /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/action => generated 0 bytes in 3149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:08:16.488936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:16.489840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:16.505673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.506418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:16.508310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:16.510026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.442327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ae49992-c048-443f-b316-4a304fff3bea tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.957600 Jul 30 21:08:17.445009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 964/1999] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:08:16 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a/os-security-groups => generated 1159 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:17.461366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2267d170-cf0e-4ece-ae02-21b233d6a16d req-671b36ad-28bd-4e19-838d-04e56471d3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561203ad-288a-4c80-89db-2ce51050e79a", "tag": "7ff07390-6321-4183-b433-44a7d336f921"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:17.490296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2267d170-cf0e-4ece-ae02-21b233d6a16d req-671b36ad-28bd-4e19-838d-04e56471d3cf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.490980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2267d170-cf0e-4ece-ae02-21b233d6a16d req-671b36ad-28bd-4e19-838d-04e56471d3cf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.533034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2267d170-cf0e-4ece-ae02-21b233d6a16d req-671b36ad-28bd-4e19-838d-04e56471d3cf service nova] Creating event network-changed:7ff07390-6321-4183-b433-44a7d336f921 for instance 561203ad-288a-4c80-89db-2ce51050e79a on nch2-master-1 Jul 30 21:08:17.544055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2267d170-cf0e-4ece-ae02-21b233d6a16d req-671b36ad-28bd-4e19-838d-04e56471d3cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097582 Jul 30 21:08:17.547755 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 965/2000] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:17.571414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:17.574448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:17.589935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.593036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.594105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.595901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.646314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:17.650840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=19 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:17.657521 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b4a50dd7-6d34-4da2-a965-e03f7c952ce6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 1.271974 Jul 30 21:08:17.658949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1036/2001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:16 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:17.666079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b46116e2-a7d3-4428-ba68-98914c0432e7 req-4ff23bdc-f960-40a0-9604-d373af782b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f920502-e0cf-43aa-93ba-62d50d7905d7", "name": "network-vif-deleted", "tag": "ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:17.695709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b46116e2-a7d3-4428-ba68-98914c0432e7 req-4ff23bdc-f960-40a0-9604-d373af782b62 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.697281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b46116e2-a7d3-4428-ba68-98914c0432e7 req-4ff23bdc-f960-40a0-9604-d373af782b62 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.739603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b46116e2-a7d3-4428-ba68-98914c0432e7 req-4ff23bdc-f960-40a0-9604-d373af782b62 service nova] Creating event network-vif-deleted:ccdd0a05-c25d-4329-90f9-7e9a2a2a8a4e for instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 on nch2-master-1 Jul 30 21:08:17.755492 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b46116e2-a7d3-4428-ba68-98914c0432e7 req-4ff23bdc-f960-40a0-9604-d373af782b62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089894 Jul 30 21:08:17.758344 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1037/2002] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:17.769533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:17.770466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:17.781517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.782918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:17.784097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:17.789487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:18.246592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:18.270209 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dfea448c-4cf1-441d-82fe-3ef82a1fd5fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1475 microversion: 2.1 time: 0.720411 Jul 30 21:08:18.289195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 966/2003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:17 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1475 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:18.322087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:18.329099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] [instance: 7f920502-e0cf-43aa-93ba-62d50d7905d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:18.355084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:18.361803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:18.364723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:18.366605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:18.401947 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] HTTP exception thrown: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Request method failure captured: Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 HTTP/1.1 Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ZzjD2eNc_KUMx2N9EQBxbNgT2dgnoTUOSLWY7g5ZWllH_52CJZgBjA-ZWNUwrQRRKeu9Yz1L29WJXyvW6FV6Xre9rUsNX08P5k_iTcyOpcRHu1YXsaTuH-EgL6OG69V6aLv37lyfygAAWTUeIwk2p0P4oU0uDOSmHKCzpxrXtL5EwA Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:18.405763 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a50eb5e4a334562a71d4116fa94fbcf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a50eb5e4a334562a71d4116fa94fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3a50eb5e4a334562a71d4116fa94fbcf Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215519344 Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d20ab89ea13c4611904cec244d37ba25 Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersOnMultiNodesTest-215519344-project Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. Jul 30 21:08:18.407476 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7f920502-e0cf-43aa-93ba-62d50d7905d7'} Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:18.408349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. Jul 30 21:08:18.409742 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:18.415343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] Returning 404 to user: Instance 7f920502-e0cf-43aa-93ba-62d50d7905d7 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:18.416592 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c177ea74-3016-4189-a395-c58c8a96288c tempest-ServersOnMultiNodesTest-215519344 tempest-ServersOnMultiNodesTest-215519344-project] 10.222.0.17 "GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7" status: 404 len: 111 microversion: 2.1 time: 0.125196 Jul 30 21:08:18.417425 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 967/2004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:18 2022] GET /compute/v2.1/servers/7f920502-e0cf-43aa-93ba-62d50d7905d7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:18.427122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7d921a2-e235-4c84-a210-15fab9f2d566 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb628a7c10>, body: {"security_group": {"name": " tempest-securitygroup -2080680151 ", "description": "tempest-description-1725847939"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:18.516306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:18.533738 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-676214c8-2ce6-44dc-8390-5de7595c8358 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 0.772551 Jul 30 21:08:18.535033 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1038/2005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:17 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:18.679249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:18.680607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:18.698472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:18.702717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:18.704665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:18.705826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:18.985457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=71 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:19.471707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:19.487129 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2de32120-6b3f-48e6-b0c9-e54560b51f22 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.812060 Jul 30 21:08:19.487951 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1039/2006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:18 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:08:19.493779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:19.494441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:19.514853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:19.517772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:19.518808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:19.519456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:19.606298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7d921a2-e235-4c84-a210-15fab9f2d566 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.186977 Jul 30 21:08:19.607048 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 968/2007] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:18 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:19.612474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:19.613214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:19.637210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:19.638273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:19.643203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:19.644032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:20.404738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:20.413440 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73405950-c945-449d-acb1-9820374f0045 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1475 microversion: 2.1 time: 0.924165 Jul 30 21:08:20.414045 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1040/2008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:19 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1475 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:20.434733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8182b16d-be87-41e8-a227-b11ee4895e38", "tag": "67a25ff1-28d8-455a-a712-06d40a63f48d"}, {"server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "name": "network-vif-unplugged", "status": "completed", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}, {"name": "network-changed", "server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:20.470053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:20.470682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:20.499957 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Creating event network-changed:67a25ff1-28d8-455a-a712-06d40a63f48d for instance 8182b16d-be87-41e8-a227-b11ee4895e38 on nch1-master-1 Jul 30 21:08:20.501021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Creating event network-vif-unplugged:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch2-master-1 Jul 30 21:08:20.501719 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Creating event network-changed:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch2-master-1 Jul 30 21:08:20.512466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:08:20.543158 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-216ef342-4b6f-4635-9fe3-2a7c1c1999ef req-677e6fc5-4df8-4cc8-a3fe-a5829bda43e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.117844 Jul 30 21:08:20.544618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1041/2009] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:20.553634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40464e91-b8f2-4a63-839d-01da24357eb9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6291f280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:20.677436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:20.689916 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f6ad427-d2b2-43cd-aaa6-471eb9de1af0 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 1.081352 Jul 30 21:08:20.690535 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 969/2010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:19 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:20.701512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:20.703686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:20.712489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:20.713147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:20.714170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:20.714832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:21.185786 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40464e91-b8f2-4a63-839d-01da24357eb9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8" status: 200 len: 224 microversion: 2.1 time: 0.630085 Jul 30 21:08:21.186495 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1042/2011] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:08:20 2022] GET /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 => generated 224 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:21.213023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d7893e9-a59d-431c-92d7-353637a169b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628da0d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:21.334949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:21.351621 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc51350a-c7c1-4c17-8882-c00974df701f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.659448 Jul 30 21:08:21.352891 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 970/2012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:20 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:21.457181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:21.457883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:21.470131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:21.491619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:21.492721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:21.493206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:22.148819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:22.163683 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5bff3b2e-89f0-4282-9a94-edbc2049d1f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1475 microversion: 2.1 time: 0.727028 Jul 30 21:08:22.166549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 971/2013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:21 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1475 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:22.199547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-205679076", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "d44fb578-3f11-4627-b87b-1a7defede23d"}, {"uuid": "989f0e8b-f372-4c53-8ee0-b845429b4582"}, {"uuid": "d44fb578-3f11-4627-b87b-1a7defede23d"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:22.219428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d7893e9-a59d-431c-92d7-353637a169b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8" status: 202 len: 0 microversion: 2.1 time: 1.023518 Jul 30 21:08:22.222973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1043/2014] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:08:21 2022] DELETE /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:08:22.229798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:22.231135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:22.262033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:22.262711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:22.264592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:22.265853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:22.354844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] validate_networks() for [('d44fb578-3f11-4627-b87b-1a7defede23d', None, None, None, None, None), ('989f0e8b-f372-4c53-8ee0-b845429b4582', None, None, None, None, None), ('d44fb578-3f11-4627-b87b-1a7defede23d', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:22.621016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:22.639914 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8fef4515-d7f0-48a1-96b3-53b3345af831 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 0.415277 Jul 30 21:08:22.640793 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1044/2015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:22 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:22.652864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6291f310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:22.794149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:08:22.794784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:08:22.795378 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.795378 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 HTTP/1.1 Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:22.809694 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.811681 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '043d224d-06dd-4bd0-b1aa-08365100b7f8'} Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:22.812915 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:08:22.814546 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.816239 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] Jul 30 21:08:22.818064 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:22.823772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:08:22.823772 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-ab4436a6-4ffb-46ce-8e18-ef29bcfa9fe7'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:22.823772 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b9a7c88-0f95-4a46-8c41-5b7237f42343 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8" status: 404 len: 194 microversion: 2.1 time: 0.178185 Jul 30 21:08:22.823772 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1045/2016] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:08:22 2022] GET /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 => generated 194 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:22.831974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:22.833016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:22.870659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:22.871514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:22.872554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:22.873482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:23.206533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:23.220585 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a0d0d87-8d0c-480f-8610-03273d82123f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.396658 Jul 30 21:08:23.223734 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1046/2017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:22 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:23.239716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae29a878-4a6a-408a-8703-88a427d0f209 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb6287e940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1343454660", "description": "tempest-description-1474548947"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:24.293859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae29a878-4a6a-408a-8703-88a427d0f209 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.068729 Jul 30 21:08:24.295516 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1047/2018] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:24.308219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:24.308984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:24.328961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:24.330956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:24.343965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:24.345657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:24.845627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:24.901481 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c204381b-f774-4528-a910-799bef081f74 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1470 microversion: 2.1 time: 0.604706 Jul 30 21:08:24.902080 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1048/2019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:24 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1470 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:24.928010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:24.929241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:24.951057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:24.953347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:24.956279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:24.956941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:25.963868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:25.964364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:25.965067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:25.965493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:25.965910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:25.982709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:25.983206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:25.984080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:25.984767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.028786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Getting quotas for project c143a2d2e4b04edba1f2734d4d19d978. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:26.037619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Getting quotas for user 6399b6f3e2574df8af12786c8755c59a and project c143a2d2e4b04edba1f2734d4d19d978. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:26.060593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:26.063544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:26.129760 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef19f48b-710a-4699-bcb4-593e450ef195 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.958984 Jul 30 21:08:26.132195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 972/2020] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:26.137760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:26.138739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:26.149740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.150625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.151923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.152802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.318340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:26.330622 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39fefbe8-8608-45fb-ac22-b7ded6bd1733 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 1.420631 Jul 30 21:08:26.333690 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1049/2021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:24 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:26.347727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75f2762e-7114-4366-aa34-79aed7fa8889 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb5c65c550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2080902891", "description": "tempest-description-268982857"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:26.437737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:26.450740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b55ebdce-125d-4881-bdca-be001c0ca31b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.316759 Jul 30 21:08:26.452022 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 973/2022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:26 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:26.459509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:26.460284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:26.472677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.473136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.478221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.479017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.595423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37265270-62db-4c27-9308-b5dc2360b3ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9/action" status: 204 len: 0 microversion: 2.1 time: 0.141464 Jul 30 21:08:26.600739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 974/2023] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:08:26 2022] POST /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:26.608528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0bc11e50-eb30-4dc4-8a1a-17af89ebc797 req-de1aa811-d173-4fcb-9ef9-e194fd6ded4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8182b16d-be87-41e8-a227-b11ee4895e38", "name": "network-vif-plugged", "status": "completed", "tag": "67a25ff1-28d8-455a-a712-06d40a63f48d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:26.622948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0bc11e50-eb30-4dc4-8a1a-17af89ebc797 req-de1aa811-d173-4fcb-9ef9-e194fd6ded4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.623653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0bc11e50-eb30-4dc4-8a1a-17af89ebc797 req-de1aa811-d173-4fcb-9ef9-e194fd6ded4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.638435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0bc11e50-eb30-4dc4-8a1a-17af89ebc797 req-de1aa811-d173-4fcb-9ef9-e194fd6ded4d service nova] Creating event network-vif-plugged:67a25ff1-28d8-455a-a712-06d40a63f48d for instance 8182b16d-be87-41e8-a227-b11ee4895e38 on nch1-master-1 Jul 30 21:08:26.657303 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0bc11e50-eb30-4dc4-8a1a-17af89ebc797 req-de1aa811-d173-4fcb-9ef9-e194fd6ded4d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057481 Jul 30 21:08:26.660725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 975/2024] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:26.676648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3d3ff58-211d-4053-8b75-b0e9eb9d2c8b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:26.678442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3d3ff58-211d-4053-8b75-b0e9eb9d2c8b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:26.808748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3d3ff58-211d-4053-8b75-b0e9eb9d2c8b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:26.820021 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3d3ff58-211d-4053-8b75-b0e9eb9d2c8b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1212 microversion: 2.1 time: 0.157031 Jul 30 21:08:26.835928 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 976/2025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:26 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1212 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:26.923410 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75f2762e-7114-4366-aa34-79aed7fa8889 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.586482 Jul 30 21:08:26.924728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1050/2026] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:26.931116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:26.932574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:26.956141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.959020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:26.960387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:26.962297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:27.601476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-801896510", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:27.710296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:27.986983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:28.003998 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-339874ff-6efe-4d77-9e6c-46154176e7d7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1470 microversion: 2.1 time: 1.077757 Jul 30 21:08:28.004606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1051/2027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:26 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1470 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:28.021166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ebdd84f0-5202-4104-ba4b-604c45f73335 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb629191f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1723984282", "description": "tempest-description-1797741937"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:28.163622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:28.165171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:28.165979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:28.167672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:28.168351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:28.185986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.196573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:28.198595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.199269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:28.245748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Getting quotas for project 9ac2076b2db2419db452fab81b425dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:28.260214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Getting quotas for user cd9de4db5d7a487fa26b3138d1158f33 and project 9ac2076b2db2419db452fab81b425dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:28.301766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:28.313779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:28.427877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d59549e-7fc5-467d-8bff-ec900d04b768 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588849 Jul 30 21:08:28.430914 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 977/2028] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:28.444719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:28.446939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:28.494111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.495265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:28.500076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.501352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:28.726495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ebdd84f0-5202-4104-ba4b-604c45f73335 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.720801 Jul 30 21:08:28.727668 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1052/2029] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:28.746480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:28.753933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:28.774894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.777549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:28.778409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:28.787356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:29.085445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:29.102746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f8d046d-779c-4996-9736-10e82fe1d4f1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.370139 Jul 30 21:08:29.108540 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1053/2030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:28 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:29.121923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:29.132236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:29.141132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:29.141901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:29.144021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:29.144659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:29.274385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:29.290309 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c73e67cc-e57a-41db-8d2f-56f3b9e432ef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1270 microversion: 2.1 time: 0.180254 Jul 30 21:08:29.292973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1054/2031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:29 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:29.307885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-745b6abd-26d6-4c1d-b77e-0981a1d1c791 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:29.308990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-745b6abd-26d6-4c1d-b77e-0981a1d1c791 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:29.331120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:29.341914 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9856e3af-f782-4f8e-90a4-603a6b7f6015 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1312 microversion: 2.1 time: 0.909919 Jul 30 21:08:29.350073 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 978/2032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:28 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1312 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:29.371145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-45ac75bb-10a9-421f-a41b-3772d81b49de tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628a7940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:29.433308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-745b6abd-26d6-4c1d-b77e-0981a1d1c791 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:29.450211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-745b6abd-26d6-4c1d-b77e-0981a1d1c791 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1213 microversion: 2.1 time: 0.150568 Jul 30 21:08:29.451663 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1055/2033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:29 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:29.471607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:29.472248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:29.501423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:29.502069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:29.502930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:29.503487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:30.255623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-45ac75bb-10a9-421f-a41b-3772d81b49de tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1836 microversion: 2.1 time: 0.894128 Jul 30 21:08:30.256860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 979/2034] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:08:29 2022] GET /compute/v2.1/os-security-groups => generated 1836 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:30.262038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:30.262933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:30.271612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:30.272754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:30.274060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:30.275019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:30.564149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:30.574689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:30.582200 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1ea8c50-5425-40f4-a75e-9e27a6962234 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1470 microversion: 2.1 time: 1.123930 Jul 30 21:08:30.585327 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1056/2035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:29 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1470 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:30.603454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a874f6e-6c92-4e78-ad3d-d4e206f5f8f2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb62895ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:30.928936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:30.937623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90496071-ecce-457b-88ff-bfc00bb6a25a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.679419 Jul 30 21:08:30.944633 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 980/2036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:30 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:30.959973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:30.960825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:30.979861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:30.980772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:30.982542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:30.984118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:31.509272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a874f6e-6c92-4e78-ad3d-d4e206f5f8f2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0" status: 202 len: 0 microversion: 2.1 time: 0.921852 Jul 30 21:08:31.510091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1057/2037] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:08:30 2022] DELETE /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0 => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:08:31.516807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:31.517439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:31.535783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:31.536256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:31.537098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:31.537555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:31.626897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:31.645807 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64a8a6ff-14b3-40e8-b01c-d189e465380b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1312 microversion: 2.1 time: 0.698845 Jul 30 21:08:31.649271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 981/2038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:30 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1312 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:31.658732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:31.660487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:31.689807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:31.691175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:31.696689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:31.697885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:31.780671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:31.932834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:31.938760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:31.956392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8c22747-1b3f-4783-899d-581fd113f41a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1271 microversion: 2.1 time: 0.305665 Jul 30 21:08:31.963411 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4efbf46-7237-4a0a-8b7e-ced11267bfe5 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1496 microversion: 2.1 time: 0.451910 Jul 30 21:08:31.963673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 982/2039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:31 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:31.968450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7d0ff909-29c0-4ece-b4b9-8ca1c0b25c8b req-c8df5dd6-ebea-448f-b5f3-fe884035fa5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "name": "network-vif-plugged", "status": "completed", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:31.976333 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1058/2040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:31 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1496 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:31.989902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5c65c040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:32.044476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7d0ff909-29c0-4ece-b4b9-8ca1c0b25c8b req-c8df5dd6-ebea-448f-b5f3-fe884035fa5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.044955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7d0ff909-29c0-4ece-b4b9-8ca1c0b25c8b req-c8df5dd6-ebea-448f-b5f3-fe884035fa5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.079526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7d0ff909-29c0-4ece-b4b9-8ca1c0b25c8b req-c8df5dd6-ebea-448f-b5f3-fe884035fa5f service nova] Creating event network-vif-plugged:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch2-master-1 Jul 30 21:08:32.084888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7d0ff909-29c0-4ece-b4b9-8ca1c0b25c8b req-c8df5dd6-ebea-448f-b5f3-fe884035fa5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120060 Jul 30 21:08:32.085074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:08:32.085528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 983/2041] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:32.085696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:08:32.086142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.086142 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0 HTTP/1.1 Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:32.088043 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.089900 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0bc2c04d-8166-431c-800a-0d14b540f2f0'} Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:32.091004 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:08:32.092617 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.094233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3064cfe1-3d3f-401f-ba69-f84e1e90a9b6'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2419b9d3-3ca7-426e-babb-82d61e70bcbf tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0" status: 404 len: 194 microversion: 2.1 time: 0.107151 Jul 30 21:08:32.096759 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1059/2042] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:08:31 2022] GET /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:32.107911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:32.110740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:32.116562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:32.118074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:32.128064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.128815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.132661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.134448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.145908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.146375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.147184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.147666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.575748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:32.588491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfa12c94-d68a-4c94-bc20-0ac6d54ba01f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1516 microversion: 2.1 time: 0.490025 Jul 30 21:08:32.592665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 984/2043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:32 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1516 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:32.611668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-089093b2-3935-4e00-b184-f7c61d94b72a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:32.635037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.server_groups [None req-089093b2-3935-4e00-b184-f7c61d94b72a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Querying cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) for 1 instances {{(pid=130983) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 30 21:08:32.636356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-089093b2-3935-4e00-b184-f7c61d94b72a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:32.637231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-089093b2-3935-4e00-b184-f7c61d94b72a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:32.711841 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-089093b2-3935-4e00-b184-f7c61d94b72a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0" status: 200 len: 221 microversion: 2.1 time: 0.115080 Jul 30 21:08:32.714067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 985/2044] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:08:32 2022] GET /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0 => generated 221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:32.726636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43952563-63f9-4275-b25f-a4b7cbcbba43 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb629453a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:32.987503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:33.021350 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92063878-db9d-49dd-a447-a928637355d1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1462 microversion: 2.1 time: 0.922851 Jul 30 21:08:33.022372 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1060/2045] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:32 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1462 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:33.043720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:33.049933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:33.065980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:33.068074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:33.070120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:33.070640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:33.615986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:33.625937 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c61c335d-4fba-41a3-9817-c4f066707884 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1333 microversion: 2.1 time: 0.601960 Jul 30 21:08:33.649072 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1061/2046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:33 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1333 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:33.654394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:33.655035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:33.713627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:33.714486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:33.715678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:33.716138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:33.781194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:33.996460 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-65d51acb-90ad-4ea6-94a7-2fa994d8cbf8 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 204 len: 0 microversion: 2.1 time: 0.345998 Jul 30 21:08:33.998950 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1062/2047] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:33 2022] DELETE /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:34.292229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43952563-63f9-4275-b25f-a4b7cbcbba43 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d" status: 202 len: 0 microversion: 2.1 time: 1.576366 Jul 30 21:08:34.294001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 986/2048] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:08:32 2022] DELETE /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d => generated 0 bytes in 1579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:08:34.299859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:34.300783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:34.331214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:34.333324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:34.336390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:34.337361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:34.365805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-409252963", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "41a2a4a8-b923-4381-b42c-beff534a23f3"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:34.467733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] validate_networks() for [('41a2a4a8-b923-4381-b42c-beff534a23f3', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:34.786796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:34.796967 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9fe52987-cda6-4aba-a0b9-8c85be461014 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.501472 Jul 30 21:08:34.819566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 987/2049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:34 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:34.822812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:34.823487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:34.832132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:34.832895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:34.833880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:34.836735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.328814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:35.329929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:35.332515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:35.334995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:35.338803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:35.354058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-888cca46-eb89-4458-b54f-4f34817f34d8 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1613 microversion: 2.1 time: 0.546255 Jul 30 21:08:35.354058 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 988/2050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:34 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1613 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:35.365266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.366473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.366841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:35.367735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.368556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.377144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:35.392461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.392833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.393837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.394452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.430838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Getting quotas for project ab77ff72721c4579b8e48346f7d98842. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:35.437277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Getting quotas for user e32ef1b0626a4e8ba78cf5d60d5cba07 and project ab77ff72721c4579b8e48346f7d98842. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:35.463698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:35.466324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:35.522217 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d47815a-a51c-477a-9243-b26ef8d732cc tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520905 Jul 30 21:08:35.523176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1063/2051] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:35.528738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:35.529820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:35.546409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.547178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.548177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:35.548789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:35.941538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:35.958262 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5cf74f4-f7da-4cf9-b9bb-256e2c7e00ed tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1502 microversion: 2.1 time: 0.433182 Jul 30 21:08:35.959306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1064/2052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:35 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1502 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:35.964365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5d3c31f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:36.131742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:36.142163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:08:36.143086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 6a603123-979a-44c4-8f9a-2650f985922d not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:08:36.143862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.143862 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d HTTP/1.1 Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:36.146140 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.147747 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6a603123-979a-44c4-8f9a-2650f985922d'} Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:36.148728 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:08:36.150041 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.151272 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] Jul 30 21:08:36.152736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:36.153270 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ee328cf-c9c5-454c-a58f-55f31d46fd7f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1522 microversion: 2.1 time: 0.789739 Jul 30 21:08:36.155320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:08:36.155320 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-b82e6c77-ba74-47ef-be68-235cc8c0b9e2'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:36.156738 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51b8f248-7016-4400-8288-373d050b624f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d" status: 404 len: 194 microversion: 2.1 time: 0.196046 Jul 30 21:08:36.157459 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1065/2053] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:08:35 2022] GET /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d => generated 194 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:36.161776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 989/2054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:35 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:36.176226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:36.176513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9859d56-17cb-40d7-b252-9b249ecddf91 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '.version_select at 0x7fbb628c4430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:36.176874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:36.184648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.185439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.186396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.187007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.199608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9859d56-17cb-40d7-b252-9b249ecddf91 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.203618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9859d56-17cb-40d7-b252-9b249ecddf91 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.217538 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b9859d56-17cb-40d7-b252-9b249ecddf91 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.054080 Jul 30 21:08:36.232627 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 990/2055] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:08:36 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:36.244827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f93a7ce8-2daf-4533-b396-e6122607dfe2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:36.245798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f93a7ce8-2daf-4533-b396-e6122607dfe2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:36.402164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f93a7ce8-2daf-4533-b396-e6122607dfe2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:36.426539 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f93a7ce8-2daf-4533-b396-e6122607dfe2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1216 microversion: 2.1 time: 0.190603 Jul 30 21:08:36.427901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 991/2056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:36 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:36.440346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:36.440976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:36.459372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.459845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.460650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.461650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.681457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:36.689898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2cd348b-fb5a-45a8-a53a-bad29e3ff889 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.531218 Jul 30 21:08:36.703276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1066/2057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:36 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:36.708606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7bb066ad-5384-4728-ab19-7f554bfdf95e req-ddd0065c-f5de-4caf-b5a4-fa5f5449f452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "tag": "7e0d5ab9-e506-4a2f-9756-658ee0fc42ff"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:36.721427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7bb066ad-5384-4728-ab19-7f554bfdf95e req-ddd0065c-f5de-4caf-b5a4-fa5f5449f452 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:36.722067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7bb066ad-5384-4728-ab19-7f554bfdf95e req-ddd0065c-f5de-4caf-b5a4-fa5f5449f452 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:36.746240 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7bb066ad-5384-4728-ab19-7f554bfdf95e req-ddd0065c-f5de-4caf-b5a4-fa5f5449f452 service nova] Creating event network-changed:7e0d5ab9-e506-4a2f-9756-658ee0fc42ff for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:36.753554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7bb066ad-5384-4728-ab19-7f554bfdf95e req-ddd0065c-f5de-4caf-b5a4-fa5f5449f452 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048673 Jul 30 21:08:36.754468 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1067/2058] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:36.771982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc82f775-08e5-4bab-8533-5e69cbedd5e4 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5c68d9d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:37.200916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:37.215733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-caf307c1-1978-4379-a31d-eb02aee5aae4 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.777762 Jul 30 21:08:37.216759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 992/2059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:36 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:37.222400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2089695200", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:37.238119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:37.328846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:38.223852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:38.259696 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc82f775-08e5-4bab-8533-5e69cbedd5e4 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a" status: 202 len: 0 microversion: 2.1 time: 1.503906 Jul 30 21:08:38.260933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1068/2060] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:08:36 2022] DELETE /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a => generated 0 bytes in 1506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:08:38.266236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8a53541a-88fc-4a86-a7ab-7d65ecda1697 req-3cefcd26-da21-47b8-92d1-c66cc75944c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5538e8db-43b5-45a5-a07a-26df1c6fbe68", "tag": "6a9986c5-365a-4b18-8efc-ec47155b4f0f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:38.313296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a53541a-88fc-4a86-a7ab-7d65ecda1697 req-3cefcd26-da21-47b8-92d1-c66cc75944c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.314072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a53541a-88fc-4a86-a7ab-7d65ecda1697 req-3cefcd26-da21-47b8-92d1-c66cc75944c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:38.340011 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8a53541a-88fc-4a86-a7ab-7d65ecda1697 req-3cefcd26-da21-47b8-92d1-c66cc75944c8 service nova] Creating event network-changed:6a9986c5-365a-4b18-8efc-ec47155b4f0f for instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 on nch2-master-1 Jul 30 21:08:38.355683 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8a53541a-88fc-4a86-a7ab-7d65ecda1697 req-3cefcd26-da21-47b8-92d1-c66cc75944c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092447 Jul 30 21:08:38.356899 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1069/2061] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:38.362348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:38.365772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:38.381847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.382325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:38.383164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.383649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:38.468216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.468743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:38.469066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lazy-loading 'fault' on Instance uuid 8182b16d-be87-41e8-a227-b11ee4895e38 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:08:38.796275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027664b7857430494e38fa27da60c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a502ca105b1344babf2e8d590de18198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:38.809163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d04bfbd-2560-4946-9f05-cffacce6baf1 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 200 len: 1302 microversion: 2.1 time: 0.450826 Jul 30 21:08:38.809749 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1070/2062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:38 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 1302 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:38.833170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:38.833857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:38.861308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.861840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:38.864585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:38.872747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.233300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:39.241008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:39.243513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:39.244203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:39.245144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:39.263512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.263785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:39.264283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.269809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.270359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.272854 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a6e362f-6cfa-4a22-b0a7-615971a521b6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1522 microversion: 2.1 time: 0.452450 Jul 30 21:08:39.276618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1071/2063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:38 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:39.288144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:39.292074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:39.305935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.306700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.307797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.309995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.310136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:39.322301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:39.360274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:39.362782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:39.437173 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88a12c17-b208-48aa-9fa6-93e5fbd05388 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.219072 Jul 30 21:08:39.437843 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 993/2064] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:39.443583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:39.444544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:39.452488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.453226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.454188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.454797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.637690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:39.653628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8745dc65-8e37-4c11-8533-a1f6ff75eb85 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1274 microversion: 2.1 time: 0.374536 Jul 30 21:08:39.656964 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1072/2065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:39 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:39.668172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:39.668676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:39.684017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.684542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.686957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:39.687454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:39.896285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:39.909822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8863db80-8742-4b9c-854f-8ee21b65c08d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.470683 Jul 30 21:08:39.910665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 994/2066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:39 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:39.936261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628fe8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.017823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:08:40.018710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:08:40.019560 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.019560 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a HTTP/1.1 Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:40.022433 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.024661 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'ceb77ccb-67bc-4c4f-88bb-fcb52efae40a'} Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:40.029242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:08:40.032339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.034178 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-0ba752d9-afd9-4b29-95d6-519d5ce8efff'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c5e0bdf-0595-484d-97e3-a6d923a55c01 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a" status: 404 len: 194 microversion: 2.1 time: 0.096767 Jul 30 21:08:40.036929 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 995/2067] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:08:39 2022] GET /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:40.037949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e8439f17-d93d-4563-becf-470db6f5538d req-f5dc6ef9-6cb2-4150-996f-639267eaadd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "tag": "da571ea3-710d-4e17-955a-44cd2d11c0f5"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:40.053903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e8439f17-d93d-4563-becf-470db6f5538d req-f5dc6ef9-6cb2-4150-996f-639267eaadd8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.056133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e8439f17-d93d-4563-becf-470db6f5538d req-f5dc6ef9-6cb2-4150-996f-639267eaadd8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.057719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:40.069408 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d299f414-5a9a-4036-a35c-6d6d1d898f21 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.410997 Jul 30 21:08:40.071083 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1073/2068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:39 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:40.081361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e8439f17-d93d-4563-becf-470db6f5538d req-f5dc6ef9-6cb2-4150-996f-639267eaadd8 service nova] Creating event network-changed:da571ea3-710d-4e17-955a-44cd2d11c0f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:40.087126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.088187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:40.099077 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e8439f17-d93d-4563-becf-470db6f5538d req-f5dc6ef9-6cb2-4150-996f-639267eaadd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070359 Jul 30 21:08:40.100019 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 996/2069] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:40.111028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-76f9b786-1ed8-4fe3-8eee-138166c5f51f req-3a08bb92-fa09-4dc2-820a-c7ce272115ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d028aca0-d3d0-4caf-8b0c-615ab599b649", "name": "network-vif-plugged", "status": "completed", "tag": "e782bd19-ee42-40ec-b554-e87a125812a1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:40.138632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-76f9b786-1ed8-4fe3-8eee-138166c5f51f req-3a08bb92-fa09-4dc2-820a-c7ce272115ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.139860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-76f9b786-1ed8-4fe3-8eee-138166c5f51f req-3a08bb92-fa09-4dc2-820a-c7ce272115ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.151818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.154306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-76f9b786-1ed8-4fe3-8eee-138166c5f51f req-3a08bb92-fa09-4dc2-820a-c7ce272115ef service nova] Creating event network-vif-plugged:e782bd19-ee42-40ec-b554-e87a125812a1 for instance d028aca0-d3d0-4caf-8b0c-615ab599b649 on nch2-master-1 Jul 30 21:08:40.156403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.157260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.167059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.169500 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-76f9b786-1ed8-4fe3-8eee-138166c5f51f req-3a08bb92-fa09-4dc2-820a-c7ce272115ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065940 Jul 30 21:08:40.170395 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 997/2070] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:40.177560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.178463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:40.187272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.188092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.190426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.191079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.210557 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 HTTP/1.1 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:40.212618 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:40.214477 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '8182b16d-be87-41e8-a227-b11ee4895e38'} Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:40.215577 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:40.217277 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:40.220080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:40.221156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fc75b511-022f-43da-979e-a47d78e348fc tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 404 len: 111 microversion: 2.1 time: 0.049315 Jul 30 21:08:40.222286 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 998/2071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:40.227638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d625cd72-c9de-4afd-980b-7b2c4c583a16 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628c28b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.361029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:40.385704 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1cc78d2-0de2-4ce0-adc3-b9968b0370fe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1217 microversion: 2.1 time: 0.301864 Jul 30 21:08:40.399317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1074/2072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:40.399317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86b7863c-f3a8-493d-8603-cdb6a87e2d12 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.416968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.server_groups [None req-86b7863c-f3a8-493d-8603-cdb6a87e2d12 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Querying cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) for 1 instances {{(pid=130984) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 30 21:08:40.418132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b7863c-f3a8-493d-8603-cdb6a87e2d12 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.418583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86b7863c-f3a8-493d-8603-cdb6a87e2d12 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.431659 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86b7863c-f3a8-493d-8603-cdb6a87e2d12 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042224 Jul 30 21:08:40.433044 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1075/2073] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:40.438338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.439571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:40.447320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.448078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.449114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.449728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.719235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:40.732367 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48bb44d6-fef6-4177-b375-9fbf353f1ba7 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1522 microversion: 2.1 time: 0.298383 Jul 30 21:08:40.735362 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1076/2074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:40.749717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3f72e05-78ad-45af-9a29-9463299eec53 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.782621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.server_groups [None req-a3f72e05-78ad-45af-9a29-9463299eec53 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Querying cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) for 1 instances {{(pid=130984) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 30 21:08:40.784633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3f72e05-78ad-45af-9a29-9463299eec53 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.786735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3f72e05-78ad-45af-9a29-9463299eec53 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.812437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3f72e05-78ad-45af-9a29-9463299eec53 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0" status: 200 len: 183 microversion: 2.1 time: 0.075679 Jul 30 21:08:40.813385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1077/2075] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0 => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:40.828177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.831889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:40.842770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.843243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.844081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:40.857527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:40.983090 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d625cd72-c9de-4afd-980b-7b2c4c583a16 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.759389 Jul 30 21:08:40.984126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 999/2076] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:40.989077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:40.989911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:41.066716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.070918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.071950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.075306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.146142 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 HTTP/1.1 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:41.155149 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:41.157042 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '8182b16d-be87-41e8-a227-b11ee4895e38'} Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:41.158096 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:41.161750 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:41.163502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:41.167477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55709696-396f-47af-87ff-7aefd2a00b9a tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 404 len: 111 microversion: 2.1 time: 0.181988 Jul 30 21:08:41.170577 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1000/2077] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:40 2022] DELETE /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:41.178205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-010d1af5-c29a-41d9-a69b-2378acdb9904 req-bb90c8f7-e782-4ac7-8af1-081febe1a8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8182b16d-be87-41e8-a227-b11ee4895e38", "name": "network-vif-deleted", "tag": "67a25ff1-28d8-455a-a712-06d40a63f48d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:41.214236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-010d1af5-c29a-41d9-a69b-2378acdb9904 req-bb90c8f7-e782-4ac7-8af1-081febe1a8cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.216428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-010d1af5-c29a-41d9-a69b-2378acdb9904 req-bb90c8f7-e782-4ac7-8af1-081febe1a8cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.239880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-010d1af5-c29a-41d9-a69b-2378acdb9904 req-bb90c8f7-e782-4ac7-8af1-081febe1a8cb service nova] Creating event network-vif-deleted:67a25ff1-28d8-455a-a712-06d40a63f48d for instance 8182b16d-be87-41e8-a227-b11ee4895e38 on nch1-master-1 Jul 30 21:08:41.258354 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-010d1af5-c29a-41d9-a69b-2378acdb9904 req-bb90c8f7-e782-4ac7-8af1-081febe1a8cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085529 Jul 30 21:08:41.260001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1001/2078] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:41.274977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:41.277186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:41.297294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.299357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.300456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.302992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.557569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:41.562908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:41.568216 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fee6fd1c-9607-4139-8c30-195c222929d7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.743912 Jul 30 21:08:41.569036 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1078/2079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:40 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:41.589908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63e3e28f-4772-48ba-8f2d-86af9becbdd9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb628d9d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879826669", "description": "tempest-description-1035801348"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:41.811560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:41.821536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4f3cb79-6206-451a-9990-567d9ce99086 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.559131 Jul 30 21:08:41.822263 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1002/2080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:41 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:41.829218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:41.830156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:41.839792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.840524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:41.842184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:41.842840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.256372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:42.268024 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3380be54-a964-41fb-aa2d-472adfa8dd6c tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.444091 Jul 30 21:08:42.275381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1003/2081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:41 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:42.280690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:42.281318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] [instance: 8182b16d-be87-41e8-a227-b11ee4895e38] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:42.298519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.298998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.301398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.301914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.332736 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:42.332914 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63e3e28f-4772-48ba-8f2d-86af9becbdd9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.748131 Jul 30 21:08:42.333384 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1079/2082] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 HTTP/1.1 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:08:42.338043 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:42.339682 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '8182b16d-be87-41e8-a227-b11ee4895e38'} Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:42.340560 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. Jul 30 21:08:42.341975 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:08:42.344384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:42.344384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:42.344384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:42.346511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance 8182b16d-be87-41e8-a227-b11ee4895e38 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:42.347937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b11ba236-ed82-456d-8a17-8c629a33e6b6 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38" status: 404 len: 111 microversion: 2.1 time: 0.070955 Jul 30 21:08:42.348819 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1004/2083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:42 2022] GET /compute/v2.1/servers/8182b16d-be87-41e8-a227-b11ee4895e38 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:42.354920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:42.355982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:42.362872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.363708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.364424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.364582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.365820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.366247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.366620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.368702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.503434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:42.513737 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1de876d9-2987-49c4-b76b-5cad7b959d28 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1271 microversion: 2.1 time: 0.179107 Jul 30 21:08:42.514320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1080/2084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:42 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:42.532055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bb6bd95e-e74d-44cb-b703-f7535c234078 req-e1d989d7-a64a-4a23-b7c4-74c78e2586f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "tag": "a59110de-e042-44ca-adfe-8f07d6a2d4f5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:42.543593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bb6bd95e-e74d-44cb-b703-f7535c234078 req-e1d989d7-a64a-4a23-b7c4-74c78e2586f5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:42.544129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bb6bd95e-e74d-44cb-b703-f7535c234078 req-e1d989d7-a64a-4a23-b7c4-74c78e2586f5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:42.562722 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bb6bd95e-e74d-44cb-b703-f7535c234078 req-e1d989d7-a64a-4a23-b7c4-74c78e2586f5 service nova] Creating event network-changed:a59110de-e042-44ca-adfe-8f07d6a2d4f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:42.568807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bb6bd95e-e74d-44cb-b703-f7535c234078 req-e1d989d7-a64a-4a23-b7c4-74c78e2586f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040202 Jul 30 21:08:42.569418 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1081/2085] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:42.575691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c6c4229-5533-4dd2-bd4e-035fa7e05764 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb628da1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-881814793", "description": "tempest-description-1684750768"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:43.182019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c6c4229-5533-4dd2-bd4e-035fa7e05764 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.610521 Jul 30 21:08:43.195823 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1082/2086] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:08:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:43.197470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:43.207811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92dae793-bca7-47d8-9b05-96d8ef660aee tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:43.213349 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-360ed412-26bc-4772-b65a-8098bca1b834 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1522 microversion: 2.1 time: 0.863130 Jul 30 21:08:43.217772 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1005/2087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:42 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1522 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:43.222764 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-92dae793-bca7-47d8-9b05-96d8ef660aee tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92dae793-bca7-47d8-9b05-96d8ef660aee tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-server-groups/dac0a70f-e10f-4a45-9e40-a73d5c0ed460 HTTP/1.1 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:43.228486 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. Jul 30 21:08:43.230316 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'dac0a70f-e10f-4a45-9e40-a73d5c0ed460'} Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:43.231358 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. Jul 30 21:08:43.232948 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.236033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:43.236937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92dae793-bca7-47d8-9b05-96d8ef660aee tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance group dac0a70f-e10f-4a45-9e40-a73d5c0ed460 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:43.237995 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92dae793-bca7-47d8-9b05-96d8ef660aee tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/dac0a70f-e10f-4a45-9e40-a73d5c0ed460" status: 404 len: 117 microversion: 2.1 time: 0.039677 Jul 30 21:08:43.238804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:43.241543 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1083/2088] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:43 2022] DELETE /compute/v2.1/os-server-groups/dac0a70f-e10f-4a45-9e40-a73d5c0ed460 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:43.248646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:43.252755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.253926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:43.261941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.263592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.264231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.280475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.280952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.281760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.293184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.712170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:43.729281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77ed4df3-b3a7-42b0-88d4-aaf193c09eef tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.486328 Jul 30 21:08:43.731445 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1084/2089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:43 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:43.739516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c072a24-dc29-48b0-9b97-68814c0c5d43 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:43.754979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9c072a24-dc29-48b0-9b97-68814c0c5d43 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c072a24-dc29-48b0-9b97-68814c0c5d43 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-server-groups/2cf78093-e38a-454d-8bac-791b0dc2bfa8 HTTP/1.1 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:43.757636 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. Jul 30 21:08:43.759794 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2cf78093-e38a-454d-8bac-791b0dc2bfa8'} Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:43.760665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. Jul 30 21:08:43.762966 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:43.765978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c072a24-dc29-48b0-9b97-68814c0c5d43 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance group 2cf78093-e38a-454d-8bac-791b0dc2bfa8 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:43.766866 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c072a24-dc29-48b0-9b97-68814c0c5d43 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/2cf78093-e38a-454d-8bac-791b0dc2bfa8" status: 404 len: 117 microversion: 2.1 time: 0.034169 Jul 30 21:08:43.767708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:43.770892 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1085/2090] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:43 2022] DELETE /compute/v2.1/os-server-groups/2cf78093-e38a-454d-8bac-791b0dc2bfa8 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:43.776717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f17b425-34db-417e-abdf-ad17bae750e2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.555753 Jul 30 21:08:43.777641 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1006/2091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:43 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:43.791135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:43.791135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:43.791135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.791135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.791792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:43.791792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:43.798745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1311663659", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "6e933f29-0529-47aa-8c1a-d8e3316823fc"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:43.871425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] validate_networks() for [('6e933f29-0529-47aa-8c1a-d8e3316823fc', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:44.186117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:44.196801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6066a512-094e-471c-b499-e763b746554f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.424502 Jul 30 21:08:44.210029 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1086/2092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:43 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:44.215217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.215898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:44.222160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.222842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.223944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.224636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.506171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:44.517934 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21a07256-6416-4b74-878c-9685df7152b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.306375 Jul 30 21:08:44.518879 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1087/2093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:44 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:44.527977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f89b69ff-9ddd-41e5-a262-2c04dd3eb886 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.539995 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-f89b69ff-9ddd-41e5-a262-2c04dd3eb886 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f89b69ff-9ddd-41e5-a262-2c04dd3eb886 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-server-groups/7b47f27d-460d-4f60-9866-c40c4db62fed HTTP/1.1 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:44.541974 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. Jul 30 21:08:44.543628 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7b47f27d-460d-4f60-9866-c40c4db62fed'} Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:44.544798 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. Jul 30 21:08:44.546166 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.549196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f89b69ff-9ddd-41e5-a262-2c04dd3eb886 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance group 7b47f27d-460d-4f60-9866-c40c4db62fed could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:44.549196 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f89b69ff-9ddd-41e5-a262-2c04dd3eb886 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/7b47f27d-460d-4f60-9866-c40c4db62fed" status: 404 len: 117 microversion: 2.1 time: 0.022917 Jul 30 21:08:44.549196 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1088/2094] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:44 2022] DELETE /compute/v2.1/os-server-groups/7b47f27d-460d-4f60-9866-c40c4db62fed => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:44.553696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f41d2203-5e82-4729-a0a0-33a44bf2e580 req-db8317c9-483a-479a-9d95-a9ecb9631db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7db670dd-8d19-4776-b60b-9db4bafbec00", "tag": "5c1340f8-01af-4436-b452-821cf23296fb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:44.565622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f41d2203-5e82-4729-a0a0-33a44bf2e580 req-db8317c9-483a-479a-9d95-a9ecb9631db9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.566085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f41d2203-5e82-4729-a0a0-33a44bf2e580 req-db8317c9-483a-479a-9d95-a9ecb9631db9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.577115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f41d2203-5e82-4729-a0a0-33a44bf2e580 req-db8317c9-483a-479a-9d95-a9ecb9631db9 service nova] Creating event network-changed:5c1340f8-01af-4436-b452-821cf23296fb for instance 7db670dd-8d19-4776-b60b-9db4bafbec00 on nch1-master-1 Jul 30 21:08:44.581930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f41d2203-5e82-4729-a0a0-33a44bf2e580 req-db8317c9-483a-479a-9d95-a9ecb9631db9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 Jul 30 21:08:44.582663 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1089/2095] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:44.588476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.589437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:44.596097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.596801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.597593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.598045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.693280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:44.694894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:44.695896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:44.696898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:44.697536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:44.718753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.720010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.721022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.721868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.754888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Getting quotas for project 6193b7fd6d224f328a2b4c561edb89ea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:44.765496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Getting quotas for user eeb3ffbaef3347de8d9ad6b2bdfa19bc and project 6193b7fd6d224f328a2b4c561edb89ea. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:44.781630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:44.784561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:44.808948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:44.821441 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cccb290-c7cd-4921-96ec-ac221408ad64 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1507 microversion: 2.1 time: 0.236393 Jul 30 21:08:44.822385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1090/2096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:44 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:44.831919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d833835-f5ff-4abc-b5cc-d678b5803576 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.839105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4d833835-f5ff-4abc-b5cc-d678b5803576 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] HTTP exception thrown: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d833835-f5ff-4abc-b5cc-d678b5803576 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Request method failure captured: Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-server-groups/f10e771e-7c71-4e33-bfd9-633160804a9e HTTP/1.1 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2xv4vxGpZifmqytWX5PVV1g8fS9kFdmL6HElyfAULVcGoN6NdRiXmNeotf9GYWaxRzMv_sHlsE6EICPz_vIMzHsLMO3eH5DSBLCrlFIlsF58aI_ZJMER0eWkUnx_kpqdsn5_hK8GgjEB2zPdrUys_XpmW-RfPYm10y1TJq-gM9jRc Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:08:44.841542 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a502ca105b1344babf2e8d590de18198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a502ca105b1344babf2e8d590de18198", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a502ca105b1344babf2e8d590de18198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a502ca105b1344babf2e8d590de18198 Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerGroupTestJSON-845254107 Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8027664b7857430494e38fa27da60c75 Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerGroupTestJSON-845254107-project Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. Jul 30 21:08:44.843108 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'f10e771e-7c71-4e33-bfd9-633160804a9e'} Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:44.844317 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. Jul 30 21:08:44.845673 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:08:44.848087 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b8f86ec-3a9b-4f3d-b076-b3eeca74beda tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051393 Jul 30 21:08:44.848087 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1007/2097] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:44.849251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d833835-f5ff-4abc-b5cc-d678b5803576 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Returning 404 to user: Instance group f10e771e-7c71-4e33-bfd9-633160804a9e could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:08:44.850505 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d833835-f5ff-4abc-b5cc-d678b5803576 tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/f10e771e-7c71-4e33-bfd9-633160804a9e" status: 404 len: 117 microversion: 2.1 time: 0.022694 Jul 30 21:08:44.850946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c38b0edb-a579-4a16-b497-a819fe423a98 req-78d4fde9-206b-45a2-86eb-6ac7be746b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545981a3-0424-40b7-8988-54421b666879", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:44.852693 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1091/2098] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:44 2022] DELETE /compute/v2.1/os-server-groups/f10e771e-7c71-4e33-bfd9-633160804a9e => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:08:44.858199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.859459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:44.864820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c38b0edb-a579-4a16-b497-a819fe423a98 req-78d4fde9-206b-45a2-86eb-6ac7be746b47 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.865287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c38b0edb-a579-4a16-b497-a819fe423a98 req-78d4fde9-206b-45a2-86eb-6ac7be746b47 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.868957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.869766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.871047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.871829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.880251 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c38b0edb-a579-4a16-b497-a819fe423a98 req-78d4fde9-206b-45a2-86eb-6ac7be746b47 service nova] Creating event network-changed:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch1-master-1 Jul 30 21:08:44.886016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c38b0edb-a579-4a16-b497-a819fe423a98 req-78d4fde9-206b-45a2-86eb-6ac7be746b47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038446 Jul 30 21:08:44.897397 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1008/2099] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:44.919060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:44.922799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:44.938858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.940862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:44.943030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:44.944925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:45.275530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:45.298380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:45.308272 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3daeb538-d89a-4332-8802-0fdc3ff0f2f7 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.405762 Jul 30 21:08:45.309936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-998bfcb4-f05c-40b0-9ade-d61ce8187474 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.454806 Jul 30 21:08:45.313436 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1092/2100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:44 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:45.333844 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1009/2101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:44 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:45.340050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:45.348448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:45.356649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69692aa1-87b2-4333-a95f-77000ab6a214 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:45.357676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:45.358261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:45.358716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69692aa1-87b2-4333-a95f-77000ab6a214 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:45.359661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:45.362595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:45.430897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:45.455954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:45.487263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69692aa1-87b2-4333-a95f-77000ab6a214 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:45.500546 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69692aa1-87b2-4333-a95f-77000ab6a214 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1216 microversion: 2.1 time: 0.157768 Jul 30 21:08:45.502382 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1010/2102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:45 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:45.511561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-18b9ae2a-7808-4d29-8998-f84a8b46924d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:45.614973 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-18b9ae2a-7808-4d29-8998-f84a8b46924d tempest-ServerGroupTestJSON-845254107 tempest-ServerGroupTestJSON-845254107-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0" status: 204 len: 0 microversion: 2.1 time: 0.109197 Jul 30 21:08:45.619068 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1011/2103] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Jul 30 21:08:45 2022] DELETE /compute/v2.1/os-server-groups/2e367f57-e0c8-4a18-9cd6-2ef96a1756b0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:45.635835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:45.636214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:45.654720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:45.655321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:45.656917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:45.660385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.163139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:46.168281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:46.178571 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eb12dde1-07de-475a-baca-7381232dc702 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.551244 Jul 30 21:08:46.180181 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1012/2104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:45 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:46.186876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:46.190520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:46.221718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.223599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.225460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.227977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.303857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:46.313244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-88f962e1-52dc-4717-bedf-cf6012fe6c1a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 200 len: 1507 microversion: 2.1 time: 0.986605 Jul 30 21:08:46.322201 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1093/2105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:45 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 1507 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:46.342660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:46.343546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:46.353191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.357869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.358936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.359595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.517129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:46.528294 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e311360-d9f1-412d-a05a-6fa67725cfd9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.346577 Jul 30 21:08:46.528903 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1013/2106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:46 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:46.534756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:46.540804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:46.567849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.569591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.574409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.575013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.847754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:46.859213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e0e7de29-1360-4ee4-850e-56d9f3ec3d17 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.329109 Jul 30 21:08:46.865679 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1014/2107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:46 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:46.880085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:46.881067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:46.906999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.908521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.912178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:46.917570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:46.961477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:46.965420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:46.973133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cd343f3-9a5c-4479-acf7-cb1df3926d23 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.634800 Jul 30 21:08:46.977312 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1094/2108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:46 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:08:46.986946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-01bcc008-ca71-4b11-9fc2-77b7961eab60 req-8c4794af-9266-4147-98c2-f40c7511cea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5538e8db-43b5-45a5-a07a-26df1c6fbe68", "name": "network-vif-plugged", "status": "completed", "tag": "6a9986c5-365a-4b18-8efc-ec47155b4f0f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:47.024597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-01bcc008-ca71-4b11-9fc2-77b7961eab60 req-8c4794af-9266-4147-98c2-f40c7511cea9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.025977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-01bcc008-ca71-4b11-9fc2-77b7961eab60 req-8c4794af-9266-4147-98c2-f40c7511cea9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.061984 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-01bcc008-ca71-4b11-9fc2-77b7961eab60 req-8c4794af-9266-4147-98c2-f40c7511cea9 service nova] Creating event network-vif-plugged:6a9986c5-365a-4b18-8efc-ec47155b4f0f for instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 on nch2-master-1 Jul 30 21:08:47.069399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-01bcc008-ca71-4b11-9fc2-77b7961eab60 req-8c4794af-9266-4147-98c2-f40c7511cea9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089225 Jul 30 21:08:47.081755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1095/2109] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:47.087585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:47.094035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:47.106485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.108112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.109184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.110012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.167133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6eefe176-825d-43d2-a06d-c6cb87b0df88 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 204 len: 0 microversion: 2.1 time: 0.300264 Jul 30 21:08:47.172374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1015/2110] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:46 2022] DELETE /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:47.218975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:47.219635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:47.243315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.243315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.243315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.243315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.481804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:47.498105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4fa7af1-8603-4d46-b978-ae292485f136 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1274 microversion: 2.1 time: 0.414664 Jul 30 21:08:47.501040 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1096/2111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:47 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:47.514746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1347398388", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "e18630d2-267b-48ad-955d-1514746d6c6c"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:47.584931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:47.601604 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a2610b3-2bc5-4a67-810a-33eba23d9f6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.399954 Jul 30 21:08:47.673793 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1016/2112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:47 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:08:47.673793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:47.673793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:47.673793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.675778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:47.676019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] validate_networks() for [('e18630d2-267b-48ad-955d-1514746d6c6c', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:08:47.676666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:47.676666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:48.104976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:48.119806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e29e249-036c-43c8-bec1-dddd24c94a47 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.502926 Jul 30 21:08:48.134875 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1017/2113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:47 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:48.143137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:48.148237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:48.164887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:48.170537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:48.172292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:48.173050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:48.847941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:48.856768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1bac4fe7-cd83-4666-a125-8322f3991d92 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.720693 Jul 30 21:08:48.862834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1018/2114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:48 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:48.891821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:48.893031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:48.931425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:48.932112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:48.933097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:48.933752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:49.347847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:49.362953 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8fbcffa-0fa8-4534-ba45-c25fc9f5b9c2 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.498146 Jul 30 21:08:49.363978 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1019/2115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:48 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:49.408555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:49.410844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:49.447601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:49.448533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:49.449621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:49.450313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:49.669649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:49.677797 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b6f6b76-4fbe-4d07-a24f-4f36d9df02c9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.312699 Jul 30 21:08:49.699085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1020/2116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:49 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:49.704626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:49.706703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:49.722894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:49.723731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:49.724793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:49.725446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:49.956511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:49.971771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca352e00-5ab0-49aa-a7fe-2bd613f0982f tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1313 microversion: 2.1 time: 0.271080 Jul 30 21:08:49.992538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1021/2117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:49 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:50.013260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:50.015756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:50.047662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.049852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.052305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.057237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.755927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:50.767267 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5cc3c59d-3d16-486d-9088-c1ec1f12c166 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.773035 Jul 30 21:08:50.774851 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1022/2118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:49 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:50.788404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:50.789830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:50.821909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:08:50.822421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.822981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.823351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:08:50.823876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.824323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:08:50.824419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.825041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:08:50.825659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:08:50.841160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.841948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.842988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:50.843683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:50.866299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:08:50.875144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for user 2517a20b0358424480784b0003512d50 and project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:08:50.889759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:08:50.892437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:08:50.977598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4961966d-fe36-49c2-946c-1fc9017a46e0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.475331 Jul 30 21:08:50.979689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1097/2119] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:08:51.003858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:51.006095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:51.015965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.016839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:51.017932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.018659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:51.207662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:51.221334 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58d68481-99e5-4db5-b574-73dbcd4bd2ad tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.452325 Jul 30 21:08:51.224228 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1023/2120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:50 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:51.237894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:51.242456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:51.255839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:51.259712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.266322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:51.267467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.268816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:51.564863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:51.587102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e92cf56d-8222-4272-92d0-3952b86e02c0 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.598039 Jul 30 21:08:51.589318 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1098/2121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:50 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:51.605087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d098bb6-527d-4b64-b988-899215c8cb89 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:51.606092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2d098bb6-527d-4b64-b988-899215c8cb89 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:51.827247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2d098bb6-527d-4b64-b988-899215c8cb89 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:51.836958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2d098bb6-527d-4b64-b988-899215c8cb89 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1218 microversion: 2.1 time: 0.243997 Jul 30 21:08:51.838483 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1099/2122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:51 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:51.845614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:51.846583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:51.855654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.856704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:51.857804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:51.858480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.299352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:52.311608 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21688611-80b5-4b32-bb9a-17be616bb5a2 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1462 microversion: 2.1 time: 0.470870 Jul 30 21:08:52.322158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1100/2123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:51 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1462 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:52.324464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:52.325796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:52.341678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.342162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.342969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:52.348530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.349063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.354557 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39974108-9ef4-459e-873a-5992904c84b7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 1.126432 Jul 30 21:08:52.359487 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1024/2124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:51 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:52.369793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:52.370453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:52.382642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.383114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.383955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.384411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.597203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:52.606319 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-02a8a513-3a06-49a6-84d7-08e5ba2c4e7c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.291340 Jul 30 21:08:52.622531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1101/2125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:52 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:52.645759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8f25efea-7782-47c5-b4ed-2fcc5621276d req-45fd98f9-e92d-400f-825c-815f01d0fca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d028aca0-d3d0-4caf-8b0c-615ab599b649", "name": "network-vif-deleted", "tag": "e782bd19-ee42-40ec-b554-e87a125812a1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:52.672307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f25efea-7782-47c5-b4ed-2fcc5621276d req-45fd98f9-e92d-400f-825c-815f01d0fca6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.673582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f25efea-7782-47c5-b4ed-2fcc5621276d req-45fd98f9-e92d-400f-825c-815f01d0fca6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.695692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:52.705400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8f25efea-7782-47c5-b4ed-2fcc5621276d req-45fd98f9-e92d-400f-825c-815f01d0fca6 service nova] Creating event network-vif-deleted:e782bd19-ee42-40ec-b554-e87a125812a1 for instance d028aca0-d3d0-4caf-8b0c-615ab599b649 on nch2-master-1 Jul 30 21:08:52.705946 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f213d19-12ee-4383-8fbd-feff2ad2940e tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.345147 Jul 30 21:08:52.707049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1025/2126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:52 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:52.713672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8f25efea-7782-47c5-b4ed-2fcc5621276d req-45fd98f9-e92d-400f-825c-815f01d0fca6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088295 Jul 30 21:08:52.716440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1102/2127] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:52.729139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0a936e36-b20b-4831-8fee-83eac73d0fd7 req-4199e807-d928-4702-951c-c7280b35a77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14e6810-ef24-43f8-aeba-24b68b4aaa96", "tag": "baab9c05-9b08-4133-8984-10710b40a6f9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:52.744959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0a936e36-b20b-4831-8fee-83eac73d0fd7 req-4199e807-d928-4702-951c-c7280b35a77c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.745603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0a936e36-b20b-4831-8fee-83eac73d0fd7 req-4199e807-d928-4702-951c-c7280b35a77c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.762544 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0a936e36-b20b-4831-8fee-83eac73d0fd7 req-4199e807-d928-4702-951c-c7280b35a77c service nova] Creating event network-changed:baab9c05-9b08-4133-8984-10710b40a6f9 for instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 on nch2-master-1 Jul 30 21:08:52.768117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0a936e36-b20b-4831-8fee-83eac73d0fd7 req-4199e807-d928-4702-951c-c7280b35a77c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048504 Jul 30 21:08:52.769055 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1103/2128] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:52.775008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:52.775762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:52.783810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.784226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.785053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.785513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:52.940298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Calling method '.version_select at 0x7fbb628c2e50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:52.953485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:52.954419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.008677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.009507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.046991 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95296a4f-4a94-4240-ae44-219b43bcb85c tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/9ac2076b2db2419db452fab81b425dbf?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866" status: 200 len: 690 microversion: 2.1 time: 0.338693 Jul 30 21:08:53.052163 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1026/2129] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Jul 30 21:08:52 2022] GET /compute/v2.1/os-simple-tenant-usage/9ac2076b2db2419db452fab81b425dbf?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866 => generated 690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:53.066879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.067909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:53.079955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.083671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.084740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.089029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.225932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:53.237463 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14d16276-be97-4e6f-8fdc-e61f745ceb98 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1276 microversion: 2.1 time: 0.181591 Jul 30 21:08:53.239178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1027/2130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:53 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:53.252004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '.version_select at 0x7fbb628e6d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.270187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.270652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.281419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.282195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.295981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1029f149-3817-4446-bd30-c40d16c36e6a tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/9ac2076b2db2419db452fab81b425dbf?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866" status: 200 len: 690 microversion: 2.1 time: 0.055503 Jul 30 21:08:53.306725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1028/2131] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Jul 30 21:08:53 2022] GET /compute/v2.1/os-simple-tenant-usage/9ac2076b2db2419db452fab81b425dbf?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866 => generated 690 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:53.314330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Calling method '.version_select at 0x7fbb628a7160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.329623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.329623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.386112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.386698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.414861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:53.424969 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-01bfbd7e-af69-4d62-a17b-53cb21b388fe tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.654718 Jul 30 21:08:53.428057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1104/2132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:52 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:53.445601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.445601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:53.453098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.453573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.454370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.454821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.460895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:53.525085 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce6b5546-6878-41b3-b37c-69e18e0b3446 tempest-TenantUsagesTestJSON-108631475 tempest-TenantUsagesTestJSON-108631475-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866&detailed=1" status: 200 len: 26319 microversion: 2.1 time: 0.217017 Jul 30 21:08:53.536918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1029/2133] 10.222.0.17 () {58 vars in 1335 bytes} [Sat Jul 30 21:08:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-29T21%3A08%3A52.336866&end=2022-07-31T21%3A08%3A52.336866&detailed=1 => generated 26319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:08:53.568662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.569558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:53.580730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.581546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.582606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.583481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.639074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:53.786703 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-673a2696-b0a7-46fc-8da5-c066df5ec58e tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 204 len: 0 microversion: 2.1 time: 0.222256 Jul 30 21:08:53.791549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1030/2134] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:53 2022] DELETE /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:08:53.797163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:53.798094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:53.806194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.806671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:53.807791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:53.808352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.010276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.018659 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60641854-dfdc-4546-8f97-ceda91045084 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.228297 Jul 30 21:08:54.032018 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1031/2135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:53 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:54.037526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:54.038443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:54.050213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.050909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.052225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.052900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.086596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.098297 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df256080-5ee7-45eb-a9a0-4d9196d00d82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.666096 Jul 30 21:08:54.100488 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1105/2136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:53 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:54.112095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:54.115854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:54.135339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.138604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.139527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.141284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.197374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:54.233561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.245457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4aa7168-2568-40c4-b38c-2c1416888192 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.211637 Jul 30 21:08:54.261290 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1032/2137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:54 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:54.273632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:54.274592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:54.283753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.284485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.285452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.286284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.391063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.403109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-647f69f6-0840-4b9e-97ef-a85447c4573e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1276 microversion: 2.1 time: 0.136437 Jul 30 21:08:54.404301 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1033/2138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:54 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:54.454558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:54.455784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:54.469158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.471364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.473159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:54.475679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:54.504192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.523790 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-126190c7-6ad8-4700-8d1f-71d314164838 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1468 microversion: 2.1 time: 0.419040 Jul 30 21:08:54.530026 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1106/2139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:54 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1468 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:54.790431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:54.805620 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d07037a-b919-4fce-9cc0-bdd4a8b5cbae tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.356117 Jul 30 21:08:54.808085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1034/2140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:54 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:55.051928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:55.052584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:55.067091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.067608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.068608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.069076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.126583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:55.127353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:55.156394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.156798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.157599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.158432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.492657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:55.500266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=30 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:55.512486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-12e37bd2-9e9a-4558-b8ca-6811ef72e0d2 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.390245 Jul 30 21:08:55.521907 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1035/2141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:55 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:55.524311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bdb5e553-42c7-4c38-8853-053c4aa5c6e5 req-b86bf1e3-cd1c-4d85-8f9c-af2543296388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db670dd-8d19-4776-b60b-9db4bafbec00", "name": "network-vif-plugged", "status": "completed", "tag": "5c1340f8-01af-4436-b452-821cf23296fb"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:55.548573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bdb5e553-42c7-4c38-8853-053c4aa5c6e5 req-b86bf1e3-cd1c-4d85-8f9c-af2543296388 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.549171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bdb5e553-42c7-4c38-8853-053c4aa5c6e5 req-b86bf1e3-cd1c-4d85-8f9c-af2543296388 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.582959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bdb5e553-42c7-4c38-8853-053c4aa5c6e5 req-b86bf1e3-cd1c-4d85-8f9c-af2543296388 service nova] Creating event network-vif-plugged:5c1340f8-01af-4436-b452-821cf23296fb for instance 7db670dd-8d19-4776-b60b-9db4bafbec00 on nch1-master-1 Jul 30 21:08:55.598908 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bdb5e553-42c7-4c38-8853-053c4aa5c6e5 req-b86bf1e3-cd1c-4d85-8f9c-af2543296388 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080399 Jul 30 21:08:55.602182 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1036/2142] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:55.609068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:55.609910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:55.621722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.622254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.623139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.623721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.821918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:55.843063 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee618275-b670-420f-95ea-726021fed5cc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.792511 Jul 30 21:08:55.853515 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1107/2143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:55 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:55.871418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:55.873755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:55.891947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.892774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.893833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.894479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:55.935597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:55.949261 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d8ea05e2-51f8-4454-82b5-88619f2d9282 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.343672 Jul 30 21:08:55.951913 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1037/2144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:55 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:55.965847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:55.966536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:55.996218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:55.996683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:56.003976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:56.005845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:56.436474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:56.449026 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ab8be12-d689-491e-a188-ef01d1a263c9 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1468 microversion: 2.1 time: 0.493990 Jul 30 21:08:56.464528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1038/2145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:55 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1468 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:56.482941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:56.492902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:56.509459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:56.510140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:56.513651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:56.514296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:56.790727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:56.801505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c803d9da-515d-4fa6-9f0d-e2196b7397c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.335514 Jul 30 21:08:56.808285 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1039/2146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:56 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:56.818169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:56.818169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:56.830694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:56.831261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:56.832128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:56.832582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.101604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:57.141705 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff8a4149-e18c-4977-a24c-37a6d007d149 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 1.286577 Jul 30 21:08:57.164378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:57.172308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a40e6656-c070-4cb1-9bbe-ec4e0348186f tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.362089 Jul 30 21:08:57.184038 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1040/2147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:56 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:57.184038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:57.185770 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1108/2148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:55 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:57.208661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:57.213416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:57.214409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:57.223078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.224010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.224947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.226664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.239529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.239529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.239529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.240973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.459707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:57.472200 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-71c74abd-2471-4022-ad55-9f7f3a157392 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.294373 Jul 30 21:08:57.482009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1041/2149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:57 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:57.493284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:57.494615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:57.508640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.509324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.510370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.510969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.776886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:57.787649 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2b842e2-5061-4f95-a509-1051c909b671 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1316 microversion: 2.1 time: 0.597743 Jul 30 21:08:57.788420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1109/2150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:57 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:57.797391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-plugged", "status": "completed", "tag": "da571ea3-710d-4e17-955a-44cd2d11c0f5"}, {"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-plugged", "status": "completed", "tag": "a59110de-e042-44ca-adfe-8f07d6a2d4f5"}, {"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-plugged", "status": "completed", "tag": "7e0d5ab9-e506-4a2f-9756-658ee0fc42ff"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:57.825220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.825996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.847096 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Creating event network-vif-plugged:da571ea3-710d-4e17-955a-44cd2d11c0f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:57.853724 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Creating event network-vif-plugged:a59110de-e042-44ca-adfe-8f07d6a2d4f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:57.854568 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] Creating event network-vif-plugged:7e0d5ab9-e506-4a2f-9756-658ee0fc42ff for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:08:57.867392 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1d3a08cd-d628-4065-8821-a493d048c5ef req-6b15d0c5-7f48-49d6-93c1-7f542a1e5e1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.075424 Jul 30 21:08:57.868669 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1110/2151] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:57.881684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:57.884021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:57.888657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:57.897859 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df04551b-54de-45cf-b847-acc37fdb1e10 tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1468 microversion: 2.1 time: 0.414465 Jul 30 21:08:57.901013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.911374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1042/2152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:57 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1468 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:57.913500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:57.915584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:57.917297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:58.202478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:58.204224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:58.222645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:58.223123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:58.223972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:58.224420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:58.853231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:58.878244 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-772279dd-666c-49b4-ab17-cea53d8d80fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.674479 Jul 30 21:08:58.878865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1043/2153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:58 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:08:58.900442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:58.900442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:58.918938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:58.919518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:58.920341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:58.920795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.165070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:59.178812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8db0598d-9221-4331-954d-2d6e88229905 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 1.306207 Jul 30 21:08:59.180373 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1111/2154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:57 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:59.185515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.186685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.195114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.196729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.197894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.198490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.341287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:59.356108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9fe28e3d-89e1-42eb-9653-20b7874b205c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.470959 Jul 30 21:08:59.357797 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1044/2155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:58 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:59.363269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-be78c3d0-207d-40bc-9ffb-bf56dafd6152 req-9567922b-5510-46e5-a5f2-b018fd4bb594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5538e8db-43b5-45a5-a07a-26df1c6fbe68", "name": "network-vif-deleted", "tag": "6a9986c5-365a-4b18-8efc-ec47155b4f0f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:08:59.375834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-be78c3d0-207d-40bc-9ffb-bf56dafd6152 req-9567922b-5510-46e5-a5f2-b018fd4bb594 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.376687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-be78c3d0-207d-40bc-9ffb-bf56dafd6152 req-9567922b-5510-46e5-a5f2-b018fd4bb594 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.390139 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-be78c3d0-207d-40bc-9ffb-bf56dafd6152 req-9567922b-5510-46e5-a5f2-b018fd4bb594 service nova] Creating event network-vif-deleted:6a9986c5-365a-4b18-8efc-ec47155b4f0f for instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 on nch2-master-1 Jul 30 21:08:59.395382 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-be78c3d0-207d-40bc-9ffb-bf56dafd6152 req-9567922b-5510-46e5-a5f2-b018fd4bb594 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036012 Jul 30 21:08:59.396701 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1045/2156] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:59.407685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.408653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.426487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.426959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.428138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.429312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.437507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:59.565686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:59.574507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df477531-9b2a-4f28-b6f3-e55e89f113f5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.392816 Jul 30 21:08:59.575628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1112/2157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:59.581627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.582456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.590687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.591529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.592587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.593170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.609592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:59.621527 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39dc3bbc-45c3-4ece-8cd5-f2ee2675f8e9 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1505 microversion: 2.1 time: 0.223227 Jul 30 21:08:59.622111 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1046/2158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:59.634043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.635378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.635983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lazy-loading 'fault' on Instance uuid 5538e8db-43b5-45a5-a07a-26df1c6fbe68 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:08:59.648205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.648924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.656803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.657518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.658473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.659064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.690300 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50082715-d1d8-4100-8752-6e5b4311f8c5 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips" status: 200 len: 109 microversion: 2.1 time: 0.047891 Jul 30 21:08:59.690902 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1047/2159] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips => generated 109 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:08:59.691655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9de4db5d7a487fa26b3138d1158f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac2076b2db2419db452fab81b425dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:08:59.704178 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d32b1d32-ce51-410c-a3c8-943851fcb7fd tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 200 len: 1303 microversion: 2.1 time: 0.127276 Jul 30 21:08:59.704849 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1113/2160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:08:59.718095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.718619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.725468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.725952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.729766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.729766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.753361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9999133-eecb-4429-904e-a8743363cf75 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips" status: 200 len: 109 microversion: 2.1 time: 0.039124 Jul 30 21:08:59.754476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1048/2161] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:08:59.765868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.766377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.772726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.773311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.774200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.774654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.801630 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-310eeec7-7f94-4575-b16b-c1e9113ddc3c tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips/tempest-ServerAddressesTestJSON-1610809021-network" status: 200 len: 94 microversion: 2.1 time: 0.039628 Jul 30 21:08:59.802240 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1114/2162] 10.222.0.17 () {58 vars in 1401 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00/ips/tempest-ServerAddressesTestJSON-1610809021-network => generated 94 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:08:59.815048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.815692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.824097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.824842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.825941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.826609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.854902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:08:59.908724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:08:59.909814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:08:59.916747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.917538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.918598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:08:59.919367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:08:59.965047 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26db1660-388e-4da9-b0ec-e600bf2db214 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 204 len: 0 microversion: 2.1 time: 0.152819 Jul 30 21:08:59.965972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1049/2163] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:08:59 2022] DELETE /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:08:59.973623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-df7197e9-9adf-4007-b96e-4dcf4ba9dffd req-2239af57-3316-4666-9220-4488167a5356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545981a3-0424-40b7-8988-54421b666879", "name": "network-vif-plugged", "status": "completed", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:00.011402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-df7197e9-9adf-4007-b96e-4dcf4ba9dffd req-2239af57-3316-4666-9220-4488167a5356 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.012593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-df7197e9-9adf-4007-b96e-4dcf4ba9dffd req-2239af57-3316-4666-9220-4488167a5356 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.047547 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-df7197e9-9adf-4007-b96e-4dcf4ba9dffd req-2239af57-3316-4666-9220-4488167a5356 service nova] Creating event network-vif-plugged:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch1-master-1 Jul 30 21:09:00.059830 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-df7197e9-9adf-4007-b96e-4dcf4ba9dffd req-2239af57-3316-4666-9220-4488167a5356 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091739 Jul 30 21:09:00.067540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1050/2164] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:00.076851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:00.077682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:00.088243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.092625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.092625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.092625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.133049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:00.141049 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-651c7591-0526-4da7-8261-3944f82eb423 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.236605 Jul 30 21:09:00.156750 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1115/2165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:08:59 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:09:00.208623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:00.209974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:00.241483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.242041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.242880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.243356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.286999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:00.312187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-91213b4a-800c-4659-a2c3-d1daff90ecae tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1511 microversion: 2.1 time: 0.243140 Jul 30 21:09:00.328590 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1051/2166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:00 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:00.380694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:00.381320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:00.388400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.390290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.391478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.391937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.442554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:00.454125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-591edcc7-26ef-4e91-975e-aa43725491b5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1354 microversion: 2.1 time: 0.249532 Jul 30 21:09:00.455190 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1116/2167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:00 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:09:00.545226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:00.556682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-048ca48a-2afa-48e4-b3e7-5f778e9ff7aa tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.179855 Jul 30 21:09:00.560006 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1052/2168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:00 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:00.595962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:00.596962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:00.603628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.604352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.605321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.606078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.725541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:00.726692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] [instance: 5538e8db-43b5-45a5-a07a-26df1c6fbe68] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:00.737205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.738283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.739344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:00.739557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:00.756947 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] HTTP exception thrown: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Request method failure captured: Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 HTTP/1.1 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z3IJA7G3BI-53OEDo6OozcSbm_XKhbyTBrm3f1TZyMCTcagxhESiq54raCrTfgBu7EoiKdbRUWdB-1e7W7lV4VlVuFEVPl3ysyOYL_OFa_g8BJUSWfb-ipqdpVxKW8c84mB0Y7XzFudhCOM4XZuFUqJ0DlSnUCLSn3ZfcVWAI0QrK8 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 9ac2076b2db2419db452fab81b425dbf Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TenantUsagesTestJSON-1557357255 Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:00.772628 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9ac2076b2db2419db452fab81b425dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9ac2076b2db2419db452fab81b425dbf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ac2076b2db2419db452fab81b425dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ac2076b2db2419db452fab81b425dbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TenantUsagesTestJSON-1557357255 Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 9ac2076b2db2419db452fab81b425dbf Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1557357255 Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TenantUsagesTestJSON-1557357255-project Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cd9de4db5d7a487fa26b3138d1158f33 Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TenantUsagesTestJSON-1557357255-project Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. Jul 30 21:09:00.773855 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '5538e8db-43b5-45a5-a07a-26df1c6fbe68'} Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:00.774595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. Jul 30 21:09:00.776527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:00.778632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Returning 404 to user: Instance 5538e8db-43b5-45a5-a07a-26df1c6fbe68 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:00.779774 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68" status: 404 len: 111 microversion: 2.1 time: 0.058475 Jul 30 21:09:00.781757 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1053/2169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:00 2022] GET /compute/v2.1/servers/5538e8db-43b5-45a5-a07a-26df1c6fbe68 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:09:00.799806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:00.813188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-747567c0-3ad9-46e7-9762-0737e352d97c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.220941 Jul 30 21:09:00.830105 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1117/2170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:00 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:01.116330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:01.117422 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80045b59-a746-4b55-9c9d-5f069974221d tempest-TenantUsagesTestJSON-1557357255 tempest-TenantUsagesTestJSON-1557357255-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001513 Jul 30 21:09:01.124991 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1054/2171] 10.222.0.17 () {56 vars in 886 bytes} [Sat Jul 30 21:09:01 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 30 21:09:01.165210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:01.166386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:01.169777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:01.184584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.188241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.189275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.191719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.343755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:01.344789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:01.378503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.380038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.380950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.386182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.607376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:01.615689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de3de083-e9f2-4980-8105-c753ff3a0ab3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.455612 Jul 30 21:09:01.616649 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1118/2172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:01 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:01.621421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c2bf37d3-ebc7-4128-8f23-6a9f51f36771 req-65f0e3a0-2255-4137-8e19-46bfff471fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f4af92-7e39-4b71-9cd1-952ce0c8e42f", "tag": "8f18a742-6484-4954-9a1a-04574afb6edc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:01.631210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2bf37d3-ebc7-4128-8f23-6a9f51f36771 req-65f0e3a0-2255-4137-8e19-46bfff471fcb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.631993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2bf37d3-ebc7-4128-8f23-6a9f51f36771 req-65f0e3a0-2255-4137-8e19-46bfff471fcb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.645591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c2bf37d3-ebc7-4128-8f23-6a9f51f36771 req-65f0e3a0-2255-4137-8e19-46bfff471fcb service nova] Creating event network-changed:8f18a742-6484-4954-9a1a-04574afb6edc for instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f on nch1-master-1 Jul 30 21:09:01.651833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c2bf37d3-ebc7-4128-8f23-6a9f51f36771 req-65f0e3a0-2255-4137-8e19-46bfff471fcb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Jul 30 21:09:01.656434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1119/2173] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:01.661989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:01.663042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:01.670108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.670576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.671417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.672023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.836597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:01.880996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:01.893109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b2440bc9-a4a5-4e92-b642-7ff5a7ad7821 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1511 microversion: 2.1 time: 0.553114 Jul 30 21:09:01.898189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1055/2174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:01 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:01.907708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:01.908547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:01.924837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.926472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:01.932914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:01.933607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.147482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:02.157695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6991eb12-c8bc-43aa-a461-b1fa45f88e48 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1803 microversion: 2.1 time: 0.499807 Jul 30 21:09:02.168388 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1120/2175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:01 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1803 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:02.173562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:02.174381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:02.185713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.190950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.192078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.192987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.333623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:02.343233 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68e5a8f4-59fd-4b29-ab61-8b1231fd4261 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.443547 Jul 30 21:09:02.350208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1056/2176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:01 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:02.361132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-32b930c3-d3b3-4c7f-8b52-5809605ebecb req-c15afa7a-8de3-4ce4-814b-6ef0cdf1c426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14e6810-ef24-43f8-aeba-24b68b4aaa96", "name": "network-vif-plugged", "status": "completed", "tag": "baab9c05-9b08-4133-8984-10710b40a6f9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:02.387667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-32b930c3-d3b3-4c7f-8b52-5809605ebecb req-c15afa7a-8de3-4ce4-814b-6ef0cdf1c426 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.388320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-32b930c3-d3b3-4c7f-8b52-5809605ebecb req-c15afa7a-8de3-4ce4-814b-6ef0cdf1c426 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.416104 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-32b930c3-d3b3-4c7f-8b52-5809605ebecb req-c15afa7a-8de3-4ce4-814b-6ef0cdf1c426 service nova] Creating event network-vif-plugged:baab9c05-9b08-4133-8984-10710b40a6f9 for instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 on nch2-master-1 Jul 30 21:09:02.424718 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-32b930c3-d3b3-4c7f-8b52-5809605ebecb req-c15afa7a-8de3-4ce4-814b-6ef0cdf1c426 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072121 Jul 30 21:09:02.427800 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1057/2177] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:02.446195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:02.448386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:02.463068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.463656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.464528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.466251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.554727 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c8b9cc7-9699-43f2-a3ce-1076913bd287 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055/ips" status: 200 len: 217 microversion: 2.1 time: 0.124816 Jul 30 21:09:02.559326 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1058/2178] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:09:02 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055/ips => generated 217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:02.576050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:02.582311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:02.605610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.606251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.607206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.607792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.702829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:09:02.865221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:02.875823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c26e982-9cd9-4744-a361-8401d8bb506c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1313 microversion: 2.1 time: 0.705992 Jul 30 21:09:02.880703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1121/2179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:02 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:02.893991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:02.895925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:02.923193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:02.925193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.934321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.936043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.937048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.939496 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34c4cdcf-e492-40cd-aa24-dc433eb34772 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 204 len: 0 microversion: 2.1 time: 0.369596 Jul 30 21:09:02.940434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1059/2180] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:09:02 2022] DELETE /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:02.952068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:02.952807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:02.971540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.972968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:02.973874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:02.987510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.254040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:03.268355 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d14e8e41-ae06-4a7d-aa32-f446ed36d404 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1511 microversion: 2.1 time: 0.324193 Jul 30 21:09:03.272126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1060/2181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:02 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:03.294593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:03.295014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:03.314573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.315046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.315889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.321498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.335038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:03.348858 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e1e32a48-5225-4c5d-b88c-282132f205fe tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1316 microversion: 2.1 time: 0.466739 Jul 30 21:09:03.352030 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1122/2182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:02 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:03.381404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:03.383147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:03.398938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:03.404421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.405167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.406176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.417926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.694379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:03.712889 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7fdb455-5767-449c-84b9-d972fa327f5e tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1809 microversion: 2.1 time: 0.431864 Jul 30 21:09:03.714114 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1061/2183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:03 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1809 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:03.780379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b1c155ee-41fa-433c-bf2d-72faf64deff8 req-a49d95d7-cbf9-4706-8b6e-9c5a99f99f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db670dd-8d19-4776-b60b-9db4bafbec00", "name": "network-vif-deleted", "tag": "5c1340f8-01af-4436-b452-821cf23296fb"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:03.809390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1c155ee-41fa-433c-bf2d-72faf64deff8 req-a49d95d7-cbf9-4706-8b6e-9c5a99f99f73 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.815244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1c155ee-41fa-433c-bf2d-72faf64deff8 req-a49d95d7-cbf9-4706-8b6e-9c5a99f99f73 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.862537 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b1c155ee-41fa-433c-bf2d-72faf64deff8 req-a49d95d7-cbf9-4706-8b6e-9c5a99f99f73 service nova] Creating event network-vif-deleted:5c1340f8-01af-4436-b452-821cf23296fb for instance 7db670dd-8d19-4776-b60b-9db4bafbec00 on nch1-master-1 Jul 30 21:09:03.890191 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b1c155ee-41fa-433c-bf2d-72faf64deff8 req-a49d95d7-cbf9-4706-8b6e-9c5a99f99f73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118527 Jul 30 21:09:03.893047 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1062/2184] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:09:03.918372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:03.919164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:03.930761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.931272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.932468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:03.933030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:03.969136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:03.978358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e20c8c23-bec4-4103-8f6b-97dd669e8917 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.603406 Jul 30 21:09:03.994272 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1123/2185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:03 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:04.211041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:04.222389 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a3b188e-aaa1-4396-bbc4-82be46618616 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1461 microversion: 2.1 time: 0.318449 Jul 30 21:09:04.223195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1063/2186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:03 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1461 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:04.245027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:04.247326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:04.254642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:04.255120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:04.257223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:04.257939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:04.302399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:04.374389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:04.382944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:09:04.391422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:04.392084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:04.392798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:04.393538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:04.394248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:04.400165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:04.543956 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-988186ac-97a1-41dc-82c1-63416dae2cb6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879/action" status: 202 len: 0 microversion: 2.1 time: 0.302514 Jul 30 21:09:04.549679 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1064/2187] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:04 2022] POST /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:09:04.562834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:04.564136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:04.584342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:04.586253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:04.587389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:04.588115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:04.778971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ea56e83-2af3-403f-9a85-56d8795256fc tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Calling method '.version_select at 0x7fbb5c64e160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:05.001988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32ef1b0626a4e8ba78cf5d60d5cba07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab77ff72721c4579b8e48346f7d98842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:05.010045 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48659a13-de1a-4e55-b9e0-485cfc0040fd tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 200 len: 1301 microversion: 2.1 time: 0.460314 Jul 30 21:09:05.023560 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1065/2188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:04 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 1301 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:05.030260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:05.031080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:05.039939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.040603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.042058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.042762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.151451 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ea56e83-2af3-403f-9a85-56d8795256fc tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.914574 Jul 30 21:09:05.160274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1124/2189] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:09:04 2022] GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf/defaults => generated 371 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:05.165807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:05.167181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:05.174247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.174901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.192024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.192973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.261348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:05.368998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:05.389744 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6a014291-3601-4472-91ea-694f3278f630 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1504 microversion: 2.1 time: 0.376759 Jul 30 21:09:05.390268 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1066/2190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:05 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:05.403084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:05.410079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:05.424632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.425804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.426925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.427424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.700198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:05.709229 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f9ac7ed-7284-41a2-96b0-251d6dcec53b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1470 microversion: 2.1 time: 0.547718 Jul 30 21:09:05.711992 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1125/2191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:05 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:05.720231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:05.727022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:05.736875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.741958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.743087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:05.745237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:05.753091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:05.761766 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-840c777a-b939-4223-b073-c1ba4306b5c6 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1809 microversion: 2.1 time: 0.370453 Jul 30 21:09:05.766634 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1067/2192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:05 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1809 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:05.782816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74d1fca3-f3bd-4242-a982-da6f7cd4b6b4 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Calling method '.version_select at 0x7fbb6291f160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:06.165497 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74d1fca3-f3bd-4242-a982-da6f7cd4b6b4 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf" status: 200 len: 371 microversion: 2.1 time: 0.391765 Jul 30 21:09:06.179181 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1068/2193] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:09:05 2022] GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf => generated 371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:06.192887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879826669"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:06.193722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:06.211459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.213518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:06.216456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.217157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:06.504995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:06.520666 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa26f0a8-c313-465f-b621-3c3e14e48f6d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.806400 Jul 30 21:09:06.521279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1126/2194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:05 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:06.542479 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Adding security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 to port baab9c05-9b08-4133-8984-10710b40a6f9 Jul 30 21:09:06.543749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:06.544440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] [instance: 7db670dd-8d19-4776-b60b-9db4bafbec00] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:06.557778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.558234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:06.559087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.559576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:06.598477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] HTTP exception thrown: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Request method failure captured: Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 HTTP/1.1 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z3QEueYyTsLqoIYchjKS9BdRnms58_MAz74zqByRjVUAsMSrIAFFXeB5njW5iMsr-lA9PqGtFHeF4r_L_lzFHUrwTbyNUq1eIcZK-c4DU_0uK0Nip01Lx1WCtKuzYdNN9TyjaRVRh5i6rTIGTrPuxZogECmhHxlf_Nc8qSh69knOTE Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ab77ff72721c4579b8e48346f7d98842 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerAddressesTestJSON-193298551 Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:09:06.600449 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab77ff72721c4579b8e48346f7d98842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab77ff72721c4579b8e48346f7d98842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab77ff72721c4579b8e48346f7d98842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab77ff72721c4579b8e48346f7d98842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerAddressesTestJSON-193298551 Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ab77ff72721c4579b8e48346f7d98842 Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerAddressesTestJSON-193298551 Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerAddressesTestJSON-193298551-project Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e32ef1b0626a4e8ba78cf5d60d5cba07 Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerAddressesTestJSON-193298551-project Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. Jul 30 21:09:06.602048 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7db670dd-8d19-4776-b60b-9db4bafbec00'} Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:06.602817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. Jul 30 21:09:06.603896 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:06.607782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] Returning 404 to user: Instance 7db670dd-8d19-4776-b60b-9db4bafbec00 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:06.612333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bffa14b8-718e-476a-af5c-f192c3e969d2 tempest-ServerAddressesTestJSON-193298551 tempest-ServerAddressesTestJSON-193298551-project] 10.222.0.17 "GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00" status: 404 len: 111 microversion: 2.1 time: 0.090060 Jul 30 21:09:06.613433 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1127/2195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:06 2022] GET /compute/v2.1/servers/7db670dd-8d19-4776-b60b-9db4bafbec00 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:06.624259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50e4bc6d-a5c5-407d-ae3b-f93625559b1d tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Calling method '.version_select at 0x7fbb5c655ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:06.705432 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50e4bc6d-a5c5-407d-ae3b-f93625559b1d tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.090576 Jul 30 21:09:06.706828 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1128/2196] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:09:06 2022] GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf/defaults => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:06.721138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c99b51e0-0832-44d1-a73b-89bc22458165 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Calling method '.version_select at 0x7fbb5c655f70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:06.873837 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c99b51e0-0832-44d1-a73b-89bc22458165 tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf" status: 200 len: 371 microversion: 2.1 time: 0.156989 Jul 30 21:09:06.878703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1129/2197] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:09:06 2022] GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:06.890842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:06.895327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:06.911884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.912724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:06.914423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:06.918008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.202669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:08.222089 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a5a84b45-772e-497d-a773-d9c3b389a9f6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1470 microversion: 2.1 time: 1.341837 Jul 30 21:09:08.222989 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1130/2198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:06 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1470 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:08.237826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:08.238700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:08.246887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.260109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.261215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.261841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.596041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:08.612741 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3360e83c-ea2d-4ba5-865f-9628f2fe8cbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1788 microversion: 2.1 time: 0.388552 Jul 30 21:09:08.616047 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1131/2199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:08 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1788 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:08.627898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b30c86b2-1298-4568-947d-ce6a72c17516 req-6ccd2f11-8cd4-4161-919b-9524442d8015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-unplugged", "status": "completed", "tag": "da571ea3-710d-4e17-955a-44cd2d11c0f5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:08.650197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b30c86b2-1298-4568-947d-ce6a72c17516 req-6ccd2f11-8cd4-4161-919b-9524442d8015 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.650621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b30c86b2-1298-4568-947d-ce6a72c17516 req-6ccd2f11-8cd4-4161-919b-9524442d8015 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.682045 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b30c86b2-1298-4568-947d-ce6a72c17516 req-6ccd2f11-8cd4-4161-919b-9524442d8015 service nova] Creating event network-vif-unplugged:da571ea3-710d-4e17-955a-44cd2d11c0f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:09:08.699146 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b30c86b2-1298-4568-947d-ce6a72c17516 req-6ccd2f11-8cd4-4161-919b-9524442d8015 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079535 Jul 30 21:09:08.700093 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1132/2200] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:08.707301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-34aab76d-bb01-4042-8dce-1ffad847b0eb tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] Calling method '.version_select at 0x7fbb5c6551f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:08.777287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49b0aa9a-c9f1-4532-94d4-af408734ecb7 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action" status: 202 len: 0 microversion: 2.1 time: 2.596303 Jul 30 21:09:08.777900 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1069/2201] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:06 2022] POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action => generated 0 bytes in 2598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:08.784638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7dc5574b-f0c4-45e2-8736-692a0ecaf2ad tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb628c4280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:08.872843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7dc5574b-f0c4-45e2-8736-692a0ecaf2ad tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659" status: 200 len: 637 microversion: 2.1 time: 0.093673 Jul 30 21:09:08.881095 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1070/2202] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:09:08 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659 => generated 637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:08.895059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6ad2920e-e56c-46aa-b39b-09a77ff8e3c2 req-bfb2f642-1bde-48ae-8ffc-19fcf14c019f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-deleted", "tag": "a59110de-e042-44ca-adfe-8f07d6a2d4f5"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:08.908283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-34aab76d-bb01-4042-8dce-1ffad847b0eb tempest-QuotasTestJSON-2110181646 tempest-QuotasTestJSON-2110181646-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf?user_id=f4cd985d3acd49198bcf8b3356acc9ad" status: 200 len: 371 microversion: 2.1 time: 0.205922 Jul 30 21:09:08.911233 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1133/2203] 10.222.0.17 () {58 vars in 1323 bytes} [Sat Jul 30 21:09:08 2022] GET /compute/v2.1/os-quota-sets/01e07746fe614f5ca3dcf9cafa96e7bf?user_id=f4cd985d3acd49198bcf8b3356acc9ad => generated 371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:08.927103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:08.928327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:08.938723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.939503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.940466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.941002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6ad2920e-e56c-46aa-b39b-09a77ff8e3c2 req-bfb2f642-1bde-48ae-8ffc-19fcf14c019f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:08.941355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.941465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6ad2920e-e56c-46aa-b39b-09a77ff8e3c2 req-bfb2f642-1bde-48ae-8ffc-19fcf14c019f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:08.970353 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6ad2920e-e56c-46aa-b39b-09a77ff8e3c2 req-bfb2f642-1bde-48ae-8ffc-19fcf14c019f service nova] Creating event network-vif-deleted:a59110de-e042-44ca-adfe-8f07d6a2d4f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:09:08.996847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6ad2920e-e56c-46aa-b39b-09a77ff8e3c2 req-bfb2f642-1bde-48ae-8ffc-19fcf14c019f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114390 Jul 30 21:09:08.997487 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1071/2204] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:09.007644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6289c4c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:09.712782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:09.735153 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b679097-531e-48a0-85a9-5b1f8457b8c0 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.818654 Jul 30 21:09:09.736524 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1134/2205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:08 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:09.755050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-46ad79d1-da59-4eb4-bd68-8b3188250ade req-801e9650-ca0c-4292-be91-6069f653e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14e6810-ef24-43f8-aeba-24b68b4aaa96", "tag": "baab9c05-9b08-4133-8984-10710b40a6f9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:09.786712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-46ad79d1-da59-4eb4-bd68-8b3188250ade req-801e9650-ca0c-4292-be91-6069f653e4cd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:09.788921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-46ad79d1-da59-4eb4-bd68-8b3188250ade req-801e9650-ca0c-4292-be91-6069f653e4cd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:09.819138 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-46ad79d1-da59-4eb4-bd68-8b3188250ade req-801e9650-ca0c-4292-be91-6069f653e4cd service nova] Creating event network-changed:baab9c05-9b08-4133-8984-10710b40a6f9 for instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 on nch2-master-1 Jul 30 21:09:09.824116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use.", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:09.825369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.825369 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.839189 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-46ad79d1-da59-4eb4-bd68-8b3188250ade req-801e9650-ca0c-4292-be91-6069f653e4cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095824 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 HTTP/1.1 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:09.840840 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: exception: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.842135 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f93ae01e-4f7b-4ad1-b54d-264c8bbd1950'} Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:09.842783 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.843829 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:09.844744 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] Jul 30 21:09:09.845768 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:09.846058 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1135/2206] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:09.847869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 400 to user: Security Group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 in use. Jul 30 21:09:09.847869 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7f0502fa-25ac-42ba-bf07-4dcf3462c705'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:09.849060 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8abee174-1203-487f-a528-ebe166b1258c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950" status: 400 len: 185 microversion: 2.1 time: 0.845858 Jul 30 21:09:09.849835 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1072/2207] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:08 2022] DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 => generated 185 bytes in 852 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:09:09.856816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:09.857782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47726469-916e-48ac-8e2a-54c6729d8e38 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb5c64ee50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:09.859461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:09.876183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:09.878239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:09.893395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:09.896502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:09.980849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-47726469-916e-48ac-8e2a-54c6729d8e38 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:09.997974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-47726469-916e-48ac-8e2a-54c6729d8e38 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:10.499399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47726469-916e-48ac-8e2a-54c6729d8e38 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.654697 Jul 30 21:09:10.500203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:10.505531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1136/2208] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:09 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:10.509632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e3586737-a30a-4d47-a603-fd7fc4e22aa6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1470 microversion: 2.1 time: 0.658309 Jul 30 21:09:10.511725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:10.512486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:10.528471 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1073/2209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:09 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1470 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:10.532756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:10.533244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:10.534213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:10.534680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:10.535507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:10.538078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:10.552022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:10.552744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:10.553729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:10.554371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:10.735321 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70276c1e-552a-4812-85e1-3c5574f91dbc tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action" status: 202 len: 0 microversion: 2.1 time: 0.205037 Jul 30 21:09:10.736178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1074/2210] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:10 2022] POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:10.743039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0979981e-5ea8-4dde-b794-d358233ca747 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb628baee0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:11.190265 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0979981e-5ea8-4dde-b794-d358233ca747 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "DELETE /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.452617 Jul 30 21:09:11.191253 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1075/2211] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:09:10 2022] DELETE /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_version => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:11.198154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:11.198904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:11.223444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.232534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.234754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.239254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.558919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:11.561793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:11.568085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a8e0574-8792-4fac-af4a-c0f668673d5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 200 len: 1653 microversion: 2.1 time: 1.061417 Jul 30 21:09:11.570709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7f1e73f-7541-4fa0-bdbe-46d97b609da6 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1574 microversion: 2.1 time: 0.377979 Jul 30 21:09:11.572716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1076/2212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:11 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1574 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:11.582119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:11.589524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:11.591962 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1137/2213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:10 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 1653 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:11.600816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-unplugged", "status": "completed", "tag": "7e0d5ab9-e506-4a2f-9756-658ee0fc42ff"}, {"server_uuid": "a5f4af92-7e39-4b71-9cd1-952ce0c8e42f", "name": "network-vif-plugged", "status": "completed", "tag": "8f18a742-6484-4954-9a1a-04574afb6edc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:11.602620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.609781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.611130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.614530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.634539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.640949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.674120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] Creating event network-vif-unplugged:7e0d5ab9-e506-4a2f-9756-658ee0fc42ff for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:09:11.675647 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] Creating event network-vif-plugged:8f18a742-6484-4954-9a1a-04574afb6edc for instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f on nch1-master-1 Jul 30 21:09:11.686243 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e6badd45-73b7-4501-b239-d45df334d669 req-75c6839b-42ca-4f78-8f93-1e9bdf36174f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.089767 Jul 30 21:09:11.695218 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1138/2214] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:11.714913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f61ef4c3-7a2b-4258-852b-1fa78ee4a300 req-6102c42b-6458-41d8-a48a-a0874b765eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-deleted", "tag": "7e0d5ab9-e506-4a2f-9756-658ee0fc42ff"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:11.728380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f61ef4c3-7a2b-4258-852b-1fa78ee4a300 req-6102c42b-6458-41d8-a48a-a0874b765eb9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.729198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f61ef4c3-7a2b-4258-852b-1fa78ee4a300 req-6102c42b-6458-41d8-a48a-a0874b765eb9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.777507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f61ef4c3-7a2b-4258-852b-1fa78ee4a300 req-6102c42b-6458-41d8-a48a-a0874b765eb9 service nova] Creating event network-vif-deleted:7e0d5ab9-e506-4a2f-9756-658ee0fc42ff for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:09:11.789205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f61ef4c3-7a2b-4258-852b-1fa78ee4a300 req-6102c42b-6458-41d8-a48a-a0874b765eb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079439 Jul 30 21:09:11.790765 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1139/2215] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:11.817737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a52f86c-3317-4a42-977a-99cd61901b3d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb62917040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:11.912936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a52f86c-3317-4a42-977a-99cd61901b3d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 37 microversion: 2.1 time: 0.118838 Jul 30 21:09:11.920859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1140/2216] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:09:11 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 37 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:11.930067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:11.930067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:11.962403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.963056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:11.964097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:11.964680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:12.080536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:12.136303 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1dc7c61-d2dc-41b9-9712-05f65a34d552 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.560618 Jul 30 21:09:12.138155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1077/2217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:11 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:12.149405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ed2bba8-fcc1-4faf-b0bb-f262f5b810dd tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb6289c3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:12.248781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8ed2bba8-fcc1-4faf-b0bb-f262f5b810dd tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:12.255996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8ed2bba8-fcc1-4faf-b0bb-f262f5b810dd tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:12.474929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:12.493680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a19eeb73-7192-467c-9e41-fa9ac98fe173 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.571473 Jul 30 21:09:12.494391 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1141/2218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:11 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:12.595318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:12.596109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:12.603619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:12.609110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:12.610266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:12.610874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:12.674282 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ed2bba8-fcc1-4faf-b0bb-f262f5b810dd tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.534672 Jul 30 21:09:12.675209 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1078/2219] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:12 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:12.693261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:12.695914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:12.729737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:12.730451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:12.731498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:12.732129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:12.765862 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 HTTP/1.1 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:12.773047 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:09:12.774672 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b47ab82f-5261-4c09-aa62-851d8f0b9055'} Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:12.775349 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:09:12.776428 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:12.779192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:12.780381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0abc58b-dcb1-44df-b6e4-3a752ce712e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 404 len: 111 microversion: 2.1 time: 0.099014 Jul 30 21:09:12.781166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1079/2220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:12 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:12.786770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4db836d9-1dfd-4af2-94bd-973145194b4b tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb628ba4c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:12.863466 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4db836d9-1dfd-4af2-94bd-973145194b4b tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080909 Jul 30 21:09:12.885031 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1080/2221] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Jul 30 21:09:12 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_distro => generated 33 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:12.890265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ba83f0d-c757-43a2-bc0d-ea90c38ad41c tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb5c8ab790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:12.978043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-5ba83f0d-c757-43a2-bc0d-ea90c38ad41c tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:12.984656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-5ba83f0d-c757-43a2-bc0d-ea90c38ad41c tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:13.185286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:13.197793 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-555b437e-606d-4de1-9108-267d0ffc07e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1574 microversion: 2.1 time: 0.606990 Jul 30 21:09:13.198870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1142/2222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:12 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1574 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:13.207185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:13.208136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:13.221556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:13.222573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:13.224429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:13.225426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:13.358152 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ba83f0d-c757-43a2-bc0d-ea90c38ad41c tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.471632 Jul 30 21:09:13.358749 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1081/2223] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:12 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:13.372089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2af552fd-ab37-4aa1-b3b7-62373c3c8e64 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb628a74c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:13.434046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2af552fd-ab37-4aa1-b3b7-62373c3c8e64 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.068801 Jul 30 21:09:13.435950 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1082/2224] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:09:13 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:09:13.449657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3845e14b-a68a-4153-8976-5a927afcdf91 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb6289c670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:13.601897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3845e14b-a68a-4153-8976-5a927afcdf91 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:13.610996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3845e14b-a68a-4153-8976-5a927afcdf91 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:13.925936 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3845e14b-a68a-4153-8976-5a927afcdf91 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483354 Jul 30 21:09:13.926450 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1083/2225] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:13 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:13.937028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:13.937682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:13.954452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:13.956409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:13.957752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:13.959856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:13.964434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:13.981246 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-01aecaca-7ccf-4e0f-bd19-eeac13926a9a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1318 microversion: 2.1 time: 0.779351 Jul 30 21:09:14.005197 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1143/2226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:13 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:14.028900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a6bbd32f-900b-4ad3-8d7a-06a44340d4c3 req-4bd6501c-b73c-4483-85fd-348d8e6e9aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ab82f-5261-4c09-aa62-851d8f0b9055", "name": "network-vif-deleted", "tag": "da571ea3-710d-4e17-955a-44cd2d11c0f5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:14.056226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a6bbd32f-900b-4ad3-8d7a-06a44340d4c3 req-4bd6501c-b73c-4483-85fd-348d8e6e9aae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:14.059017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a6bbd32f-900b-4ad3-8d7a-06a44340d4c3 req-4bd6501c-b73c-4483-85fd-348d8e6e9aae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:14.085686 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a6bbd32f-900b-4ad3-8d7a-06a44340d4c3 req-4bd6501c-b73c-4483-85fd-348d8e6e9aae service nova] Creating event network-vif-deleted:da571ea3-710d-4e17-955a-44cd2d11c0f5 for instance b47ab82f-5261-4c09-aa62-851d8f0b9055 on nch1-master-1 Jul 30 21:09:14.091777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a6bbd32f-900b-4ad3-8d7a-06a44340d4c3 req-4bd6501c-b73c-4483-85fd-348d8e6e9aae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082818 Jul 30 21:09:14.092911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1144/2227] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:14.101954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-affe69c2-88cd-4d35-878c-8947b567675d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb5c64e5e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:14.237526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-affe69c2-88cd-4d35-878c-8947b567675d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:14.268153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-affe69c2-88cd-4d35-878c-8947b567675d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:14.864785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:14.878907 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07a86a6b-95ca-4fe4-b0f7-47f4be8439d5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.945727 Jul 30 21:09:14.882413 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1084/2228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:13 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:14.891633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:14.899037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:14.916326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:14.917136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:14.919421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:14.925736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:14.928717 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-affe69c2-88cd-4d35-878c-8947b567675d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 64 microversion: 2.1 time: 0.832637 Jul 30 21:09:14.936201 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1145/2229] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:14 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 64 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:14.943447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-030b7586-9a83-454f-9136-a835b5a6bfee tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb5c6559d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:15.000573 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-030b7586-9a83-454f-9136-a835b5a6bfee tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 64 microversion: 2.1 time: 0.061042 Jul 30 21:09:15.002063 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1146/2230] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:09:14 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:15.007569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:15.008917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:15.031207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:15.034015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:15.046755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:15.048302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:15.403332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:15.429875 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46da150c-a4aa-4641-8877-0a62f4f89408 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1508 microversion: 2.1 time: 0.420933 Jul 30 21:09:15.432146 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1147/2231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:15 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:15.441214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b3ef839-31b7-4fa8-969b-433616e37663 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb5c655d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:15.461766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:15.473749 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ba05e73a-4407-4d15-9116-aa0ccbc0c000 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1579 microversion: 2.1 time: 0.587420 Jul 30 21:09:15.474369 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1085/2232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:14 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1579 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:15.485569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:15.486212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:15.503087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:15.503857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:15.504851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:15.505490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:15.539488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6b3ef839-31b7-4fa8-969b-433616e37663 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:15.556240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6b3ef839-31b7-4fa8-969b-433616e37663 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:16.153592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b3ef839-31b7-4fa8-969b-433616e37663 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.720076 Jul 30 21:09:16.159412 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1148/2233] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:15 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:16.166827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:16.167865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:16.180154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.185296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:16.186471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.188318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:16.348389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:16.368971 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ca503b1-39a6-4f81-902b-05189eec8cb6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1508 microversion: 2.1 time: 0.892213 Jul 30 21:09:16.371248 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1086/2234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:15 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1508 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:16.392605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c8e1e43-bbcb-4f86-8666-7cff2f9a29b0 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update', calling method: .version_select at 0x7fbb5c8ab670>, body: {"meta": {"os_version": "alt"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:16.531515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4c8e1e43-bbcb-4f86-8666-7cff2f9a29b0 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:16.542953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4c8e1e43-bbcb-4f86-8666-7cff2f9a29b0 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:16.570490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:16.578768 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8c00851-58e8-48a7-860c-36564e591e05 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.417742 Jul 30 21:09:16.595365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1149/2235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:16 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:16.595365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:16.595365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:16.643080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.648893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:16.649908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.651561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:16.874227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b78f8306-f6de-40ee-a95d-a9a6b27d862c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "PUT /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1080 microversion: 2.1 time: 0.286596 Jul 30 21:09:16.875684 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1150/2236] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:09:16 2022] PUT /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1080 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:16.880504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:16.884061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:16.891872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.892758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:16.893735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:16.894491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:17.214576 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c8e1e43-bbcb-4f86-8666-7cff2f9a29b0 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.840838 Jul 30 21:09:17.215424 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1087/2237] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 30 21:09:16 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata/os_version => generated 31 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:17.220809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:17.221452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:17.247685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:17.248162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:17.248994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:17.249452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:17.366154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:17.381527 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd88de14-9740-4ee2-bd39-10007ac6615d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1572 microversion: 2.1 time: 0.504193 Jul 30 21:09:17.384807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1151/2238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:16 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1572 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:17.410831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5344b8d5-7f94-49b2-b0c1-5b3e6149849d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb5c655af0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:17.480695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5344b8d5-7f94-49b2-b0c1-5b3e6149849d tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 58 microversion: 2.1 time: 0.093780 Jul 30 21:09:17.484763 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1152/2239] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:09:17 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 58 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:17.493917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-881814793"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:17.496091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:17.510653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:17.511122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:17.511962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:17.515987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:17.708539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:17.725671 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9e998743-8470-432b-96a3-db788d45dffb tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1506 microversion: 2.1 time: 0.505369 Jul 30 21:09:17.729726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1088/2240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:17 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:17.747565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7a63677-dfec-4da2-9df7-2ffc7d1a6603 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'update_all', calling method: .version_select at 0x7fbb6292a4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:17.854831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d7a63677-dfec-4da2-9df7-2ffc7d1a6603 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:17.884242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d7a63677-dfec-4da2-9df7-2ffc7d1a6603 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:17.904579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.network.security_group_api [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Adding security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee to port baab9c05-9b08-4133-8984-10710b40a6f9 Jul 30 21:09:18.429156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7a63677-dfec-4da2-9df7-2ffc7d1a6603 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 61 microversion: 2.1 time: 0.698049 Jul 30 21:09:18.430509 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1089/2241] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:09:17 2022] PUT /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 61 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:18.441601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:18.442581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:18.455359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:18.456119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:18.457142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:18.458218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:18.664752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6d7c1bcc-7e55-4411-94ea-fac855982595 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action" status: 202 len: 0 microversion: 2.1 time: 1.178514 Jul 30 21:09:18.666936 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1153/2242] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:17 2022] POST /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:18.674983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:18.676449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:18.684706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:18.685390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:18.687604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:18.688230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:19.090113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:19.098410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:19.104629 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-621e33cf-88e0-4d6b-b8ff-58b3c5202c01 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1506 microversion: 2.1 time: 0.436411 Jul 30 21:09:19.105887 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1154/2243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:18 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:19.110966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfae4146-1d69-46b4-9251-00879c700e71 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Action: 'create', calling method: .version_select at 0x7fbb628e73a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:19.198653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cfae4146-1d69-46b4-9251-00879c700e71 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:19.204603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cfae4146-1d69-46b4-9251-00879c700e71 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Getting quotas for user 538cf63f2e4c46a6969b3e7ed54c475d and project f1483d62924a45fb8861eba403c6dd19. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:19.527898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:19.544088 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2350f4b-8ea9-422f-b01a-410ab0d2485b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 1.109759 Jul 30 21:09:19.545535 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1090/2244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:18 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:19.558365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6292af70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:19.632620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfae4146-1d69-46b4-9251-00879c700e71 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "POST /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 85 microversion: 2.1 time: 0.524559 Jul 30 21:09:19.633183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1155/2245] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Jul 30 21:09:19 2022] POST /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 85 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:19.644364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-51266d70-f5bf-433f-a734-f52d19a2d329 req-668bf0ec-ec4c-4879-8ce8-e150bdd813c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14e6810-ef24-43f8-aeba-24b68b4aaa96", "tag": "baab9c05-9b08-4133-8984-10710b40a6f9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:19.673796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-51266d70-f5bf-433f-a734-f52d19a2d329 req-668bf0ec-ec4c-4879-8ce8-e150bdd813c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:19.675929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-51266d70-f5bf-433f-a734-f52d19a2d329 req-668bf0ec-ec4c-4879-8ce8-e150bdd813c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:19.726056 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-51266d70-f5bf-433f-a734-f52d19a2d329 req-668bf0ec-ec4c-4879-8ce8-e150bdd813c8 service nova] Creating event network-changed:baab9c05-9b08-4133-8984-10710b40a6f9 for instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 on nch2-master-1 Jul 30 21:09:19.735639 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-51266d70-f5bf-433f-a734-f52d19a2d329 req-668bf0ec-ec4c-4879-8ce8-e150bdd813c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095630 Jul 30 21:09:19.736257 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1156/2246] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:19.751955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:19.758330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:19.784479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:19.785121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:19.786277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:19.786876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:19.914794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:19.915624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:19.916364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:19.916991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:19.917612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:20.055345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:20.064663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use.", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:20.065532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.065532 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee HTTP/1.1 Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:20.067768 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: exception: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.068909 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6382ff1d-905e-4ce1-bc10-0a24a8589cee'} Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:20.070118 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.071084 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:20.072037 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] Jul 30 21:09:20.073104 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:20.074563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 400 to user: Security Group 6382ff1d-905e-4ce1-bc10-0a24a8589cee in use. Jul 30 21:09:20.074563 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-fc1138f6-9a1b-4c27-8d63-0b6263c8ee40'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:20.075751 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ac8d7ac-0d6f-4a97-92cf-1b303a8858ec tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee" status: 400 len: 185 microversion: 2.1 time: 0.528880 Jul 30 21:09:20.076835 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1091/2247] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:19 2022] DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee => generated 185 bytes in 530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:09:20.091701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.092365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe189f41-948f-4c85-b942-0d63b9a29185 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] Calling method '.version_select at 0x7fbb5d7f7430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:20.095028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.098543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.101267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.172094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4a39ac9-db53-4db9-9ed9-fcc9d888ff4c tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "POST /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f/action" status: 202 len: 1112 microversion: 2.1 time: 0.426672 Jul 30 21:09:20.173228 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1157/2248] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:19 2022] POST /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f/action => generated 1112 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 30 21:09:20.181169 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe189f41-948f-4c85-b942-0d63b9a29185 tempest-ImagesMetadataTestJSON-1133475983 tempest-ImagesMetadataTestJSON-1133475983-project] 10.222.0.17 "GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata" status: 200 len: 85 microversion: 2.1 time: 0.102967 Jul 30 21:09:20.181815 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1092/2249] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:09:20 2022] GET /compute/v2.1/images/5cbbb9bf-d4c4-4273-967c-4e280cf9b659/metadata => generated 85 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:20.198662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:20.199656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:20.204780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:20.206790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:20.217776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.233776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:20.243789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.243789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.243789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.253540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.253540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.253540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.253540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.262862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:20.324712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:09:20.523090 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cb86994-13ca-45dc-9142-ef0a6aebdd82 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 204 len: 0 microversion: 2.1 time: 0.348097 Jul 30 21:09:20.530781 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1158/2250] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:09:20 2022] DELETE /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:20.541533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:20.543833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:20.557953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.558498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.559407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.559933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.890781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:20.899585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ff8eacf-c476-48ce-bc5a-172639b36a61 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.710747 Jul 30 21:09:20.903605 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1093/2251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:20 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:20.915129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:20.916155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:20.928178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.932533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:20.935464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:20.936097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:21.167118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:21.177778 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4adf5b54-f3b1-4c24-bde0-d2028a795c11 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.272857 Jul 30 21:09:21.181463 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1094/2252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:20 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:21.836296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:21.848027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91412409-53aa-4d20-984b-071b3596d0ad tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1646 microversion: 2.1 time: 1.315130 Jul 30 21:09:21.848627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1159/2253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:20 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1646 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:09:21.945351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:21.947416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:21.961345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:21.963938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:21.965043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:21.966841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:22.200931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:22.201618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:22.214887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:22.215380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:22.219976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:22.220483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:22.516941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:22.531548 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ae4b3be-3541-4e2e-8665-7d5ace1a8d5b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.609531 Jul 30 21:09:22.546185 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1095/2254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:21 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:22.765706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:22.775110 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a89f2997-6c28-4523-9666-7af6e2941c72 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.578723 Jul 30 21:09:22.775985 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1160/2255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:22 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:09:22.864817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c35fa2a-984a-4894-8fc7-3643ece55436 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Action: 'create', calling method: .version_select at 0x7fbb62891e50>, body: {"keypair": {"name": "tempest-keypair-1567046396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopAhjEBESo575JBoygy3ISzaRd52I9vKRPMT5ylJ4VW6FxJ7hA17xhxELnsjee9BxZou8EtuDMMDMFU7FDG+9+SYyy2KGs2OIH3GbjiRwrzV+MuhccaNkGwnO1+BpNKw=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:22.873003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:22.874682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:22.903012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0c35fa2a-984a-4894-8fc7-3643ece55436 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Getting quotas for project 6dcec3648d3843dd96bfed76e793598a. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:22.907547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:22.910206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:22.914406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:22.914966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:22.917528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0c35fa2a-984a-4894-8fc7-3643ece55436 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Getting quotas for user 879e94018c474c838b1b989f3d4013a0 and project 6dcec3648d3843dd96bfed76e793598a. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:22.979484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c35fa2a-984a-4894-8fc7-3643ece55436 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.443631 Jul 30 21:09:22.985974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1096/2256] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:09:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:23.573113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:23.574161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:23.592999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:23.593712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:23.594969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:23.595678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:23.900554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:23.909700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d790f86-2a3d-432d-9dcb-8d24bf87851d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1646 microversion: 2.1 time: 1.043591 Jul 30 21:09:23.916549 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1161/2257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:22 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1646 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:23.949855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:23.952914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:23.980909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:23.992018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:23.996149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:23.997247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:24.886528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:24.902347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c52565ef-7fee-4693-b3b7-9bfaa4f69a4d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.979344 Jul 30 21:09:24.905947 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1162/2258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:23 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:24.917735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d5ee8445-24d2-4c1f-8ef1-87b1673a79b9 req-b21e6b3e-603d-4cb0-8398-1f1850aa5cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14e6810-ef24-43f8-aeba-24b68b4aaa96", "name": "network-vif-deleted", "tag": "baab9c05-9b08-4133-8984-10710b40a6f9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:24.981437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d5ee8445-24d2-4c1f-8ef1-87b1673a79b9 req-b21e6b3e-603d-4cb0-8398-1f1850aa5cd6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:24.995343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d5ee8445-24d2-4c1f-8ef1-87b1673a79b9 req-b21e6b3e-603d-4cb0-8398-1f1850aa5cd6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:25.049238 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d5ee8445-24d2-4c1f-8ef1-87b1673a79b9 req-b21e6b3e-603d-4cb0-8398-1f1850aa5cd6 service nova] Creating event network-vif-deleted:baab9c05-9b08-4133-8984-10710b40a6f9 for instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 on nch2-master-1 Jul 30 21:09:25.064521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:25.066844 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d5ee8445-24d2-4c1f-8ef1-87b1673a79b9 req-b21e6b3e-603d-4cb0-8398-1f1850aa5cd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159259 Jul 30 21:09:25.074083 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1163/2259] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:25.082102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:25.093849 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-471b417c-b5c8-4859-a090-1982d8f0fdac tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 1.525597 Jul 30 21:09:25.094462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1097/2260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:23 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:25.101464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:25.135215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:25.150252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:25.151624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:25.153415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:25.249708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:25.250674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:25.253379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lazy-loading 'fault' on Instance uuid d14e6810-ef24-43f8-aeba-24b68b4aaa96 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:09:25.365277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:25.380477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e4e03ad-e3d8-4dac-b98d-2dd20e51ab3e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 200 len: 1306 microversion: 2.1 time: 0.304682 Jul 30 21:09:25.388587 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1164/2261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:25 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 1306 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:25.945548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:25.946644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:25.977177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:25.978671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:25.982182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:25.982862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.258637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Calling method '.version_select at 0x7fbb5c655670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:26.306695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.308440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.309494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.310138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.358818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5eff0781-d49a-4e4b-9358-7da259470d73 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.329273 Jul 30 21:09:26.359929 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1165/2262] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Jul 30 21:09:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:26.389142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:26.392693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:26.415438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.416462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.419261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.420188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.623699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:26.636112 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-395056e4-1a2b-4d4a-80b4-76a7dc68f1cb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.695235 Jul 30 21:09:26.664786 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1098/2263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:25 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:26.687568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:26.694928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:26.743422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.744287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.745359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:26.746556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:26.785447 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 HTTP/1.1 Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:26.790917 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:26.792517 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd14e6810-ef24-43f8-aeba-24b68b4aaa96'} Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:26.793360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:26.794542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:26.797247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:26.798287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-24fffe36-d095-4464-becb-e6c7065c5a3c tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 404 len: 111 microversion: 2.1 time: 0.131816 Jul 30 21:09:26.813627 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1099/2264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:26 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:26.826886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1034143876", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:26.864538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:26.949604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:26.989029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:27.018273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8454cedb-fb59-4f11-a762-d022dcd5b44d tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.655914 Jul 30 21:09:27.031833 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1166/2265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:26 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:27.042659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1285825295", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "14b695f3-d9d3-4bb3-a626-6084dcaadac4"}, {"uuid": "2612297e-cc03-4fc2-8c23-95e5d15636cb"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:27.166060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] validate_networks() for [('14b695f3-d9d3-4bb3-a626-6084dcaadac4', None, None, None, None, None), ('2612297e-cc03-4fc2-8c23-95e5d15636cb', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:27.827832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Getting quotas for project 33e26e21a05e4ecd87fd72361a5cbfbe. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:27.852696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Getting quotas for user c56c6e988ce2451b9426e412284605fb and project 33e26e21a05e4ecd87fd72361a5cbfbe. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:27.880193 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Request method failure captured: Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 1752 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4FNGCqfzXJcjtilctHqXbEHqtwkcNaBgLzclhI4ufTBVgNu8YT7qjOxqXn1EY-ZoTLjzdJWyUh1brGr_l0_2vjvrvywpMFVVuZdll6r6TvegyW-kzKqDOtJbckyyz2Xa0uyg1bsIyWUvB7AiWi8UDlRoAKW1tw_UWWcQBtJ_wQ5ao Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 33e26e21a05e4ecd87fd72361a5cbfbe Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-686086293 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e26e21a05e4ecd87fd72361a5cbfbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e26e21a05e4ecd87fd72361a5cbfbe", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e26e21a05e4ecd87fd72361a5cbfbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e26e21a05e4ecd87fd72361a5cbfbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-686086293 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 33e26e21a05e4ecd87fd72361a5cbfbe Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-686086293 Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-686086293-project Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c56c6e988ce2451b9426e412284605fb Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-686086293-project Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1034143876", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:09:27.888362 ncdv-master-1 devstack@n-api.service[130983]: exception: Maximum number of metadata items exceeds 128 Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1034143876', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:09:27.890677 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:27.893849 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3c40fbb-9970-429b-9a18-5d1cfd352c35 tempest-AbsoluteLimitsNegativeTestJSON-686086293 tempest-AbsoluteLimitsNegativeTestJSON-686086293-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.068046 Jul 30 21:09:27.896685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1100/2266] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 30 21:09:26 2022] POST /compute/v2.1/servers => generated 87 bytes in 1075 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:09:27.904668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e2cd8a7-b353-4ee7-8b64-78499ac7e93d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb62881040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:28.379476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e2cd8a7-b353-4ee7-8b64-78499ac7e93d tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950" status: 202 len: 0 microversion: 2.1 time: 0.479639 Jul 30 21:09:28.380128 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1101/2267] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:27 2022] DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:28.520683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:28.522170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:28.523602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:28.524217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:28.525541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:28.546860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:28.547065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:28.549223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:28.550968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:28.622208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Getting quotas for project c143a2d2e4b04edba1f2734d4d19d978. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:28.644936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Getting quotas for user 6399b6f3e2574df8af12786c8755c59a and project c143a2d2e4b04edba1f2734d4d19d978. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:28.700184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:28.702868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:28.860533 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae8ba1d0-738c-4dd1-9064-c6037e31434a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827214 Jul 30 21:09:28.861320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1167/2268] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:28.862367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3093c110-e0cd-4208-9645-bbf2d1590e7e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: .version_select at 0x7fbb62986a60>, body: {"keypair": {"name": "tempest-keypair-931599014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzjZ/mUWm67InBoIjZRAINcvHRL0X/dFkXmJYCVxh/hBqDwHN4QtHBOR3O+wbpZiJyY7TSDmDXXnvM2VX/2RQkwPrAWyfiMgxErKLBn9/lQgwAYkTc4sMX6xyRd+Eydig=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:28.883987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:28.885492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:28.894843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:28.895565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:28.896523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:28.897250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:28.918859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3093c110-e0cd-4208-9645-bbf2d1590e7e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for project 2b4c650076ad4077874a72f6e64461f3. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:28.937534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3093c110-e0cd-4208-9645-bbf2d1590e7e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for user f00d46cd63d94b49abfa65d6106c7d88 and project 2b4c650076ad4077874a72f6e64461f3. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:29.015868 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3093c110-e0cd-4208-9645-bbf2d1590e7e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.633774 Jul 30 21:09:29.016555 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1102/2269] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:09:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 635 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:09:29.024460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:29.024967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:29.032363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:29.033067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:29.034429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:29.035048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:29.313319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:29.332782 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6869073e-ab34-41c6-98a6-2be0a121cbce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.462405 Jul 30 21:09:29.333511 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1168/2270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:28 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:29.352446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e21311e9-c39e-4d58-a825-0def7adaca8a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6298d3a0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:29.395730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:29.410271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90c8caaf-5be9-4144-98e7-7b6b748b9999 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.392457 Jul 30 21:09:29.429627 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1103/2271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:29 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:29.438934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21abcab8-e36f-4af9-afaa-aa74af7569c8 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:29.439843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21abcab8-e36f-4af9-afaa-aa74af7569c8 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:29.618611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21abcab8-e36f-4af9-afaa-aa74af7569c8 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:29.630798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21abcab8-e36f-4af9-afaa-aa74af7569c8 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1213 microversion: 2.1 time: 0.195913 Jul 30 21:09:29.633463 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1104/2272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:29 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:29.650913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-869200558", "imageRef": "c08c3a28-1c42-406f-95bc-1f79bdd8d6f2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2ba2526a-3eee-4599-bafb-df64c479177d"}], "security_groups": [{"name": "tempest-securitygroup--1560481700"}], "key_name": "tempest-keypair-1567046396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:30.074205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] validate_networks() for [('2ba2526a-3eee-4599-bafb-df64c479177d', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:30.129409 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e21311e9-c39e-4d58-a825-0def7adaca8a tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee" status: 202 len: 0 microversion: 2.1 time: 0.781605 Jul 30 21:09:30.133493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1169/2273] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:29 2022] DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:30.146389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e804a31-387d-4e6f-9835-9edfc8009cae tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'create', calling method: .version_select at 0x7fbb62883160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1884433606", "description": "tempest-description-167816241"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:30.542752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e804a31-387d-4e6f-9835-9edfc8009cae tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.399130 Jul 30 21:09:30.544027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1170/2274] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:09:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:30.550282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:30.551872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:30.596930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:30.599809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:30.601525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:30.602182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:31.380443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:31.404779 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b34ba1a8-cfc7-4273-aaba-865faccc06a6 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1475 microversion: 2.1 time: 0.859285 Jul 30 21:09:31.406379 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1171/2275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:30 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:31.421727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:31.424812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:31.442191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:31.443623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:31.444924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:31.446170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:31.622527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:31.644134 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e68e38e-a3d7-48c5-8e39-98a5d09a0070 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.235309 Jul 30 21:09:31.646164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1172/2276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:31 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:31.656863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8adfe2a-1e44-4bf9-8e17-6b853af0f4f4 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Action: 'update', calling method: .version_select at 0x7fbb62998d30>, body: {"security_group": {"name": "tempest-sg-hth-1618696842", "description": "tempest-description-hth-1513465842"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:32.181028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8adfe2a-1e44-4bf9-8e17-6b853af0f4f4 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96" status: 200 len: 218 microversion: 2.1 time: 0.533505 Jul 30 21:09:32.187755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1173/2277] 10.222.0.17 () {60 vars in 1290 bytes} [Sat Jul 30 21:09:31 2022] PUT /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96 => generated 218 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:32.198657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:32.203213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:32.221805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:32.222690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:32.223675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:32.224356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:32.238193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:32.447455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:32.457458 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d7b0c6f-1917-4616-8a91-2c3ab51e99e1 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1271 microversion: 2.1 time: 0.268396 Jul 30 21:09:32.479377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1174/2278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:32 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:32.493263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d55b970f-d573-4849-aebd-f4d1e74e2070 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6298dca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:32.700497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d55b970f-d573-4849-aebd-f4d1e74e2070 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96" status: 200 len: 218 microversion: 2.1 time: 0.219821 Jul 30 21:09:32.701380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1175/2279] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:09:32 2022] GET /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96 => generated 218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:32.716628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:32.717557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:32.749399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:32.751421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:32.755344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:32.756056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.143024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:33.145010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:33.145010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:33.145010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:33.145263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:33.161323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.161796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.162977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.163752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.168388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:33.178746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b644c0d1-2b5b-42af-a4b5-287f1c0a6b24 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1474 microversion: 2.1 time: 0.465990 Jul 30 21:09:33.181953 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1176/2280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:32 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1474 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:33.195125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Getting quotas for project 6dcec3648d3843dd96bfed76e793598a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:33.199157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:33.200121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:33.203511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Getting quotas for user 879e94018c474c838b1b989f3d4013a0 and project 6dcec3648d3843dd96bfed76e793598a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:33.213446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.214152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.217497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.218062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.241000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:33.244133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08c3a28-1c42-406f-95bc-1f79bdd8d6f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:33.358131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-853d516c-0f35-4f52-9bc9-850859b95845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.723217 Jul 30 21:09:33.359532 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1105/2281] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 3726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:33.391445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f1e8168-0ad9-422b-9028-95e32d4198de tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6292aca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:33.647055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:33.661754 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79eaf340-d133-4d05-b982-8e452d3d49f3 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.475011 Jul 30 21:09:33.665003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1177/2282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:33 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:33.676301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6232b2b-c69a-4b71-9d66-88204bd9acf5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:33.677734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b6232b2b-c69a-4b71-9d66-88204bd9acf5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:33.806833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6232b2b-c69a-4b71-9d66-88204bd9acf5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:33.813934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=31 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:33.838843 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6232b2b-c69a-4b71-9d66-88204bd9acf5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1245 microversion: 2.1 time: 0.169821 Jul 30 21:09:33.841393 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1178/2283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:33 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:33.854099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:33.864039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:33.882561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.885656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:33.887607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:33.888810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.191230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:34.200707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3f0dd17c-6546-4ad6-8a13-fdab9619af9d tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1271 microversion: 2.1 time: 0.357898 Jul 30 21:09:34.215672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1179/2284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:33 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1271 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:34.225794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545981a3-0424-40b7-8988-54421b666879", "name": "network-vif-unplugged", "status": "completed", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:34.242929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:34.243671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.268053 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] Creating event network-vif-unplugged:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch2-master-1 Jul 30 21:09:34.274979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] Instance 545981a3-0424-40b7-8988-54421b666879 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:09:34.311784 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-da217b32-77bb-4768-b2ca-ae2ba3521abb req-6236afc2-f9c4-49fa-8126-3a9fc3a6a645 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096512 Jul 30 21:09:34.318251 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1180/2285] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:34.338473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:34.341573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:34.358027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:34.361721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.362809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:34.363401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.884440 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f1e8168-0ad9-422b-9028-95e32d4198de tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96" status: 202 len: 0 microversion: 2.1 time: 1.519793 Jul 30 21:09:34.885566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1106/2286] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:33 2022] DELETE /compute/v2.1/os-security-groups/7a9b7913-9fbc-46e4-b46b-cfad297f1b96 => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:34.890804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:34.891735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:34.900883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:34.901690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.902709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:34.903451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:34.997163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:35.008794 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfd1f48f-5176-4778-adc0-170f464865e7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1474 microversion: 2.1 time: 0.686670 Jul 30 21:09:35.009649 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1181/2287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:34 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1474 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:35.021604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:35.023500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:35.044978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.045585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.046636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.047277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.248225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:35.262230 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea36efed-bd09-4233-8958-cab78a7969f9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1297 microversion: 2.1 time: 0.251240 Jul 30 21:09:35.277781 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1182/2288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:35 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1297 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:35.295325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:35.295905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:35.304142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.304661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.305557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.306061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.342465 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 HTTP/1.1 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd14e6810-ef24-43f8-aeba-24b68b4aaa96'} Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:35.344736 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.348665 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.350454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:35.351558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa2c56a4-a074-4706-92c6-604826ae55c3 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 404 len: 111 microversion: 2.1 time: 0.072455 Jul 30 21:09:35.360907 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1183/2289] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:09:35 2022] DELETE /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:35.366067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:35.366922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:35.373914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.374583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.375902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.376514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.748042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:35.760200 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e85b75cf-5bff-4a18-a7f1-93fffa4f1925 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.872978 Jul 30 21:09:35.762194 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1107/2290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:34 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:35.772334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:35.774964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: d14e6810-ef24-43f8-aeba-24b68b4aaa96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:35.799027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.800039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.801792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:35.802537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:35.831812 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 HTTP/1.1 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd14e6810-ef24-43f8-aeba-24b68b4aaa96'} Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:35.833920 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. Jul 30 21:09:35.840618 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:35.843723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Instance d14e6810-ef24-43f8-aeba-24b68b4aaa96 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:35.845002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d0306aac-c43e-4113-8482-40748cf7e141 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96" status: 404 len: 111 microversion: 2.1 time: 0.079684 Jul 30 21:09:35.851151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1108/2291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:35 2022] GET /compute/v2.1/servers/d14e6810-ef24-43f8-aeba-24b68b4aaa96 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:35.859502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628baf70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.140579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:36.142475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:36.144777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:36.146600 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.146600 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee HTTP/1.1 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6382ff1d-905e-4ce1-bc10-0a24a8589cee'} Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:36.150315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] Jul 30 21:09:36.154161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.173787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2683fedd-6ad5-4568-95dc-7a7a119ac8e5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1313 microversion: 2.1 time: 0.792745 Jul 30 21:09:36.173787 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1184/2292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:35 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1313 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:36.173787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.173787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:36.176764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 6382ff1d-905e-4ce1-bc10-0a24a8589cee does not exist Jul 30 21:09:36.176764 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-362d6156-0fe9-480a-b175-ea5fb836bef0'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:36.177997 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fedfe504-58c1-4ec8-8eb0-8573f2c17c25 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee" status: 404 len: 194 microversion: 2.1 time: 0.325450 Jul 30 21:09:36.178803 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1109/2293] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:35 2022] DELETE /compute/v2.1/os-security-groups/6382ff1d-905e-4ce1-bc10-0a24a8589cee => generated 194 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:36.189456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.190006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.190821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.191324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.193673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5c8abca0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.332538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:36.334147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:36.335429 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.335429 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 HTTP/1.1 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f93ae01e-4f7b-4ad1-b54d-264c8bbd1950'} Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:36.337552 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] Jul 30 21:09:36.341657 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.345707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 does not exist Jul 30 21:09:36.345707 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-91f94291-514b-4067-832a-013d22a0f66e'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:36.347759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60f440ce-89c8-46c2-9598-5386231e6f72 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950" status: 404 len: 194 microversion: 2.1 time: 0.163468 Jul 30 21:09:36.348798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1110/2294] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:36 2022] DELETE /compute/v2.1/os-security-groups/f93ae01e-4f7b-4ad1-b54d-264c8bbd1950 => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:36.364037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.367169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:36.381454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.388245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.392473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.394489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.577106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:36.585976 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7a0ab29-d1e0-4f24-a0d4-df951c270b8c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1472 microversion: 2.1 time: 0.425686 Jul 30 21:09:36.595119 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1185/2295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:36 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:36.608278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5c66bee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.670131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:36.671009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:36.671879 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.671879 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a HTTP/1.1 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ceb77ccb-67bc-4c4f-88bb-fcb52efae40a'} Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:36.674352 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] Jul 30 21:09:36.678365 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.681674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group ceb77ccb-67bc-4c4f-88bb-fcb52efae40a does not exist Jul 30 21:09:36.681674 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-34e6e564-1097-4e49-a4d2-80ba8e92b143'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:36.682797 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63d20803-b203-415f-b511-316910736429 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a" status: 404 len: 194 microversion: 2.1 time: 0.083826 Jul 30 21:09:36.686976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1186/2296] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:36 2022] DELETE /compute/v2.1/os-security-groups/ceb77ccb-67bc-4c4f-88bb-fcb52efae40a => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:36.694340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545981a3-0424-40b7-8988-54421b666879", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:36.711332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:36.712911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.713156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.719538 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4c15156-bb30-4899-a49e-0c63d58aa06e tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1303 microversion: 2.1 time: 0.369455 Jul 30 21:09:36.732396 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] Creating event network-changed:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch2-master-1 Jul 30 21:09:36.736418 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1111/2297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:36 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:36.749313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] Instance 545981a3-0424-40b7-8988-54421b666879 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:09:36.768735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8fa39446-6e2e-4dc1-83d4-08816082a331 req-02c66735-dd44-4182-a630-ae7d2cb5adc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079726 Jul 30 21:09:36.770349 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1187/2298] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:36.792930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb62896310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.802106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.802912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:36.810072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.810655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.815272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:36.816470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:36.900796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:36.901805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 6a603123-979a-44c4-8f9a-2650f985922d not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:36.903216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.903216 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d HTTP/1.1 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6a603123-979a-44c4-8f9a-2650f985922d'} Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:36.905373 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] Jul 30 21:09:36.909509 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.916179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 6a603123-979a-44c4-8f9a-2650f985922d does not exist Jul 30 21:09:36.916179 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-78842615-5038-4a41-b3fc-58ee43eaab99'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:36.916179 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-390949f1-2639-495b-af04-90dc816ad1e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d" status: 404 len: 194 microversion: 2.1 time: 0.172937 Jul 30 21:09:36.916179 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1112/2299] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:36 2022] DELETE /compute/v2.1/os-security-groups/6a603123-979a-44c4-8f9a-2650f985922d => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:36.920177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6292aaf0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:36.971944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:36.974729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:36.978088 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.978088 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0 HTTP/1.1 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0bc2c04d-8166-431c-800a-0d14b540f2f0'} Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:36.981399 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] Jul 30 21:09:36.984797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:09:36.992009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 0bc2c04d-8166-431c-800a-0d14b540f2f0 does not exist Jul 30 21:09:36.992009 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-05760f43-8b3f-4a9f-bc30-52fc80eb6ace'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:36.993328 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a061c1f8-413a-472c-bbc1-d156311018e1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0" status: 404 len: 194 microversion: 2.1 time: 0.077880 Jul 30 21:09:36.994382 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1113/2300] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:36 2022] DELETE /compute/v2.1/os-security-groups/0bc2c04d-8166-431c-800a-0d14b540f2f0 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:37.003427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-270858824", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4a92aec-0588-4592-82ad-0035b1652de3"}], "security_groups": [{"name": "tempest-securitygroup--1133277402"}], "key_name": "tempest-keypair-931599014", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:37.145492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:37.170101 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-272cddac-7ec8-4ef5-a732-8d5fb87c509e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.389063 Jul 30 21:09:37.171644 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1188/2301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:36 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:37.177057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb6298df70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:37.257575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:09:37.263380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Neutron security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:09:37.264379 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.264379 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 HTTP/1.1 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '043d224d-06dd-4bd0-b1aa-08365100b7f8'} Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:09:37.266942 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] Jul 30 21:09:37.270242 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:37.272286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Security group 043d224d-06dd-4bd0-b1aa-08365100b7f8 does not exist Jul 30 21:09:37.272286 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-2d81fba7-36c9-4b9a-847f-e7d6e6ec27e8'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:37.273574 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94bfa78e-5471-4ed5-a49f-d783d2a20f2e tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8" status: 404 len: 194 microversion: 2.1 time: 0.100485 Jul 30 21:09:37.277065 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1189/2302] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:37 2022] DELETE /compute/v2.1/os-security-groups/043d224d-06dd-4bd0-b1aa-08365100b7f8 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:37.291688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:37.293402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:37.312057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:37.313134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:37.316460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:37.318341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:37.325133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] validate_networks() for [('b4a92aec-0588-4592-82ad-0035b1652de3', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:38.153430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:38.174011 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ebb486f8-d5a9-4c6b-9eef-bf912f4a77df tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1313 microversion: 2.1 time: 0.898980 Jul 30 21:09:38.192253 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1190/2303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:37 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1313 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:38.198402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:38.208215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:38.218335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:38.221350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:38.222333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:38.226165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:38.282999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:09:38.398990 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35984cc2-4304-424d-a7a6-a58e57480f52 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 204 len: 0 microversion: 2.1 time: 0.204749 Jul 30 21:09:38.400335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1191/2304] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:09:38 2022] DELETE /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:38.408576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:38.410092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:38.421214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:38.422004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:38.423181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:38.423915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:38.576974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:39.243226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:39.276258 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2bc08ad1-f1ef-4e87-ad6c-f5b6512a4995 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1469 microversion: 2.1 time: 0.874220 Jul 30 21:09:39.286498 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1192/2305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:38 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1469 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:39.297403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:39.301178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:39.315600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.316868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.319085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.321793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.501822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:39.514308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:39.515402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:39.516051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:39.516615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:39.517201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:39.530421 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cba761e-80fc-49ea-ac94-150cd75f2bd5 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1303 microversion: 2.1 time: 0.239635 Jul 30 21:09:39.538908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=43 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:39.540033 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1193/2306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:39 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:39.545684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.559670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.563737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.564310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:39.564965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.568513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:39.591651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.600757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.602755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.605196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.666110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for project 2b4c650076ad4077874a72f6e64461f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:39.679471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for user f00d46cd63d94b49abfa65d6106c7d88 and project 2b4c650076ad4077874a72f6e64461f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:39.690887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:39.711907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:39.718900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:39.821752 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d21f3cd4-a6a5-4222-a851-af381ad5364e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.825822 Jul 30 21:09:39.833942 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1114/2307] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:09:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:09:39.844960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:39.845612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:39.859494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.859972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:39.860772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:39.863493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:40.484533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:40.494841 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-809a3d24-88a3-4329-a275-8c9950896247 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1517 microversion: 2.1 time: 0.953533 Jul 30 21:09:40.514588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1194/2308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:39 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1517 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:40.526414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:40.533082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:40.556652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:40.557525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:40.559197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:40.560933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:40.924205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:40.957056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72386a2a-11d6-4e8e-8b04-cd6ab3cd9471 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1648 microversion: 2.1 time: 1.121210 Jul 30 21:09:40.961622 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1115/2309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:39 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1648 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:40.985604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:40.986195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:41.024639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.025393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:41.028384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.029669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:41.298941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf8b1e75-3095-4a1d-b49d-98543000699e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879/action" status: 204 len: 0 microversion: 2.1 time: 0.334981 Jul 30 21:09:41.300123 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1116/2310] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:09:40 2022] POST /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879/action => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:41.629851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:41.653701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4eb56d03-1517-472d-8ca2-64e13c19ebbb tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 1.134128 Jul 30 21:09:41.657853 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1195/2311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:40 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:41.673918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:41.676466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:41.682731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-250729683", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "696a1d42-ff8f-418a-9c2e-037ff89f8b5b"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:41.696592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.698372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:41.700599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.704282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:41.803789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] validate_networks() for [('696a1d42-ff8f-418a-9c2e-037ff89f8b5b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:41.868459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:41.881105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:41.886507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:41.888949 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4ee4c384-6042-43a9-9dd9-850c274f3d94 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1340 microversion: 2.20 time: 0.229771 Jul 30 21:09:41.891388 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1196/2312] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:41 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:41.901307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:41.904359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:41.915763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:41.917651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.920671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:41.921826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:41.924887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:43.385615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:43.404676 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bdec854-41f4-4e39-a67a-57422053c7dd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 1.511770 Jul 30 21:09:43.405434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1197/2313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:41 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:43.410231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:43.413634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:43.460769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:43.463313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:43.465628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:43.468098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:43.696887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:43.705898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e615f6d0-ad25-4888-a0fe-e5f9cefec42c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1469 microversion: 2.1 time: 0.299255 Jul 30 21:09:43.709922 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1198/2314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:43 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:43.721467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:43.730646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:43.755833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:43.756340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:43.757171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:43.757636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:43.887947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:44.660787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:44.681886 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2783d7b4-5d5c-4bc7-8afb-0a6763a81d9e tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1523 microversion: 2.1 time: 0.957092 Jul 30 21:09:44.683718 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1199/2315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:43 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1523 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:44.692936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:44.702626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:44.725205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:44.732081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:44.734692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:44.735341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:44.833878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:44.844172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:44.845105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lazy-loading 'fault' on Instance uuid 561203ad-288a-4c80-89db-2ce51050e79a {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:09:44.968941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb3ffbaef3347de8d9ad6b2bdfa19bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6193b7fd6d224f328a2b4c561edb89ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:44.981128 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-38ecba60-b534-47df-b8c4-89c9256d66b1 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 200 len: 1306 microversion: 2.1 time: 0.296269 Jul 30 21:09:44.996208 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1200/2316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:44 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 1306 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:45.023070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:45.023835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:45.044937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:45.045404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:45.052782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:45.053938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:46.269621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:46.293812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dd297ea5-887c-4e05-ae9b-793f366abcda tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 1.293662 Jul 30 21:09:46.308407 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1201/2317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:44 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:46.314282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:46.324200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:46.338881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:46.348795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:46.355130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:46.355707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:46.765777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:46.767426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:46.768118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:46.768711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:46.769497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:46.791596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:46.798520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:46.801695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:46.802332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:46.890783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Getting quotas for project cc4eb46593544ff78b641193ec88a7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:46.915454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Getting quotas for user 70a0d6cf4a484ad4900293ad97249a5d and project cc4eb46593544ff78b641193ec88a7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:46.959205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:46.961888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:47.127908 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-736caac7-05d7-42a5-8c37-1ba3ef9aea3b tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.822049 Jul 30 21:09:47.140851 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1117/2318] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:47.152167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8c3297cf-3426-4c88-a8df-69e46f3a64f3 req-e30de87c-5985-45df-b190-f9fad84d2aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561203ad-288a-4c80-89db-2ce51050e79a", "name": "network-vif-deleted", "tag": "7ff07390-6321-4183-b433-44a7d336f921"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:47.205898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8c3297cf-3426-4c88-a8df-69e46f3a64f3 req-e30de87c-5985-45df-b190-f9fad84d2aea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.206511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8c3297cf-3426-4c88-a8df-69e46f3a64f3 req-e30de87c-5985-45df-b190-f9fad84d2aea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:47.263065 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8c3297cf-3426-4c88-a8df-69e46f3a64f3 req-e30de87c-5985-45df-b190-f9fad84d2aea service nova] Creating event network-vif-deleted:7ff07390-6321-4183-b433-44a7d336f921 for instance 561203ad-288a-4c80-89db-2ce51050e79a on nch2-master-1 Jul 30 21:09:47.281435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8c3297cf-3426-4c88-a8df-69e46f3a64f3 req-e30de87c-5985-45df-b190-f9fad84d2aea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138622 Jul 30 21:09:47.283910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1118/2319] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:47.290509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545981a3-0424-40b7-8988-54421b666879", "name": "network-vif-plugged", "status": "completed", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:47.331948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.332408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:47.359306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] Creating event network-vif-plugged:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch2-master-1 Jul 30 21:09:47.389222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] Instance 545981a3-0424-40b7-8988-54421b666879 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:09:47.429088 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-158038a1-a8d4-4164-b64c-178efc40181e req-0be7b972-13bb-4ba6-9064-7e96607a2ef2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143664 Jul 30 21:09:47.429726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1119/2320] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:47.457998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:47.469353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:47.504379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.504854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:47.505675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.506321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:47.755974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:47.768797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:47.774163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:47.780981 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71ba3b44-3b1f-4095-a73e-85276405570b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 1.471078 Jul 30 21:09:47.782192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1202/2321] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:46 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:47.796931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:47.797831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:47.806733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.817207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:47.818504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:47.819523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.272448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:48.287876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-741f0a02-a99c-422a-a34c-9563a9656da1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1469 microversion: 2.1 time: 0.500548 Jul 30 21:09:48.288616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1203/2322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:47 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:48.306866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:48.312640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:48.328464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.329034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.329902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.331602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.603096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:48.613593 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb00bc78-655f-4db0-9489-80d4207b5e4a tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1523 microversion: 2.1 time: 0.311110 Jul 30 21:09:48.639322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1204/2323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:48 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:48.639322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:48.639322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] [instance: 561203ad-288a-4c80-89db-2ce51050e79a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:48.653394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.653962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.654868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.655589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.685834 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] HTTP exception thrown: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Request method failure captured: Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a HTTP/1.1 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2e6HV4NTxtVuWS4gG42OxesWQeQxsXMpz7P1Ez7L3EZ_1VF-RBNQyJoPzpgKOOe_8nFTAOmYJiq-PZCdnnjzsRi-bWD6O8pLylG9YNBEGzHmom759LAUj_6__HBpR5FJ3iy0KQ5fIuldrShb4kM6_31EZ2uqj_55xUMxGDCuk1OCA Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6193b7fd6d224f328a2b4c561edb89ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6193b7fd6d224f328a2b4c561edb89ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6193b7fd6d224f328a2b4c561edb89ea Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2033432162 Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eeb3ffbaef3347de8d9ad6b2bdfa19bc Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsTestJSON-2033432162-project Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '561203ad-288a-4c80-89db-2ce51050e79a'} Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:09:48.687772 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Returning 404 to user: Instance 561203ad-288a-4c80-89db-2ce51050e79a could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:09:48.693364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1267f249-178e-481f-aa61-1e020c27be80 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a" status: 404 len: 111 microversion: 2.1 time: 0.063693 Jul 30 21:09:48.695053 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1205/2324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:48 2022] GET /compute/v2.1/servers/561203ad-288a-4c80-89db-2ce51050e79a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:09:48.705901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:48.708531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:48.716423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.717190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.718525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:48.719209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:48.883624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:48.894928 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6665f79d-9aaf-425e-a214-ea922a97f8af tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 1.463965 Jul 30 21:09:48.901325 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1120/2325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:47 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:48.907713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:48.929163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2078bf85-3b1b-46b1-bf88-a3ff1bf7bf7f tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1211 microversion: 2.1 time: 0.220292 Jul 30 21:09:48.949817 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1206/2326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:48 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1211 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:48.965471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:48.967603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:48.971227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-531deeaa-c529-421e-8265-8a06dc472a91 req-2bd826bd-07c4-4983-8586-9b413c8b787e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914fd755-9940-4f50-9f38-378ea723e33e", "tag": "8745a6b9-a208-4303-b33c-e934968b161e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:49.022182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.024115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.025138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.028681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.041781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-531deeaa-c529-421e-8265-8a06dc472a91 req-2bd826bd-07c4-4983-8586-9b413c8b787e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.042254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-531deeaa-c529-421e-8265-8a06dc472a91 req-2bd826bd-07c4-4983-8586-9b413c8b787e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.078502 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-531deeaa-c529-421e-8265-8a06dc472a91 req-2bd826bd-07c4-4983-8586-9b413c8b787e service nova] Creating event network-changed:8745a6b9-a208-4303-b33c-e934968b161e for instance 914fd755-9940-4f50-9f38-378ea723e33e on nch2-master-1 Jul 30 21:09:49.089269 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-531deeaa-c529-421e-8265-8a06dc472a91 req-2bd826bd-07c4-4983-8586-9b413c8b787e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129449 Jul 30 21:09:49.106099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1207/2327] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:49.111877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-155de368-089f-481c-a75d-bd54660292ff tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb5d3b4b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:49.697089 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-155de368-089f-481c-a75d-bd54660292ff tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5bed8bed-2143-436e-be81-d51067d5230c" status: 202 len: 0 microversion: 2.1 time: 0.589265 Jul 30 21:09:49.697807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1208/2328] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:49 2022] DELETE /compute/v2.1/os-security-groups/5bed8bed-2143-436e-be81-d51067d5230c => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:49.705928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:49.706795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:49.713769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.714312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.715187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.715757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.754958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:49.768348 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f213d0a6-06c1-48e7-82f7-7fc18b0a71a4 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.864705 Jul 30 21:09:49.769431 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1121/2329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:48 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:49.774274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:49.774967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:49.782595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.783144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.784082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.784510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.916729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:49.926956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:49.928625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:49.929927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb53fcee-de17-4b40-8262-eb0d21b120bf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 0.230301 Jul 30 21:09:49.930674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1209/2330] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:49 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:49.936235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1092ba85-270f-458b-ad81-62f99b9082c7 req-72681dd3-b8d9-44e1-bd4f-c7ff849ca90d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:49.947342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1092ba85-270f-458b-ad81-62f99b9082c7 req-72681dd3-b8d9-44e1-bd4f-c7ff849ca90d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.947748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1092ba85-270f-458b-ad81-62f99b9082c7 req-72681dd3-b8d9-44e1-bd4f-c7ff849ca90d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.960804 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1092ba85-270f-458b-ad81-62f99b9082c7 req-72681dd3-b8d9-44e1-bd4f-c7ff849ca90d service nova] Creating event network-changed:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:09:49.966007 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1092ba85-270f-458b-ad81-62f99b9082c7 req-72681dd3-b8d9-44e1-bd4f-c7ff849ca90d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Jul 30 21:09:49.966605 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1210/2331] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:49.972829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-43d165cb-1d0a-4f02-a82a-8ed6b91d29c6 req-8aa61a21-a30f-42fc-9e8e-d7a75607c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f4af92-7e39-4b71-9cd1-952ce0c8e42f", "name": "network-vif-unplugged", "status": "completed", "tag": "8f18a742-6484-4954-9a1a-04574afb6edc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:49.983540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-43d165cb-1d0a-4f02-a82a-8ed6b91d29c6 req-8aa61a21-a30f-42fc-9e8e-d7a75607c291 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:49.984001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-43d165cb-1d0a-4f02-a82a-8ed6b91d29c6 req-8aa61a21-a30f-42fc-9e8e-d7a75607c291 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:49.995612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-43d165cb-1d0a-4f02-a82a-8ed6b91d29c6 req-8aa61a21-a30f-42fc-9e8e-d7a75607c291 service nova] Creating event network-vif-unplugged:8f18a742-6484-4954-9a1a-04574afb6edc for instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f on nch1-master-1 Jul 30 21:09:50.001338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-43d165cb-1d0a-4f02-a82a-8ed6b91d29c6 req-8aa61a21-a30f-42fc-9e8e-d7a75607c291 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032510 Jul 30 21:09:50.002013 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1211/2332] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:50.007589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.008485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.015642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.016095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.016890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.017342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.103012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:50.113415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b91a174e-1c42-4d7c-a5c0-26c2124659ec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1461 microversion: 2.1 time: 0.342785 Jul 30 21:09:50.114338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1122/2333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:49 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1461 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:50.135490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6977f6c3-39cc-4b6d-9b89-61718cfda5e9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] Calling method '.version_select at 0x7fbb628e6a60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.189183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:50.199738 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad4999f1-5e57-41b7-88c9-012f3295fd29 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1523 microversion: 2.1 time: 0.196474 Jul 30 21:09:50.214147 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1212/2334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:50.219462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.220307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.227707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.228415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.229394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.229996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.398190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:50.406311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3363fbe-f5b0-48b8-ad9b-6f59ce87ffa6 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.190621 Jul 30 21:09:50.406954 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1213/2335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:50.412997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.413650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.421344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.421818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.422622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.423079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.442059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:50.492455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:50.500965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f32d08e2-b5ae-4a06-8f4d-68594507ab1d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1285 microversion: 2.1 time: 0.092076 Jul 30 21:09:50.501846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1214/2336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:50.506955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.507591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.514428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.515034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.515992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.517082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.686265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:50.701801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-599d1a14-5ef1-447e-b0f2-3f728fcfe318 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1461 microversion: 2.1 time: 0.198254 Jul 30 21:09:50.719412 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1215/2337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1461 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:50.737972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3071872-d3ef-45ee-8a4e-8dc5ced827a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'create', calling method: .version_select at 0x7fbb6294a430>, body: {"keypair": {"name": "tempest-keypair-1302841326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMuTkzYIroFjuz7CKUOFItKYt2Z+yLGxMSLC/yURDgNCLCL27ztEKOatsUSsV+6afAZKUA2SHZqD2vc5cncLZI+HLbiTgmbVBufRfZhIe7xaekOavlLpfT2vO6LcBjvlw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:50.772862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a3071872-d3ef-45ee-8a4e-8dc5ced827a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:50.789137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a3071872-d3ef-45ee-8a4e-8dc5ced827a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:50.827479 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6977f6c3-39cc-4b6d-9b89-61718cfda5e9 tempest-SecurityGroupsTestJSON-2033432162 tempest-SecurityGroupsTestJSON-2033432162-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a81851b1-f980-4ca6-bf9b-089f7745d70d" status: 202 len: 0 microversion: 2.1 time: 0.711628 Jul 30 21:09:50.828190 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1123/2338] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:09:50 2022] DELETE /compute/v2.1/os-security-groups/a81851b1-f980-4ca6-bf9b-089f7745d70d => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:09:50.836319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.837021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.846415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:50.848347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3071872-d3ef-45ee-8a4e-8dc5ced827a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118746 Jul 30 21:09:50.858875 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1216/2339] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:09:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:50.862434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.862969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.863867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.864597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.898240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:50.956502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:50.957072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:50.971888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.973382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:50.974636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:50.976371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:51.411217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:51.425323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:51.429070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:51.430538 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f2055bc0-dfe3-4b49-810d-487b59eca46e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 0.480729 Jul 30 21:09:51.431671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1217/2340] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:09:51.439085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:51.440036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:51.447753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:51.448499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:51.450128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:51.451482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:51.676447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:51.686243 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b253384-6369-4634-ae4e-d9931bb16006 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.856881 Jul 30 21:09:51.690720 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1124/2341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:50 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:51.696230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "tag": "fc09815c-9698-426c-ae3b-1bc29942d22b"}, {"name": "network-changed", "server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "tag": "b771d596-e80e-4dd6-8bf1-6adc34b796d3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:51.711228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:51.715102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:51.738682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] Creating event network-changed:fc09815c-9698-426c-ae3b-1bc29942d22b for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:09:51.743131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] Creating event network-changed:b771d596-e80e-4dd6-8bf1-6adc34b796d3 for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:09:51.763195 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-226c5e91-7259-4e0d-9bcd-c53e1fd338ee req-08240cc4-1f04-4d33-b310-cb16b669bfdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070956 Jul 30 21:09:51.764470 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1125/2342] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:51.775375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:51.778540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:51.793686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:51.794791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:51.795984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:51.796978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:52.192561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:52.201434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a8a0998-442d-4d0a-afc2-7448b460e108 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1523 microversion: 2.1 time: 0.768438 Jul 30 21:09:52.202266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1218/2343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:51 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1523 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:52.207382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:52.208169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:52.208365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:52.215006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:52.215744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:52.216735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:52.217162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:52.224650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0134628a-4b12-4ca0-b047-c2e0ebc63244 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.458335 Jul 30 21:09:52.226511 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1126/2344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:51 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:52.322896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-436555297", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:52.408323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] validate_networks() for [('017caf28-79cd-4ffa-9be8-ca1d78ee7a8b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:52.415153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:52.425250 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae204df2-811a-4341-9088-4b765eeff3b3 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1273 microversion: 2.1 time: 0.220461 Jul 30 21:09:52.426696 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1219/2345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:52 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:52.432980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-25258959-bc77-4a45-8ee3-b6feee6b043d req-fcb0092c-6882-4d95-b15a-0b2939f6d4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f4af92-7e39-4b71-9cd1-952ce0c8e42f", "name": "network-vif-plugged", "status": "completed", "tag": "8f18a742-6484-4954-9a1a-04574afb6edc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:52.449131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-25258959-bc77-4a45-8ee3-b6feee6b043d req-fcb0092c-6882-4d95-b15a-0b2939f6d4a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:52.450235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-25258959-bc77-4a45-8ee3-b6feee6b043d req-fcb0092c-6882-4d95-b15a-0b2939f6d4a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:52.474113 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-25258959-bc77-4a45-8ee3-b6feee6b043d req-fcb0092c-6882-4d95-b15a-0b2939f6d4a6 service nova] Creating event network-vif-plugged:8f18a742-6484-4954-9a1a-04574afb6edc for instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f on nch1-master-1 Jul 30 21:09:52.481732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-25258959-bc77-4a45-8ee3-b6feee6b043d req-fcb0092c-6882-4d95-b15a-0b2939f6d4a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053580 Jul 30 21:09:52.491209 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1220/2346] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:52.499276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:52.502633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:52.526023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:52.526928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:52.528388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:52.530001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.001431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:53.020631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:53.022205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:53.023565 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f193c5f7-5be8-4a86-a69c-c87381df8d77 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 0.530635 Jul 30 21:09:53.024307 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1221/2347] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:52 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:53.029248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:53.029976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:53.044225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.048410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.056344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.057276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.322743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:53.349093 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3073c83-2b2d-4d2a-8d2c-5285760cd37a tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.323080 Jul 30 21:09:53.351119 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1222/2348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:53 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:53.360742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:53.361614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:53.370066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.370798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.371895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.372504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.635727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:53.637193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:53.638294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:53.639425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:53.640422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:53.657264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.657994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.659840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.660461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.673002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=7 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:53.686334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:53.693006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for user 8b930b074300497fa17ae36dc074c586 and project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:53.711867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:53.714695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:53.794903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c3bfcce9-806b-436f-a4b9-311be7ef61c9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.566648 Jul 30 21:09:53.797838 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1127/2349] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:53.804279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:53.805171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:53.812076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.813516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:53.814502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:53.815095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:54.034662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:54.048760 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-545b727e-4e85-43cc-9f00-7375c40b9e86 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1523 microversion: 2.1 time: 0.695304 Jul 30 21:09:54.065716 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1223/2350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:53 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:54.090487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:54.093391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:54.124070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:54.125023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:54.128745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:54.128914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:54.180779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:54.199377 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cad74249-6f84-48d8-babe-53fa495de81c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.397745 Jul 30 21:09:54.220919 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1128/2351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:53 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:54.238695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c77a91a-2df6-4508-9f98-bb48e7a55c29 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:54.239658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c77a91a-2df6-4508-9f98-bb48e7a55c29 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:54.394942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c77a91a-2df6-4508-9f98-bb48e7a55c29 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:54.414919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c77a91a-2df6-4508-9f98-bb48e7a55c29 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1221 microversion: 2.1 time: 0.192101 Jul 30 21:09:54.416645 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1129/2352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:54 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:54.437075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:54.440112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:54.469368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:54.469856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:54.470680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:54.471147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:55.116738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:55.130156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d86e3107-e409-4997-832c-d89bcbba4877 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 1.060024 Jul 30 21:09:55.131070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1224/2353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:54 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:55.140659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:55.142778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:55.156853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:55.160411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:55.161451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:55.162073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:55.237691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:55.247016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:55.252948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:55.260654 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fc7c949-812a-4e8d-8985-c9e511a3ba7f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 0.838745 Jul 30 21:09:55.261458 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1130/2354] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:54 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:55.272071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1851447551", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:55.376974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] validate_networks() for [('017caf28-79cd-4ffa-9be8-ca1d78ee7a8b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:55.713565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:55.733373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aedeb2b5-7605-4fef-91ef-310ee62598f5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.597696 Jul 30 21:09:55.734692 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1225/2355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:55 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:55.742468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:55.743374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:55.751340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:55.752313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:55.754047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:55.754846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.519773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:56.531048 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94fdd8ec-bac4-427a-8af0-3840c6bac964 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1508 microversion: 2.1 time: 0.794670 Jul 30 21:09:56.543584 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1226/2356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:55 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1508 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:56.548523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f7c876fd-abdc-4e2b-906e-c8fb059643ac req-41d1f4a9-155e-4e0f-bf59-bf6a410d9ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "name": "network-vif-plugged", "status": "completed", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:56.559211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f7c876fd-abdc-4e2b-906e-c8fb059643ac req-41d1f4a9-155e-4e0f-bf59-bf6a410d9ad2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.560163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f7c876fd-abdc-4e2b-906e-c8fb059643ac req-41d1f4a9-155e-4e0f-bf59-bf6a410d9ad2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.573559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f7c876fd-abdc-4e2b-906e-c8fb059643ac req-41d1f4a9-155e-4e0f-bf59-bf6a410d9ad2 service nova] Creating event network-vif-plugged:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:09:56.579511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f7c876fd-abdc-4e2b-906e-c8fb059643ac req-41d1f4a9-155e-4e0f-bf59-bf6a410d9ad2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045276 Jul 30 21:09:56.583108 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1227/2357] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:56.590204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:56.591151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:56.598843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.599674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.600904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.601804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.721094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:56.721650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:56.722745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:56.723304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:56.724011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:56.736187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.736913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.738505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.739191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.762375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:56.775104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for user 8b930b074300497fa17ae36dc074c586 and project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:56.796192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:56.799045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:56.861337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebad1f31-c11a-4ca9-9171-268ac21b363b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.598548 Jul 30 21:09:56.864194 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1131/2358] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:56.876799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:56.879219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:56.895075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.897621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:56.898587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:56.900413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.155281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:57.163819 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06c5e036-3a86-4440-bdba-f137d9b19cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.579260 Jul 30 21:09:57.175784 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1228/2359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:56 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:57.182497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:57.183363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:57.195336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.196059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.197021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.197629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.216390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:57.234214 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9bb81353-501c-4391-8279-838fdd57814d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.366747 Jul 30 21:09:57.244258 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1132/2360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:56 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:57.247553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:57.269453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:57.292077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.292550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.293362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.293818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.624734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:57.633213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-45463cae-56ea-45d9-a90d-e6eeaf3ee933 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 200 len: 1508 microversion: 2.1 time: 0.389773 Jul 30 21:09:57.655730 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1133/2361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:57 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:57.665983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55118de4-fc2e-4478-88f8-cf19a3de7996 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '.version_select at 0x7fbb6289cb80>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:57.669916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55118de4-fc2e-4478-88f8-cf19a3de7996 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.670392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55118de4-fc2e-4478-88f8-cf19a3de7996 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.701278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55118de4-fc2e-4478-88f8-cf19a3de7996 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.039364 Jul 30 21:09:57.702379 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1134/2362] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:09:57 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:57.713760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:57.714658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:57.723911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.727886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.728889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:57.729501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:57.959213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:57.970343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b4180a0-d0ca-468e-bee4-84365e79ccf3 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.266620 Jul 30 21:09:57.977523 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1135/2363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:57 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:57.984896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:57.985787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:58.021691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.022434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.023455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.025571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.136505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:58.160062 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac94ac99-856f-43b7-926d-e6965d924069 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1274 microversion: 2.1 time: 0.181002 Jul 30 21:09:58.160681 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1136/2364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:57 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:58.171968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5f3e452c-f1a8-4921-81b7-7aa327aa78ec req-9e4295c2-1592-49bf-8100-5d41af8355f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9096a102-3b3f-47fb-892b-cf2120a2d65a", "tag": "a3ff8f7a-f78c-4e3e-a643-2cc142f1d030"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:58.199039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f3e452c-f1a8-4921-81b7-7aa327aa78ec req-9e4295c2-1592-49bf-8100-5d41af8355f6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.199599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f3e452c-f1a8-4921-81b7-7aa327aa78ec req-9e4295c2-1592-49bf-8100-5d41af8355f6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.220282 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5f3e452c-f1a8-4921-81b7-7aa327aa78ec req-9e4295c2-1592-49bf-8100-5d41af8355f6 service nova] Creating event network-changed:a3ff8f7a-f78c-4e3e-a643-2cc142f1d030 for instance 9096a102-3b3f-47fb-892b-cf2120a2d65a on nch2-master-1 Jul 30 21:09:58.228614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5f3e452c-f1a8-4921-81b7-7aa327aa78ec req-9e4295c2-1592-49bf-8100-5d41af8355f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066610 Jul 30 21:09:58.229776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1137/2365] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:58.236574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:58.237559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:58.248587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.249355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.251443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.252285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.302043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:09:58.434284 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9b404365-6c39-4486-8ef8-28c146ff47b8 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 204 len: 0 microversion: 2.1 time: 0.200344 Jul 30 21:09:58.439562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1138/2366] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:09:58 2022] DELETE /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:09:58.448725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88d2587d-3ebb-46e9-b258-d3c2f42e803f tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:58.459501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88d2587d-3ebb-46e9-b258-d3c2f42e803f tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017095 Jul 30 21:09:58.460930 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1139/2367] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:09:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:58.467688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:58.468523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:58.475587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.476024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.476830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.477278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.658970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:58.672611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:58.674259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:58.677806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a1db791-226b-42e2-9028-7c06e1107f4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1406 microversion: 2.20 time: 1.500917 Jul 30 21:09:58.678589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1229/2368] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:09:57 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1406 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:09:58.683953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:58.688428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:58.696283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.696851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.697721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.698246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.751680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:58.760693 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9d97005-c65d-4c06-8b04-d85604643679 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.297760 Jul 30 21:09:58.761364 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1140/2369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:58 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:58.766462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-85708208-9e8a-4a2b-a51e-a76a2debcff3 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-867288636", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:58.770201 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:09:58.770201 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:09:58.797436 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-85708208-9e8a-4a2b-a51e-a76a2debcff3 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.034450 Jul 30 21:09:58.799067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1141/2370] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 30 21:09:58 2022] POST /compute/v2.1/flavors => generated 498 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:58.804987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3d6f03e6-e988-4ec9-9d91-1169dd3f6d07 req-62f2fa2e-72b5-4eaa-a92d-fee8e5eefeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914fd755-9940-4f50-9f38-378ea723e33e", "name": "network-vif-plugged", "status": "completed", "tag": "8745a6b9-a208-4303-b33c-e934968b161e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:58.816258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3d6f03e6-e988-4ec9-9d91-1169dd3f6d07 req-62f2fa2e-72b5-4eaa-a92d-fee8e5eefeb5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:58.816999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3d6f03e6-e988-4ec9-9d91-1169dd3f6d07 req-62f2fa2e-72b5-4eaa-a92d-fee8e5eefeb5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:58.830759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3d6f03e6-e988-4ec9-9d91-1169dd3f6d07 req-62f2fa2e-72b5-4eaa-a92d-fee8e5eefeb5 service nova] Creating event network-vif-plugged:8745a6b9-a208-4303-b33c-e934968b161e for instance 914fd755-9940-4f50-9f38-378ea723e33e on nch2-master-1 Jul 30 21:09:58.837260 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3d6f03e6-e988-4ec9-9d91-1169dd3f6d07 req-62f2fa2e-72b5-4eaa-a92d-fee8e5eefeb5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Jul 30 21:09:58.838082 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1142/2371] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:09:58.844887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1311220785", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "e18630d2-267b-48ad-955d-1514746d6c6c"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:09:58.905846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] validate_networks() for [('e18630d2-267b-48ad-955d-1514746d6c6c', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:09:59.102122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:59.133448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0422689-3287-45bf-a805-7de294fbc00d tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.448573 Jul 30 21:09:59.151063 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1230/2372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:58 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:59.161411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e91449cd-dfbe-443b-86c7-5d2191c82cfe tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:59.191220 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e91449cd-dfbe-443b-86c7-5d2191c82cfe tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038037 Jul 30 21:09:59.197295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1231/2373] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Jul 30 21:09:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:09:59.203175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:59.204018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:59.229315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.230022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.232253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.234468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.658543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:09:59.668126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8db42fa-cac5-4fdb-bf9d-1e27ff5b833b tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.469473 Jul 30 21:09:59.684202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1232/2374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:59 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:09:59.689998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:09:59.690630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:09:59.699469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.700639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.701811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:09:59.702266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:09:59.702392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.702989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:09:59.703575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:09:59.703846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.704294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:09:59.719149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.719731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.720590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:09:59.721046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:09:59.812733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:09:59.827711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Getting quotas for user 2517a20b0358424480784b0003512d50 and project d9be740494d2497cb1771330a1ba99f1. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:09:59.846075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:09:59.848488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:09:59.926339 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f56d4e1-b0cf-4e14-aef6-e5da1c30a744 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083823 Jul 30 21:09:59.933762 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1143/2375] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:09:59.939980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-660983108", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "55b98233-bb62-4348-9dd0-b7ca4dca6f12"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:00.021134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:00.326257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:00.326695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:00.327359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:00.327793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:00.328166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:00.347445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.347925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.348771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.349237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.399363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:00.409031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:00.412113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:00.424756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-897d9119-0188-49e3-b49e-b9c117e0d804 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.738718 Jul 30 21:10:00.431450 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1233/2376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:09:59 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:00.433521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:00.434552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:00.435866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:00.437186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:00.437661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:00.456910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.459132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.461061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.463719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.491930 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4907715d-be71-4399-b6f7-d5d38f9247cf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556491 Jul 30 21:10:00.493298 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1144/2377] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:10:00.498611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:00.499400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:00.509567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.510237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.511304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:00.511451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:00.512607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:00.811925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:00.985958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.007704 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ccb963dc-eeab-43f0-b60d-b0116ebb9b3c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1371 microversion: 2.1 time: 0.512818 Jul 30 21:10:01.035977 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1145/2378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:00 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:01.048517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:01.051226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:01.066164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.068103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.070905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.071650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.199958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.211854 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d28e65d-0c8c-4b21-9107-9ba46bec40c1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1214 microversion: 2.1 time: 0.174260 Jul 30 21:10:01.212877 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1146/2379] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:01 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:01.228096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:01.229232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:01.251723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.252451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.260073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.260670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.283989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:01.511511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.546848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.551326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.556591 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53ff73f4-846e-483e-b3e1-b93f85ce366f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1597 microversion: 2.20 time: 1.129657 Jul 30 21:10:01.558351 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1234/2380] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:00 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1597 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:01.592247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:01.605143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:01.624138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.625134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.627032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.627809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.706757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.721285 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-18c6e3dd-5d75-4b9f-9d65-61a9f859a331 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.502943 Jul 30 21:10:01.721876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1147/2381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:01 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:01.727533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:01.736045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:01.748665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.749260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.760461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.761203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.833767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:01.847072 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7a22a63-b75c-4671-8704-bcdbe7fbddf2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1274 microversion: 2.1 time: 0.284675 Jul 30 21:10:01.851506 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1235/2382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:01 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:01.856501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-256aefc1-95ec-4b02-be92-cbfcd1d4f58f req-479344e5-ea80-435c-a5f5-03eb19ae178f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "name": "network-vif-plugged", "status": "completed", "tag": "fc09815c-9698-426c-ae3b-1bc29942d22b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:01.870473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-256aefc1-95ec-4b02-be92-cbfcd1d4f58f req-479344e5-ea80-435c-a5f5-03eb19ae178f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.870942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-256aefc1-95ec-4b02-be92-cbfcd1d4f58f req-479344e5-ea80-435c-a5f5-03eb19ae178f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.885156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-256aefc1-95ec-4b02-be92-cbfcd1d4f58f req-479344e5-ea80-435c-a5f5-03eb19ae178f service nova] Creating event network-vif-plugged:fc09815c-9698-426c-ae3b-1bc29942d22b for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:10:01.890321 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-256aefc1-95ec-4b02-be92-cbfcd1d4f58f req-479344e5-ea80-435c-a5f5-03eb19ae178f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040298 Jul 30 21:10:01.890926 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1236/2383] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:01.900169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:01.900896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:01.908037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.908831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:01.909863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:01.910628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.142374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:02.169310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90d473a4-20f0-44f3-88c4-ef37941ee741 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.445435 Jul 30 21:10:02.181145 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1148/2384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:01 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:02.194114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:02.194931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:02.213079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.214486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.215661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.216174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.443654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:02.458440 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-93274a16-5d97-446c-a1e1-e65e35e627d4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.563222 Jul 30 21:10:02.459463 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1237/2385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:01 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:02.479521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:02.487938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:02.509075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.509784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.510777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.511575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.843221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:02.855379 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fafbbc41-1c89-4d3e-b326-c43b416a8128 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1557 microversion: 2.1 time: 0.388720 Jul 30 21:10:02.855858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1238/2386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:02 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1557 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:02.886907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:02.888996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:02.897389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.898136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:02.899134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:02.900169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.047164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:03.053559 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b456ad3e-afc0-4765-99a5-6d63b540cc53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.868885 Jul 30 21:10:03.054623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1149/2387] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:10:02 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-interface => generated 284 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:10:03.060390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4cfe0045-e6b5-4a5c-aac7-0353d0de1674 req-c43188c3-d902-469d-9879-1a4d8ebb7c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cdffb63-cce7-4f8c-93e6-1e91d1a86b33", "tag": "9d400d81-f07e-4a3a-9e3f-1e017498e75b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:03.062792 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d42609f-a76a-4a12-9b39-b7cdb5529403 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1276 microversion: 2.1 time: 0.205281 Jul 30 21:10:03.079655 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1239/2388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:02 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:03.085501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:03.086141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:03.091726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4cfe0045-e6b5-4a5c-aac7-0353d0de1674 req-c43188c3-d902-469d-9879-1a4d8ebb7c50 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.092487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4cfe0045-e6b5-4a5c-aac7-0353d0de1674 req-c43188c3-d902-469d-9879-1a4d8ebb7c50 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.108969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.109339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.109829 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4cfe0045-e6b5-4a5c-aac7-0353d0de1674 req-c43188c3-d902-469d-9879-1a4d8ebb7c50 service nova] Creating event network-changed:9d400d81-f07e-4a3a-9e3f-1e017498e75b for instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 on nch1-master-1 Jul 30 21:10:03.110144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.110599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.123832 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4cfe0045-e6b5-4a5c-aac7-0353d0de1674 req-c43188c3-d902-469d-9879-1a4d8ebb7c50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063315 Jul 30 21:10:03.125184 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1150/2389] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:03.131948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:03.133067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:03.142426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.143703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.146822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.147662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.370203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:03.385151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b14276ee-047a-4193-a745-0207fb27ddd5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1336 microversion: 2.1 time: 0.257273 Jul 30 21:10:03.385855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1151/2390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:03 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1336 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:03.392053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:03.393816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:03.402301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.403148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.404669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.405393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.523928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:03.531958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3675b24b-dfc7-4ccf-a1b8-d40416e0c79a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.451139 Jul 30 21:10:03.533385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1240/2391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:03 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:03.540703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:03.543159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:03.554369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.555126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.556316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.557376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.731010 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f6ac44b1-a0d8-40ec-8d67-a9e64bd1b2a4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343752 Jul 30 21:10:03.732822 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1152/2392] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:10:03 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-interface => generated 285 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:03.744928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:03.746751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:03.755556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.756922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.758627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.759871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.916820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:03.930230 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9aa66d3c-dc13-4be0-8d7a-76277b8b16de tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 0.393423 Jul 30 21:10:03.931261 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1241/2393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:03 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:03.936792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2f9a9bbe-cc22-4ba0-879a-edf29f99bbff req-d7adde31-cf32-4a74-9de5-7334fb18ebbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "name": "network-vif-plugged", "status": "completed", "tag": "b771d596-e80e-4dd6-8bf1-6adc34b796d3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:03.946323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:03.949193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f9a9bbe-cc22-4ba0-879a-edf29f99bbff req-d7adde31-cf32-4a74-9de5-7334fb18ebbc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:03.950303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f9a9bbe-cc22-4ba0-879a-edf29f99bbff req-d7adde31-cf32-4a74-9de5-7334fb18ebbc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:03.971903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2f9a9bbe-cc22-4ba0-879a-edf29f99bbff req-d7adde31-cf32-4a74-9de5-7334fb18ebbc service nova] Creating event network-vif-plugged:b771d596-e80e-4dd6-8bf1-6adc34b796d3 for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:10:03.979347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2f9a9bbe-cc22-4ba0-879a-edf29f99bbff req-d7adde31-cf32-4a74-9de5-7334fb18ebbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046495 Jul 30 21:10:03.980289 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1242/2394] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:04.091727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:04.093901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:04.102141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.103146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.104449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.105114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.200637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:04.209752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d27f947b-275e-4201-8815-caab0f26c6f5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1276 microversion: 2.1 time: 0.126796 Jul 30 21:10:04.210625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1243/2395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:04 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:04.229677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-14e8dd97-f0cf-4178-bf6c-794c7ae15c99 req-1afa0766-140f-4ed0-ad47-570d8ff06ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34a758e-5ea9-47fa-bee4-115ca0e7d0f9", "tag": "41c8040e-13f4-4674-a483-0056062f66f2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:04.261795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-14e8dd97-f0cf-4178-bf6c-794c7ae15c99 req-1afa0766-140f-4ed0-ad47-570d8ff06ed8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.262541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-14e8dd97-f0cf-4178-bf6c-794c7ae15c99 req-1afa0766-140f-4ed0-ad47-570d8ff06ed8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.276899 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-14e8dd97-f0cf-4178-bf6c-794c7ae15c99 req-1afa0766-140f-4ed0-ad47-570d8ff06ed8 service nova] Creating event network-changed:41c8040e-13f4-4674-a483-0056062f66f2 for instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 on nch2-master-1 Jul 30 21:10:04.286143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-14e8dd97-f0cf-4178-bf6c-794c7ae15c99 req-1afa0766-140f-4ed0-ad47-570d8ff06ed8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067046 Jul 30 21:10:04.286841 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1244/2396] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:04.410273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:04.411114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:04.418703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.419459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.421294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.421819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.506336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:04.515557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ecb6c762-6bea-4703-8bd6-910d39b50641 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1336 microversion: 2.1 time: 0.110824 Jul 30 21:10:04.527352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1245/2397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:04 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:04.556052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:04.556896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:04.563813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.564375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.565464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.565773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.666853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:04.688178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20be83ae-f7d1-4f3c-be42-ba059bf278c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.951160 Jul 30 21:10:04.690140 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1153/2398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:03 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:04.844515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:04.860009 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7bc1d575-3637-4dd6-a6c4-bd979b62a9cf tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.309388 Jul 30 21:10:04.878109 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1246/2399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:04 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:04.954422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:04.955155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:04.964832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.967816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:04.968676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:04.969171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.176877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5ac4877c-3000-44bc-bd53-d285bff600c1 req-d64c3084-985d-4437-954c-4ff4c54ecea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f4af92-7e39-4b71-9cd1-952ce0c8e42f", "name": "network-vif-deleted", "tag": "8f18a742-6484-4954-9a1a-04574afb6edc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:05.189274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5ac4877c-3000-44bc-bd53-d285bff600c1 req-d64c3084-985d-4437-954c-4ff4c54ecea7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.189755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5ac4877c-3000-44bc-bd53-d285bff600c1 req-d64c3084-985d-4437-954c-4ff4c54ecea7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.203454 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5ac4877c-3000-44bc-bd53-d285bff600c1 req-d64c3084-985d-4437-954c-4ff4c54ecea7 service nova] Creating event network-vif-deleted:8f18a742-6484-4954-9a1a-04574afb6edc for instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f on nch1-master-1 Jul 30 21:10:05.209877 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5ac4877c-3000-44bc-bd53-d285bff600c1 req-d64c3084-985d-4437-954c-4ff4c54ecea7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039115 Jul 30 21:10:05.210865 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1247/2400] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:05.235773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:05.236944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:05.244545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.245376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.246721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.247352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.378874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:05.390808 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48dbd624-3196-48aa-a1f8-e014c78cd1af tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1276 microversion: 2.1 time: 0.162343 Jul 30 21:10:05.391761 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1248/2401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:05 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:05.538483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:05.539401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:05.549058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.549800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.550986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.551778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.661306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:05.673330 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-56ac69fb-5856-48cc-8499-d0fee29962bd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1336 microversion: 2.1 time: 0.139357 Jul 30 21:10:05.689900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1249/2402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:05 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:05.715007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:05.715689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:05.743563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.745657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:05.746647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:05.748813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.031050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:06.046507 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3c95001-5474-484d-b132-475a907fec84 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1334 microversion: 2.1 time: 1.096986 Jul 30 21:10:06.048895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1154/2403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:04 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1334 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:06.058940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:06.060597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:06.072147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:06.073351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.074427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:06.075082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.421367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:06.432259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c25cdea1-ea31-44f2-997d-d316c02ab86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.721882 Jul 30 21:10:06.432864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1250/2404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:05 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:06.440433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8fc6fc07-b08c-4b68-a651-de60fba3f4bb req-78611721-885b-48fd-bce1-63bb813978af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9096a102-3b3f-47fb-892b-cf2120a2d65a", "name": "network-vif-plugged", "status": "completed", "tag": "a3ff8f7a-f78c-4e3e-a643-2cc142f1d030"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:06.469516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8fc6fc07-b08c-4b68-a651-de60fba3f4bb req-78611721-885b-48fd-bce1-63bb813978af service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:06.469966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8fc6fc07-b08c-4b68-a651-de60fba3f4bb req-78611721-885b-48fd-bce1-63bb813978af service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.498942 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8fc6fc07-b08c-4b68-a651-de60fba3f4bb req-78611721-885b-48fd-bce1-63bb813978af service nova] Creating event network-vif-plugged:a3ff8f7a-f78c-4e3e-a643-2cc142f1d030 for instance 9096a102-3b3f-47fb-892b-cf2120a2d65a on nch2-master-1 Jul 30 21:10:06.512984 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8fc6fc07-b08c-4b68-a651-de60fba3f4bb req-78611721-885b-48fd-bce1-63bb813978af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076059 Jul 30 21:10:06.513934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1251/2405] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:06.522320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:06.528988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:06.543872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:06.545141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.546963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:06.549390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:06.955762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:06.971407 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05aadd32-be53-46e3-8efb-aa02f624c969 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.454754 Jul 30 21:10:06.974867 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1252/2406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:06 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:06.990502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:06.996832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:07.025162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.035555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.038151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.039096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.262110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:07.277147 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-af99c40a-c298-4066-a375-fa31bf07e23e tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 1.226370 Jul 30 21:10:07.280588 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1155/2407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:06 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:07.293234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:07.312640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:07.342799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.343717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.344744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.346672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.359702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:07.371641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71782bec-5a18-4352-8d2c-46561dffdbbe tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.392525 Jul 30 21:10:07.372391 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1253/2408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:06 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:07.454182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:07.454953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:07.465029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.466941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.468051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:07.468661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:07.519523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:07.944476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:07.955244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75a9038f-a338-419c-9347-c8dd79f13bfb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.505483 Jul 30 21:10:07.957056 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1254/2409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:07 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:08.005143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.006078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.018869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.019797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.020681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.021137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.343127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:08.351716 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-66e6bba5-5715-4008-9879-6f6a11495be2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.351950 Jul 30 21:10:08.366138 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1255/2410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:07 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:08.375538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.376395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.383722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.384198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.385005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.385467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.425137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:08.437939 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49b072e5-fa17-4017-b285-af9b02774f31 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1669 microversion: 2.1 time: 1.154116 Jul 30 21:10:08.438796 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1156/2411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:07 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1669 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:08.445643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.451703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.466479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.467181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.468166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.468944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.569693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:08.577618 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18ddeffd-45bc-444c-86e1-1d5176735c19 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.206389 Jul 30 21:10:08.578217 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1256/2412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:08 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:08.582984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.583697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.590783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.591240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.592275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.592719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.619174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6d98db40-fac5-478e-beb7-da0e30b248af tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0/ips" status: 200 len: 179 microversion: 2.1 time: 0.039681 Jul 30 21:10:08.620439 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1257/2413] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:10:08 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0/ips => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:08.632770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.633572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.640888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.641631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.642678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.643385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.679041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:10:08.791911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a05bdca6-b500-46cd-b44e-7f6fc7394edc tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 204 len: 0 microversion: 2.1 time: 0.162221 Jul 30 21:10:08.796529 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1258/2414] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:08 2022] DELETE /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:08.804044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:08.805095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:08.813130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.813908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.814999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:08.815680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:08.986756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:09.004700 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ee22130-3bd4-4f13-831c-a9d711ce90e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.564589 Jul 30 21:10:09.012545 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1157/2415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:08 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:09.017549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:09.018356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:09.037180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.038253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.039258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.039897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.187581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:09.202786 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3180c9b3-8667-4175-afcc-820b2f8fcc82 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1675 microversion: 2.1 time: 0.403868 Jul 30 21:10:09.203762 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1259/2416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:08 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1675 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:09.309599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1a616920-e6c1-41d1-9c74-b6e09a749c93 req-fea6c381-aab2-42e8-9319-c17777a61c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:09.331819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1a616920-e6c1-41d1-9c74-b6e09a749c93 req-fea6c381-aab2-42e8-9319-c17777a61c53 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.332620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1a616920-e6c1-41d1-9c74-b6e09a749c93 req-fea6c381-aab2-42e8-9319-c17777a61c53 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.369579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1a616920-e6c1-41d1-9c74-b6e09a749c93 req-fea6c381-aab2-42e8-9319-c17777a61c53 service nova] Creating event network-changed:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:10:09.389176 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1a616920-e6c1-41d1-9c74-b6e09a749c93 req-fea6c381-aab2-42e8-9319-c17777a61c53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083673 Jul 30 21:10:09.391071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1260/2417] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:09.419850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:09.428445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:09.446264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.447071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.450235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.450986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.580711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:09.594809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aff97fe8-19e1-45a3-a012-1ace6fb01b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.580754 Jul 30 21:10:09.599673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1158/2418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:09 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:09.612539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:09.613461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:09.626878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.636151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.638317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.638901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:09.911683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:09.928697 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67984ee8-520c-43fb-b865-45835612d608 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.533999 Jul 30 21:10:09.929973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1261/2419] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:09 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:09.940717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-78ccc6b7-4ba6-46f7-a5c2-1f2e6537365c req-89a916d2-6316-4d1f-afb7-1327183dcd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdffb63-cce7-4f8c-93e6-1e91d1a86b33", "name": "network-vif-plugged", "status": "completed", "tag": "9d400d81-f07e-4a3a-9e3f-1e017498e75b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:09.973234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-78ccc6b7-4ba6-46f7-a5c2-1f2e6537365c req-89a916d2-6316-4d1f-afb7-1327183dcd43 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:09.974219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-78ccc6b7-4ba6-46f7-a5c2-1f2e6537365c req-89a916d2-6316-4d1f-afb7-1327183dcd43 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.025985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-78ccc6b7-4ba6-46f7-a5c2-1f2e6537365c req-89a916d2-6316-4d1f-afb7-1327183dcd43 service nova] Creating event network-vif-plugged:9d400d81-f07e-4a3a-9e3f-1e017498e75b for instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 on nch1-master-1 Jul 30 21:10:10.031545 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-78ccc6b7-4ba6-46f7-a5c2-1f2e6537365c req-89a916d2-6316-4d1f-afb7-1327183dcd43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100113 Jul 30 21:10:10.032768 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1262/2420] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:10.060073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:10.061401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:10.085615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:10.094107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.096510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-068c03ba-bf17-4b16-9c23-a09463181c2a tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 0.493511 Jul 30 21:10:10.096903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.098742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.100029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1159/2421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:09 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:10.100464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.228264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:10.229008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:10.239110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.243617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.244611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.245192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.369530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=7 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:10.386673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:10.395364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cda53f7-8e58-438f-9e7d-caa7ecdbfc5a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.360924 Jul 30 21:10:10.400159 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1263/2422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:10 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:10.425330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=37 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:10.620025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:10.621145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:10.647990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.648913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.649994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.650780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.712301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:10.722890 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d030ad73-a526-4d8c-9039-b6b989035d9f tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1675 microversion: 2.1 time: 0.498784 Jul 30 21:10:10.723535 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1160/2423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:10 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1675 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:10.951224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:10.952258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:10.962602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.963471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:10.964747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:10.965419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.175192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:11.188982 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90d123bc-bbe3-4759-a968-b6c923385f71 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.242271 Jul 30 21:10:11.191038 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1161/2424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:10 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:11.197372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:11.198188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:11.205904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.206382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.207218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.207700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.389705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:11.409481 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4bf6e1f3-8b50-4f0d-bcb7-a5dba35321b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.790286 Jul 30 21:10:11.410243 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1264/2425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:10 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:11.432238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:11.433463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:11.448581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.449327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.455345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.456106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.797690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:11.812965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db85b301-ac44-4d2c-9b88-3c1e2b510891 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.387767 Jul 30 21:10:11.814315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1265/2426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:11 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:11.820884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914fd755-9940-4f50-9f38-378ea723e33e", "tag": "8745a6b9-a208-4303-b33c-e934968b161e"}, {"name": "network-changed", "server_uuid": "d295abd2-c66c-414c-ae62-219fe2572cb1", "tag": "4072c44f-2359-4326-a74b-1d9c30a5797b"}, {"name": "network-changed", "server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:11.834901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.835421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.857661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Creating event network-changed:8745a6b9-a208-4303-b33c-e934968b161e for instance 914fd755-9940-4f50-9f38-378ea723e33e on nch2-master-1 Jul 30 21:10:11.858473 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Creating event network-changed:4072c44f-2359-4326-a74b-1d9c30a5797b for instance d295abd2-c66c-414c-ae62-219fe2572cb1 on nch1-master-1 Jul 30 21:10:11.859001 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] Creating event network-changed:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:10:11.871689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f125f3f1-ddf9-4cd3-8fd7-3a832bef0c05 req-29e0072d-aa94-47af-857a-651e24c40762 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.055491 Jul 30 21:10:11.872662 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1266/2427] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:11.882802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:11.883812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:11.892856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.893577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:11.895585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:11.896309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.186321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:12.221462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1740d8f3-83f0-4d1e-883c-23d3784fa449 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1315 microversion: 2.1 time: 1.028848 Jul 30 21:10:12.222664 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1162/2428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:11 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:12.238512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:12.242479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:12.261970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.262922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.265116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.266094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.358777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:12.369224 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b77f1d08-86c3-47cb-901d-f118fd5f3491 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1675 microversion: 2.1 time: 0.494364 Jul 30 21:10:12.372305 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1267/2429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:11 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1675 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:12.434586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:12.435260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:12.448051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.448854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.449234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.456944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.929614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:12.941471 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebb73454-2f64-4fa5-9b4b-711b1284bcc9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.717484 Jul 30 21:10:12.942178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1163/2430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:12 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:12.960311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:12.961093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:12.969606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.970373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.971689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:12.972338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:12.988014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:13.013135 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81f3f7b1-c82c-402e-8848-3080d2a37262 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.582629 Jul 30 21:10:13.014372 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1268/2431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:12 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:13.246627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:13.247261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:13.260070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.260566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.261375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.261826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.463719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:13.473914 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c180424-4e4a-42e3-8bd1-c4c6a000d993 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.530560 Jul 30 21:10:13.477792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1164/2432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:12 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:13.482989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:13.488631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:13.495661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.496362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.497619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.498223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.535513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:13.675090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:13.698767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40b29061-58e3-4537-bfbd-986e73407f90 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1504 microversion: 2.1 time: 0.454635 Jul 30 21:10:13.723470 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1269/2433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:13 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:13.729324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:13.732088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:13.739105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.740246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.741219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.741818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.812010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:13.822182 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7381d44c-26c3-45df-b500-f7a99d593aea tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.097278 Jul 30 21:10:13.823380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1270/2434] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:10:13 2022] DELETE /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a/os-server-password => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:13.834984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:13.836064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:13.846261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.847107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.848139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:13.848940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:13.888603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-772762d4-b66b-45f7-8568-66a2ed2408cb tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059229 Jul 30 21:10:13.889389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1271/2435] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:10:13 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a/os-server-password => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:10:13.991672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:14.002829 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-866ab6be-b445-4054-bf26-5e1674818a99 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1654 microversion: 2.1 time: 0.523649 Jul 30 21:10:14.003789 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1165/2436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:13 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1654 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:14.013686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:14.014219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:14.020713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.021248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.022078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.022535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.056673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df293e8f-c21c-446f-9029-fbb398ea1e18 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Action: 'create', calling method: .version_select at 0x7fbb629988b0>, body: {"keypair": {"name": "tempest-keypair-1463920566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDYqWSPQm/DPwoqnKPKjr270L1upbUYajFXtMzSJIvd62Op7OfMO7NLR1dHjkqbjiMVjZBWBkTiedYPn/rVc7Y/93w/mXTQLK1wPKPG0rbzAkfbo2wHGaVnOsbLMxJGzQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:14.065176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:10:14.077400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-df293e8f-c21c-446f-9029-fbb398ea1e18 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for project 7174018ac671484ab204d0ad1559d683. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:14.089313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-df293e8f-c21c-446f-9029-fbb398ea1e18 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for user eb637624ed0f48c9b4ad60e2cda88eb8 and project 7174018ac671484ab204d0ad1559d683. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:14.131600 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df293e8f-c21c-446f-9029-fbb398ea1e18 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240606 Jul 30 21:10:14.132569 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1272/2437] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:10:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:14.139771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:14.150894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:14.163864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.164583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.165903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.166790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.183981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-89022977-7116-4736-9727-b724fd58fa05 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 204 len: 0 microversion: 2.1 time: 0.175842 Jul 30 21:10:14.187465 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1166/2438] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:14 2022] DELETE /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:14.197385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:14.199702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:14.208256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.208916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.209991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.210571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.471874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:14.485576 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c43f14d-66af-4e8a-95a2-a1cd26b5c852 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.351338 Jul 30 21:10:14.486806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1273/2439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:14 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:14.492671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b74be0b6-fd5e-4809-b3d6-24996de54ae8 req-5225d4b3-019d-43ca-93f4-882fba68dbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "name": "network-vif-deleted", "tag": "b771d596-e80e-4dd6-8bf1-6adc34b796d3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:14.504516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b74be0b6-fd5e-4809-b3d6-24996de54ae8 req-5225d4b3-019d-43ca-93f4-882fba68dbab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.505200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b74be0b6-fd5e-4809-b3d6-24996de54ae8 req-5225d4b3-019d-43ca-93f4-882fba68dbab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.532424 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b74be0b6-fd5e-4809-b3d6-24996de54ae8 req-5225d4b3-019d-43ca-93f4-882fba68dbab service nova] Creating event network-vif-deleted:b771d596-e80e-4dd6-8bf1-6adc34b796d3 for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:10:14.542865 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b74be0b6-fd5e-4809-b3d6-24996de54ae8 req-5225d4b3-019d-43ca-93f4-882fba68dbab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053972 Jul 30 21:10:14.543852 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1274/2440] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:14.550534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:14.551410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:14.562202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:14.562792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.563265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.564589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.564999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.572782 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c41cac3-8409-4a3a-b2a6-41a991282ad4 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.381789 Jul 30 21:10:14.572782 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1167/2441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:14 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:14.577314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d133dfe2-028d-4dce-a6dd-8a9c519ee8d4 req-cccb5392-4045-4c1a-9195-85d91bd981cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34a758e-5ea9-47fa-bee4-115ca0e7d0f9", "name": "network-vif-plugged", "status": "completed", "tag": "41c8040e-13f4-4674-a483-0056062f66f2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:14.593254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d133dfe2-028d-4dce-a6dd-8a9c519ee8d4 req-cccb5392-4045-4c1a-9195-85d91bd981cc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.593858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d133dfe2-028d-4dce-a6dd-8a9c519ee8d4 req-cccb5392-4045-4c1a-9195-85d91bd981cc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.614314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d133dfe2-028d-4dce-a6dd-8a9c519ee8d4 req-cccb5392-4045-4c1a-9195-85d91bd981cc service nova] Creating event network-vif-plugged:41c8040e-13f4-4674-a483-0056062f66f2 for instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 on nch2-master-1 Jul 30 21:10:14.626161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d133dfe2-028d-4dce-a6dd-8a9c519ee8d4 req-cccb5392-4045-4c1a-9195-85d91bd981cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051825 Jul 30 21:10:14.630049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1168/2442] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:14.635861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:14.636750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:14.646575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.646575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.646575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:14.646575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:14.786615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:14.796923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0b1d01e-227d-496f-a4ae-5435f94f6943 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1510 microversion: 2.1 time: 0.251414 Jul 30 21:10:14.797517 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1275/2443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:14 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:14.826689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:14.835397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b55bd42-85a7-403b-9137-b2c497bfd992 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.203983 Jul 30 21:10:14.836007 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1169/2444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:14 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:15.029505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:15.030063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:15.036606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.037849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.038844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.039664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.137286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6399b6f3e2574df8af12786c8755c59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c143a2d2e4b04edba1f2734d4d19d978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:15.149042 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa9f0d5a-e563-4426-b83b-d8aa0d406969 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 200 len: 1612 microversion: 2.1 time: 0.125534 Jul 30 21:10:15.159960 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1276/2445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:15 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 1612 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:15.507464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:15.508483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:15.515833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.516622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.517650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.518321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.593268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:15.593939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:15.603879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.604346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.605317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.605768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.802578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:15.811400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be8a2940-51b8-4bc4-a40a-3fb50031498d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.221857 Jul 30 21:10:15.823873 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1277/2446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:15 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:15.830579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:15.831227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:15.838337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.838807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.840023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:15.840733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:15.964879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:15.975837 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9bce446a-702b-47e2-98b2-3a2ae8a2dcc6 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.472075 Jul 30 21:10:15.989662 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1170/2447] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:15 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:16.003929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:16.015362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:16.033937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.035184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.039746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.040318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.082271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:16.110492 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70a53752-f8fd-4b84-bec1-669d751b68ee tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1510 microversion: 2.1 time: 0.282490 Jul 30 21:10:16.111947 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1278/2448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:15 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:16.172822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:16.174816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:16.183385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.184188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.185378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.186155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.228901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 HTTP/1.1 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0fdc6e54-0d1d-4746-9572-45db9fcd32e0'} Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:16.232583 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:16.236480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:16.242093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:16.243934 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd77cdd7-3d07-4861-a5a7-dbee72d30b0c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 404 len: 111 microversion: 2.1 time: 0.074472 Jul 30 21:10:16.246062 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1279/2449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:16 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:16.617384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2f3fe156-20da-4c35-b805-9821d281dde4 req-250aa684-2d4a-4f82-9ed4-eea6995d5de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9096a102-3b3f-47fb-892b-cf2120a2d65a", "name": "network-vif-deleted", "tag": "a3ff8f7a-f78c-4e3e-a643-2cc142f1d030"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:16.636332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f3fe156-20da-4c35-b805-9821d281dde4 req-250aa684-2d4a-4f82-9ed4-eea6995d5de6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.637028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f3fe156-20da-4c35-b805-9821d281dde4 req-250aa684-2d4a-4f82-9ed4-eea6995d5de6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.664077 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2f3fe156-20da-4c35-b805-9821d281dde4 req-250aa684-2d4a-4f82-9ed4-eea6995d5de6 service nova] Creating event network-vif-deleted:a3ff8f7a-f78c-4e3e-a643-2cc142f1d030 for instance 9096a102-3b3f-47fb-892b-cf2120a2d65a on nch2-master-1 Jul 30 21:10:16.676939 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2f3fe156-20da-4c35-b805-9821d281dde4 req-250aa684-2d4a-4f82-9ed4-eea6995d5de6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065944 Jul 30 21:10:16.696200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1280/2450] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:10:16.840823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:16.842698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:16.853082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.853638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.854547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:16.855178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:16.980356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:16.988229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3c925a36-acdb-43e1-8245-65eaac4b5b3e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 1.009894 Jul 30 21:10:16.989337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1171/2451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:15 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:17.013111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ad93c68b-0804-4897-92c4-ca3cb1542ef8 req-4efead05-f2c0-47ab-94fd-44c8ba9e460c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdc6e54-0d1d-4746-9572-45db9fcd32e0", "name": "network-vif-deleted", "tag": "fc09815c-9698-426c-ae3b-1bc29942d22b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:17.031523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ad93c68b-0804-4897-92c4-ca3cb1542ef8 req-4efead05-f2c0-47ab-94fd-44c8ba9e460c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.037329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:17.038597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ad93c68b-0804-4897-92c4-ca3cb1542ef8 req-4efead05-f2c0-47ab-94fd-44c8ba9e460c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.045955 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1e2ca5c4-3b49-4848-976c-b894459786e2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1322 microversion: 2.1 time: 0.210276 Jul 30 21:10:17.046861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1281/2452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:16 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:17.063208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:17.064113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:17.076795 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ad93c68b-0804-4897-92c4-ca3cb1542ef8 req-4efead05-f2c0-47ab-94fd-44c8ba9e460c service nova] Creating event network-vif-deleted:fc09815c-9698-426c-ae3b-1bc29942d22b for instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 on nch2-master-1 Jul 30 21:10:17.085394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.085862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.086669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.087121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.097981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ad93c68b-0804-4897-92c4-ca3cb1542ef8 req-4efead05-f2c0-47ab-94fd-44c8ba9e460c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095359 Jul 30 21:10:17.099194 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1172/2453] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:17.140377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:17.142347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:17.166541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.167280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.170356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.170971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.225341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:17.225937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:17.226595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lazy-loading 'fault' on Instance uuid 9096a102-3b3f-47fb-892b-cf2120a2d65a {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:10:17.297075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:17.309612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abadcf01-b181-4ee0-9af3-71d09408d588 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.260055 Jul 30 21:10:17.310217 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1282/2454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:17 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:17.405077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a0d6cf4a484ad4900293ad97249a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4eb46593544ff78b641193ec88a7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:17.415805 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b28a954-6c2f-4665-8253-ccc7ea6b4e3c tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 200 len: 1305 microversion: 2.1 time: 0.282707 Jul 30 21:10:17.431132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1173/2455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:17 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 1305 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:18.010461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:18.013317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.022304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.023103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.024183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.025142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.072524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:18.073539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.098421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.098882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.102318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.106714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.363899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:18.372971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:18.377194 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e321a9d0-c041-4673-b2d7-ebd6c0f31cbd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.371663 Jul 30 21:10:18.378741 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1283/2456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:18 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:18.388829 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98378b3c-f341-425e-894a-cf245b5c0e65 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1516 microversion: 2.1 time: 0.321367 Jul 30 21:10:18.389954 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1174/2457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:18 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:18.395906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:18.396776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.402397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:18.411549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.413005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.414208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.414430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:18.415222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.417825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.428933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.430194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.431158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.432268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.475681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'flavor' on Instance uuid b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:10:18.642056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ccd7431-54ae-4d52-a31f-5011a31ce2de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action" status: 200 len: 32 microversion: 2.1 time: 0.235192 Jul 30 21:10:18.652998 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1175/2458] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:18 2022] POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:10:18.667087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:18.668141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] [instance: 9096a102-3b3f-47fb-892b-cf2120a2d65a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.683376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.684098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.685818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.686246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.709759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] HTTP exception thrown: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Request method failure captured: Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a HTTP/1.1 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4TpkbwFnPsRsN0IYxRvknCsJ1L-FHTPXGt31RUVg2Br40cvDBmAYTI4f84adTDF31iZ9ToKBALpTQO1S1Z0bm-lG3SXicAFWw7QlRl4RidmRxwSvAZmP8607sLKQk2f4qvNbEuy5DukTiiRjVLaHrd9ZR0aiWsPr8czeTD1unzUx8 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc4eb46593544ff78b641193ec88a7c3 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerPasswordTestJSON-1899048315 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc4eb46593544ff78b641193ec88a7c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc4eb46593544ff78b641193ec88a7c3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc4eb46593544ff78b641193ec88a7c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc4eb46593544ff78b641193ec88a7c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerPasswordTestJSON-1899048315 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc4eb46593544ff78b641193ec88a7c3 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1899048315 Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerPasswordTestJSON-1899048315-project Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 70a0d6cf4a484ad4900293ad97249a5d Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerPasswordTestJSON-1899048315-project Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '9096a102-3b3f-47fb-892b-cf2120a2d65a'} Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:18.711519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] Returning 404 to user: Instance 9096a102-3b3f-47fb-892b-cf2120a2d65a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ddc3805-2b57-47ec-b0af-80d48d41b133 tempest-ServerPasswordTestJSON-1899048315 tempest-ServerPasswordTestJSON-1899048315-project] 10.222.0.17 "GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a" status: 404 len: 111 microversion: 2.1 time: 0.057797 Jul 30 21:10:18.715161 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1176/2459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:18 2022] GET /compute/v2.1/servers/9096a102-3b3f-47fb-892b-cf2120a2d65a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:18.728173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:18.731279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:18.742600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.743096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.743946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:18.744525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:18.840997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:18.854019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f72fb70b-0eca-4761-a2fb-fe8269731929 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.471847 Jul 30 21:10:18.855345 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1284/2460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:18 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:19.038056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:19.050831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9e4c5a8e-dd6f-463d-8ded-566bed38d136 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.335839 Jul 30 21:10:19.064256 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1177/2461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:18 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:19.399983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:19.401389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:19.408822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:19.409646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:19.410681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:19.411415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:19.695216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:19.712974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee994d69-c554-4dcd-bda1-39a82ff59a48 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.315451 Jul 30 21:10:19.718533 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1285/2462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:19 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:19.736464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-58ad56ff-b2ea-4608-9846-952ff7b1cac9 req-4b18b10b-5116-4243-8c61-d8d29738f1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d295abd2-c66c-414c-ae62-219fe2572cb1", "name": "network-vif-plugged", "status": "completed", "tag": "4072c44f-2359-4326-a74b-1d9c30a5797b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:19.760918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58ad56ff-b2ea-4608-9846-952ff7b1cac9 req-4b18b10b-5116-4243-8c61-d8d29738f1eb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:19.761604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58ad56ff-b2ea-4608-9846-952ff7b1cac9 req-4b18b10b-5116-4243-8c61-d8d29738f1eb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:19.780506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-58ad56ff-b2ea-4608-9846-952ff7b1cac9 req-4b18b10b-5116-4243-8c61-d8d29738f1eb service nova] Creating event network-vif-plugged:4072c44f-2359-4326-a74b-1d9c30a5797b for instance d295abd2-c66c-414c-ae62-219fe2572cb1 on nch1-master-1 Jul 30 21:10:19.785574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-58ad56ff-b2ea-4608-9846-952ff7b1cac9 req-4b18b10b-5116-4243-8c61-d8d29738f1eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057465 Jul 30 21:10:19.786708 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1178/2463] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:19.886237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:19.890737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:19.906140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:19.908782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:19.909866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:19.910583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:20.075840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:20.076891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:20.101011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:20.101485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:20.103488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:20.104348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:20.153238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:20.165734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7d53f64-06c9-4c26-a706-8128d3e3dfa9 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.292766 Jul 30 21:10:20.167119 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1286/2464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:19 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:20.521387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:20.530199 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23460413-e263-4f39-a012-1a7d5441b6e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.459826 Jul 30 21:10:20.543421 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1179/2465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:20 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:20.734023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:20.735221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:20.742241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:20.742714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:20.743579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:20.744033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:20.856597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-96054118", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a5b978ce-8439-4fa5-8b33-328c737f1922"}], "security_groups": [{"name": "tempest-securitygroup--347375968"}], "key_name": "tempest-keypair-1463920566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2cc1badd-c9dc-4e4e-80d7-47e2203c89a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:20.894096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:20.903909 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81936925-763a-4e7f-92f0-d2d1d1a6d27c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.174061 Jul 30 21:10:20.904934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1287/2466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:20 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:21.129663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] validate_networks() for [('a5b978ce-8439-4fa5-8b33-328c737f1922', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:21.189912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.191172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.199405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.199872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.200705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.201152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.347306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:21.360990 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-378e2834-523c-45e4-97dd-ab3a93905d08 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1318 microversion: 2.1 time: 0.176184 Jul 30 21:10:21.361701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1288/2467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:21 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:21.551993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.553041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.559990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.560458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.561253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.561722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.717013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:21.725688 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-013b40d2-562b-40b6-90cf-f454b02d1a75 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.177799 Jul 30 21:10:21.726274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1289/2468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:21 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:21.770157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.771368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.779240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.779814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.780607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.781056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.797197 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 HTTP/1.1 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0fdc6e54-0d1d-4746-9572-45db9fcd32e0'} Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:21.799700 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.804949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.806557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:21.807928 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a3b08ea-6347-44d4-bb24-75a0beece442 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 404 len: 111 microversion: 2.1 time: 0.041970 Jul 30 21:10:21.808665 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1290/2469] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:21 2022] DELETE /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:10:21.813394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9ea16565-5358-4b03-bb8e-0eb43cf7ae0a req-d1615774-8774-454d-8496-e5f4013bb23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-plugged", "status": "completed", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:21.822963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ea16565-5358-4b03-bb8e-0eb43cf7ae0a req-d1615774-8774-454d-8496-e5f4013bb23c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.823486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ea16565-5358-4b03-bb8e-0eb43cf7ae0a req-d1615774-8774-454d-8496-e5f4013bb23c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.827269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:21.836993 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9ea16565-5358-4b03-bb8e-0eb43cf7ae0a req-d1615774-8774-454d-8496-e5f4013bb23c service nova] Creating event network-vif-plugged:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:10:21.842319 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9ea16565-5358-4b03-bb8e-0eb43cf7ae0a req-d1615774-8774-454d-8496-e5f4013bb23c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Jul 30 21:10:21.846381 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1291/2470] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:21.852671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.853618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: 0fdc6e54-0d1d-4746-9572-45db9fcd32e0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.861587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.862373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.863350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.863948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.880927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 HTTP/1.1 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0fdc6e54-0d1d-4746-9572-45db9fcd32e0'} Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.882611 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance 0fdc6e54-0d1d-4746-9572-45db9fcd32e0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:21.886243 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db0c8b18-b065-4d4e-9555-04c7b2572fa5 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0" status: 404 len: 111 microversion: 2.1 time: 0.036307 Jul 30 21:10:21.887767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1292/2471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:21 2022] GET /compute/v2.1/servers/0fdc6e54-0d1d-4746-9572-45db9fcd32e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:21.892804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.893524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.901713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.902175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.902964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.903468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.919648 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 HTTP/1.1 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b47ab82f-5261-4c09-aa62-851d8f0b9055'} Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:21.921377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:21.925430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39dc69f7-be32-4325-bb97-c59aa717cf5c tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 404 len: 111 microversion: 2.1 time: 0.033943 Jul 30 21:10:21.926692 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1293/2472] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:21 2022] DELETE /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:21.931451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:21.932073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:21.939659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.940209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:21.941108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:21.941607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.084770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:22.093156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b42f711b-0def-4c03-8a4b-7347b04901e3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.165824 Jul 30 21:10:22.093758 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1294/2473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:21 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:22.098421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:22.100023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] [instance: b47ab82f-5261-4c09-aa62-851d8f0b9055] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:22.105843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.106490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.107276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.107876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.122348 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] HTTP exception thrown: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Request method failure captured: Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 HTTP/1.1 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z28IpzZi6Vy219O4m1dG4sFn3AdeOn0k7TR5Ou12FnEpLwYjBA3z4eLecSnzZFt_A7l8JM03iyWc2UFl61Snt3iTBiyzy24JKwROVqS0fHXB_4mztVQOXW0J2oKgHGht9pJSRnLJtldlXNQuF0a6ZJMOD8cpzLIzaFrF8co5CYN3qk Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c143a2d2e4b04edba1f2734d4d19d978", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c143a2d2e4b04edba1f2734d4d19d978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: c143a2d2e4b04edba1f2734d4d19d978 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestMultiNic-1132101638 Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6399b6f3e2574df8af12786c8755c59a Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestMultiNic-1132101638-project Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b47ab82f-5261-4c09-aa62-851d8f0b9055'} Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:22.124105 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] Returning 404 to user: Instance b47ab82f-5261-4c09-aa62-851d8f0b9055 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:22.128510 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b983b855-2873-42c7-a1c5-ed8733bf7d81 tempest-ServersTestMultiNic-1132101638 tempest-ServersTestMultiNic-1132101638-project] 10.222.0.17 "GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055" status: 404 len: 111 microversion: 2.1 time: 0.030485 Jul 30 21:10:22.130100 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1295/2474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:22 2022] GET /compute/v2.1/servers/b47ab82f-5261-4c09-aa62-851d8f0b9055 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:22.383578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:22.384493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:22.392707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.393171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.393965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.394412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.425934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for project 7174018ac671484ab204d0ad1559d683. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:22.444495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for user eb637624ed0f48c9b4ad60e2cda88eb8 and project 7174018ac671484ab204d0ad1559d683. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:22.477058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:22.477650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:22.478258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:22.478877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:22.479460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:22.498736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.501796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.502943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.503985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.530874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for project 7174018ac671484ab204d0ad1559d683. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:22.542977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:22.544559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Getting quotas for user eb637624ed0f48c9b4ad60e2cda88eb8 and project 7174018ac671484ab204d0ad1559d683. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:22.592603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:22.604318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5901817-021c-434c-a645-52dc82d7c1ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1509 microversion: 2.1 time: 0.225461 Jul 30 21:10:22.605520 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1296/2475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:22 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:22.627110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:22.628282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:22.635281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.635994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.637336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.637938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.670147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:22.673052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2cc1badd-c9dc-4e4e-80d7-47e2203c89a3',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:22.815999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:22.825092 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a5b5cea-cbe0-4723-af55-af06cc386ca4 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1509 microversion: 2.1 time: 0.202554 Jul 30 21:10:22.840965 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1297/2476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:22 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:22.848167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:22.849002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:22.856192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.856664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.857526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.857989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.895741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-44539802-0572-41de-8052-8f9bcf4d98b7 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.042968 Jul 30 21:10:22.897383 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1180/2477] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:10:22.905847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:22.909475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:22.918060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.918818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.919965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:22.920673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:22.966670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:23.038278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de698179-4738-40fd-801d-3fccfea680bf tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "PUT /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1081 microversion: 2.1 time: 0.138644 Jul 30 21:10:23.043692 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1181/2478] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:10:22 2022] PUT /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1081 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.044391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5f5364fb-17e4-40b3-abc8-561ad9f24098 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:23.045073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5f5364fb-17e4-40b3-abc8-561ad9f24098 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.082189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:23.090971 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63c4a1a4-2742-497c-8896-4bda31dfb41c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.248642 Jul 30 21:10:23.091616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1298/2479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:22 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.097602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:23.098236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.105552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.106132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.106818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.109078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.158909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5f5364fb-17e4-40b3-abc8-561ad9f24098 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:23.169306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5f5364fb-17e4-40b3-abc8-561ad9f24098 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1120 microversion: 2.1 time: 0.128861 Jul 30 21:10:23.170538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1182/2480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:23 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1120 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.176084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:23.178014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.186307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.187551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.188729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.189398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.289092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:23.304567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6aba0730-8b81-4533-afd9-ff7eb809ec17 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1507 microversion: 2.1 time: 0.208358 Jul 30 21:10:23.319780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1299/2481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:23 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.337825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:23.338475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.346976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.347911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.349044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.349726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.569630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:23.581259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ba3afbf-49e8-4ca6-a4a5-7198bd092781 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1507 microversion: 2.1 time: 0.253905 Jul 30 21:10:23.596131 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1300/2482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:23 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.598409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:23.603572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:23.607452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.615317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.616549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.617605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.618302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.626372 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c01ecdb8-c78c-4e2a-8ce4-cc8f4a60d65d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1378 microversion: 2.1 time: 0.454263 Jul 30 21:10:23.635230 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1183/2483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:23 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1378 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.700371 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f31cf84-9460-4ab5-b6f0-60347c800b69 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "PUT /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1083 microversion: 2.1 time: 0.100867 Jul 30 21:10:23.702973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1301/2484] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:10:23 2022] PUT /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1083 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:23.719263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:23.720126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:23.726499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.727036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:23.727873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:23.728338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.021624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:24.037308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-28539a29-0019-480d-9995-90abc367f001 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1509 microversion: 2.1 time: 0.321053 Jul 30 21:10:24.051496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1184/2485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:23 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:24.065738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.066196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.074277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.074745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.079409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.079409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.108484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:24.129463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.131693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.141849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.142334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.143151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.143646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.422873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:24.443921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b102f4ca-ec8a-43a9-ba78-3b5ac4b4d3fd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1509 microversion: 2.1 time: 0.382543 Jul 30 21:10:24.457191 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1302/2486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:24 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:24.471210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.472025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.490246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.490719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.491553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.492010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.628280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:24.654623 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a398b4a4-fd6a-43c6-8687-d50d9086f894 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1236 microversion: 2.1 time: 0.190866 Jul 30 21:10:24.655649 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1303/2487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:24 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1236 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:24.662273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.663160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.671440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.672242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.673985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.674708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.707529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:10:24.834827 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a02ac790-e924-4164-bcf3-20157c4ab4ef tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 204 len: 0 microversion: 2.1 time: 0.176071 Jul 30 21:10:24.836323 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1304/2488] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:24 2022] DELETE /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:24.852957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.854778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.870651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.871194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.876967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.877668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.885275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:24.897957 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a91bd9ed-3b19-432f-bfeb-e8db0227d74d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.788277 Jul 30 21:10:24.898566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1185/2489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:24 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:24.907463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:24.908997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:24.933226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.934083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.935138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:24.935863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:24.974148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:10:25.083202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Instance is already in deleting state, ignoring this request Jul 30 21:10:25.085780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09d12f81-c42e-4d22-ac43-ead3ad9961a5 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 204 len: 0 microversion: 2.1 time: 0.186252 Jul 30 21:10:25.086392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1186/2490] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:24 2022] DELETE /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:25.096446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.097225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:25.104060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.105010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.106147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.106825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.181392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:25.205384 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-652c4794-21d8-4fe9-b21e-d9a2a88ca19d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1528 microversion: 2.1 time: 0.367189 Jul 30 21:10:25.219317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1305/2491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:24 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1528 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:25.228328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.228982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:25.236633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.237723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.238905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.240711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.370624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:25.379518 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d5c1c74a-d6df-4160-a8ad-b7584968040b tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1515 microversion: 2.1 time: 0.288473 Jul 30 21:10:25.383729 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1187/2492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:25 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:25.626220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:25.648374 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0578f828-144a-47ee-ab16-0f43a7e4ddec tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1528 microversion: 2.1 time: 0.426028 Jul 30 21:10:25.665724 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1306/2493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:25 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:25.670876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ae7aa0c-7038-49a8-8869-4a070d6de417 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.672027 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:10:25.672027 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:10:25.690413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.691258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:25.694941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ae7aa0c-7038-49a8-8869-4a070d6de417 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/55b98233-bb62-4348-9dd0-b7ca4dca6f12" status: 202 len: 0 microversion: 2.1 time: 0.028817 Jul 30 21:10:25.696246 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1188/2494] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:25 2022] DELETE /compute/v2.1/flavors/55b98233-bb62-4348-9dd0-b7ca4dca6f12 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:25.704192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01d5179d-b39b-48b6-9d43-26c1976781db tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.708128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.709245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.710045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.710492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.730657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01d5179d-b39b-48b6-9d43-26c1976781db tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030325 Jul 30 21:10:25.732468 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1189/2495] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:10:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:25.753428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:25.756718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:25.763922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.764598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.765520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.766514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.807878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:25.815473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Old instance type tempest-test_resize_flavor_-867288636, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:10:25.823800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:25.824908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:25.825478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:25.825975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:25.826901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:25.913593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b3bba75-1482-4659-8f17-530adb3fed87 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07/action" status: 202 len: 0 microversion: 2.1 time: 0.166734 Jul 30 21:10:25.914492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1190/2496] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:25 2022] POST /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:25.931322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:25.932278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:25.945747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.946223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:25.947043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:25.953618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:26.219000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:26.228085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-791eaadc-75b2-45f5-9986-6911a8e52724 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1303 microversion: 2.1 time: 0.547763 Jul 30 21:10:26.232252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1307/2497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:25 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1303 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:26.241399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:26.244280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:26.257405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:26.257890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:26.258844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:26.259606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:26.280183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:26.586396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:26.594813 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14c4dd01-bd0d-4f6e-bc5e-ed347e8e441b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.675035 Jul 30 21:10:26.600109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1191/2498] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:25 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:26.622452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:26.634494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:26.649599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:26.650368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:26.654982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:26.658153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:26.699271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:26.709253 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-705e301e-9a7d-4640-9e3c-d56d108c8f71 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1537 microversion: 2.1 time: 0.475808 Jul 30 21:10:26.713358 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1308/2499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:26 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1537 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:27.101611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2517a20b0358424480784b0003512d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9be740494d2497cb1771330a1ba99f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:27.135701 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b2a4b78b-cc92-42c9-a17f-db3d53f343d1 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 200 len: 1515 microversion: 2.1 time: 0.516039 Jul 30 21:10:27.142125 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1192/2500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:26 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:27.268635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:27.275456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:27.298769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:27.302570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:27.306254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:27.309603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:27.625442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:27.627011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:27.664818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:27.665778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:27.669890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:27.680105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.264022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:28.278593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15abdc98-d9a7-490f-9844-5290230653ae tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.659307 Jul 30 21:10:28.279860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1193/2501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:27 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:28.287208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.288180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.298591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.299930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.301374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.302265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.494667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:28.514860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b97c95b-8369-4190-bc3c-3565e6aa77e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1537 microversion: 2.1 time: 0.232898 Jul 30 21:10:28.515699 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1194/2502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:28 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:28.536692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1e33dcbc-00fb-47a3-aabe-fe043be34bb6 req-c89bb255-161f-46eb-9a86-001dda068eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d295abd2-c66c-414c-ae62-219fe2572cb1", "name": "network-vif-deleted", "tag": "4072c44f-2359-4326-a74b-1d9c30a5797b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:28.547020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1e33dcbc-00fb-47a3-aabe-fe043be34bb6 req-c89bb255-161f-46eb-9a86-001dda068eeb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.547762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1e33dcbc-00fb-47a3-aabe-fe043be34bb6 req-c89bb255-161f-46eb-9a86-001dda068eeb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.560151 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1e33dcbc-00fb-47a3-aabe-fe043be34bb6 req-c89bb255-161f-46eb-9a86-001dda068eeb service nova] Creating event network-vif-deleted:4072c44f-2359-4326-a74b-1d9c30a5797b for instance d295abd2-c66c-414c-ae62-219fe2572cb1 on nch1-master-1 Jul 30 21:10:28.566304 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1e33dcbc-00fb-47a3-aabe-fe043be34bb6 req-c89bb255-161f-46eb-9a86-001dda068eeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041891 Jul 30 21:10:28.567322 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1195/2503] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:28.575263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-38e7466a-de12-4de5-af25-b4f51b0a548d req-7dac6399-45ac-4c2b-8f30-bfda30feac6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4adc144-ea58-4187-90b0-03446f07641d", "tag": "b881dd6c-16b1-404c-b1ac-4548cd416f3e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:28.588394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-38e7466a-de12-4de5-af25-b4f51b0a548d req-7dac6399-45ac-4c2b-8f30-bfda30feac6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.589056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-38e7466a-de12-4de5-af25-b4f51b0a548d req-7dac6399-45ac-4c2b-8f30-bfda30feac6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.601882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-38e7466a-de12-4de5-af25-b4f51b0a548d req-7dac6399-45ac-4c2b-8f30-bfda30feac6e service nova] Creating event network-changed:b881dd6c-16b1-404c-b1ac-4548cd416f3e for instance d4adc144-ea58-4187-90b0-03446f07641d on nch2-master-1 Jul 30 21:10:28.607044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-38e7466a-de12-4de5-af25-b4f51b0a548d req-7dac6399-45ac-4c2b-8f30-bfda30feac6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037693 Jul 30 21:10:28.608050 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1196/2504] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:28.613370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.614267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d295abd2-c66c-414c-ae62-219fe2572cb1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.622051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.622732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.623802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.624416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.639425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] HTTP exception thrown: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Request method failure captured: Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 HTTP/1.1 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2YCqWijcJxG6CexhtDvbEUe3ARzKPw0fkB647HzhFvdanwn_M0dOMfMn1gM_aLTC6X7v6ZGxZlnEXch6OniNVqPNT5tdlfRcBJUghRcElb-b5mk_s2ZnHGiTkcE53o9oPtsQ-Tt1CQe7K-ygFYvN_GHCJ0UWxmNYrlmcWkPluzL7Q Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9be740494d2497cb1771330a1ba99f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 2517a20b0358424480784b0003512d50 Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd295abd2-c66c-414c-ae62-219fe2572cb1'} Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.641133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Returning 404 to user: Instance d295abd2-c66c-414c-ae62-219fe2572cb1 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:28.645430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2de59f9-9b5b-43f1-a48b-c763cf2453d2 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1" status: 404 len: 111 microversion: 2.1 time: 0.033336 Jul 30 21:10:28.646917 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1197/2505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:28 2022] GET /compute/v2.1/servers/d295abd2-c66c-414c-ae62-219fe2572cb1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:28.651817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.652338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.658473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.658944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.659778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.660238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.666310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:28.676324 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] HTTP exception thrown: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Request method failure captured: Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f HTTP/1.1 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2YCqWijcJxG6CexhtDvbEUe3ARzKPw0fkB647HzhFvdanwn_M0dOMfMn1gM_aLTC6X7v6ZGxZlnEXch6OniNVqPNT5tdlfRcBJUghRcElb-b5mk_s2ZnHGiTkcE53o9oPtsQ-Tt1CQe7K-ygFYvN_GHCJ0UWxmNYrlmcWkPluzL7Q Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9be740494d2497cb1771330a1ba99f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 2517a20b0358424480784b0003512d50 Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a5f4af92-7e39-4b71-9cd1-952ce0c8e42f'} Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:28.679191 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Returning 404 to user: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:28.683297 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b55ca33a-8bb7-4733-ba81-8d67d567d002 tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 404 len: 111 microversion: 2.1 time: 0.032494 Jul 30 21:10:28.685135 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1198/2506] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:28 2022] DELETE /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:28.692466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.693528 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-78193853-e5b6-40f3-aea7-6decc732290c tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1303 microversion: 2.1 time: 1.444263 Jul 30 21:10:28.694196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: a5f4af92-7e39-4b71-9cd1-952ce0c8e42f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.699389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1309/2507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:27 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1303 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:28.701022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.701188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.701999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.702562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.718761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] HTTP exception thrown: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Request method failure captured: Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f HTTP/1.1 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2YCqWijcJxG6CexhtDvbEUe3ARzKPw0fkB647HzhFvdanwn_M0dOMfMn1gM_aLTC6X7v6ZGxZlnEXch6OniNVqPNT5tdlfRcBJUghRcElb-b5mk_s2ZnHGiTkcE53o9oPtsQ-Tt1CQe7K-ygFYvN_GHCJ0UWxmNYrlmcWkPluzL7Q Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9be740494d2497cb1771330a1ba99f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 2517a20b0358424480784b0003512d50 Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a5f4af92-7e39-4b71-9cd1-952ce0c8e42f'} Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.720357 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Returning 404 to user: Instance a5f4af92-7e39-4b71-9cd1-952ce0c8e42f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e631ed1f-9053-4216-9cdf-f210caa8b7db tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f" status: 404 len: 111 microversion: 2.1 time: 0.035507 Jul 30 21:10:28.726159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1199/2508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:28 2022] GET /compute/v2.1/servers/a5f4af92-7e39-4b71-9cd1-952ce0c8e42f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:28.731416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.731848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.738006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.738471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.739248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.739763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.762094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] HTTP exception thrown: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Request method failure captured: Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 HTTP/1.1 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2YCqWijcJxG6CexhtDvbEUe3ARzKPw0fkB647HzhFvdanwn_M0dOMfMn1gM_aLTC6X7v6ZGxZlnEXch6OniNVqPNT5tdlfRcBJUghRcElb-b5mk_s2ZnHGiTkcE53o9oPtsQ-Tt1CQe7K-ygFYvN_GHCJ0UWxmNYrlmcWkPluzL7Q Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9be740494d2497cb1771330a1ba99f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 2517a20b0358424480784b0003512d50 Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd028aca0-d3d0-4caf-8b0c-615ab599b649'} Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:28.780106 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Returning 404 to user: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b4938904-1a38-48c5-982c-f0b5c7bfe3bd tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 404 len: 111 microversion: 2.1 time: 0.054452 Jul 30 21:10:28.784182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1310/2509] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:28 2022] DELETE /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:28.794421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:28.795403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] [instance: d028aca0-d3d0-4caf-8b0c-615ab599b649] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:28.803980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.804888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.805858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:28.806927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:28.830577 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] HTTP exception thrown: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Request method failure captured: Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 HTTP/1.1 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2YCqWijcJxG6CexhtDvbEUe3ARzKPw0fkB647HzhFvdanwn_M0dOMfMn1gM_aLTC6X7v6ZGxZlnEXch6OniNVqPNT5tdlfRcBJUghRcElb-b5mk_s2ZnHGiTkcE53o9oPtsQ-Tt1CQe7K-ygFYvN_GHCJ0UWxmNYrlmcWkPluzL7Q Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9be740494d2497cb1771330a1ba99f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9be740494d2497cb1771330a1ba99f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d9be740494d2497cb1771330a1ba99f1 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1357449918 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 2517a20b0358424480784b0003512d50 Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiskConfigTestJSON-1357449918-project Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd028aca0-d3d0-4caf-8b0c-615ab599b649'} Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:28.832556 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:10:28.838163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] Returning 404 to user: Instance d028aca0-d3d0-4caf-8b0c-615ab599b649 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:28.839688 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e9adb89d-92af-41d6-b973-5c698a47ba3f tempest-ServerDiskConfigTestJSON-1357449918 tempest-ServerDiskConfigTestJSON-1357449918-project] 10.222.0.17 "GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649" status: 404 len: 111 microversion: 2.1 time: 0.050283 Jul 30 21:10:28.844334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1200/2510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:28 2022] GET /compute/v2.1/servers/d028aca0-d3d0-4caf-8b0c-615ab599b649 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:29.305525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:29.306517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:29.315141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.316013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.317320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.318063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.536068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:29.539084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:29.546617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.547160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.548131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.548677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.627124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:29.636611 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42828a2e-b2d4-4f80-a79e-5e413368c321 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.335427 Jul 30 21:10:29.638550 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1311/2511] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:29 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:29.717569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:29.718997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:29.726378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.726881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.727719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:29.728180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:29.899188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:29.909068 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e0aaf44-ea83-48cd-9e2a-767bbb8b124f tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.196112 Jul 30 21:10:29.923835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1312/2512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:29 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:30.297724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:30.300099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:30.314733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e096911-60b1-4811-933e-12b762ad720f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1537 microversion: 2.1 time: 0.782449 Jul 30 21:10:30.319264 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1201/2513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:29 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1537 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:30.662189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:30.662855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:30.680298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:30.682150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:30.683184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:30.684752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:30.929311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:30.931162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:30.931923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:30.940084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:30.944942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:30.946857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:30.948317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:30.948814 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82e60c5e-92b6-40d3-9f3a-431ca64fd5a3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.291718 Jul 30 21:10:30.950673 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1313/2514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:30 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:31.340861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:31.345373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:31.356963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:31.360763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:31.362194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:31.362994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:31.390918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:31.410763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9fe8e6ab-b5eb-4a40-907c-5e0b3ececa44 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.483576 Jul 30 21:10:31.411919 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1202/2515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:30 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:31.671220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:31.680382 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-596e7556-7077-45db-8aa9-3c5a3747ac31 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.343783 Jul 30 21:10:31.681038 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1314/2516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:31 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:31.973136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:31.973870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:31.981371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:31.982077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:31.983071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:31.983724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:32.241284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:32.250223 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c75bc088-351b-44b7-b713-896b55ce55e5 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.281423 Jul 30 21:10:32.251798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1203/2517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:31 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:32.433325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:32.434577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:32.441246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:32.442003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:32.442861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:32.443577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:32.702197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:32.702837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:32.704995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:32.711836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:32.712313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:32.713721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:32.714184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:32.851282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:32.859462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7baa103-64a6-441a-8673-c23c2174d865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.161197 Jul 30 21:10:32.860052 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1204/2518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:32 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:33.028307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:33.036756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc5accd0-49df-448c-8239-8370231dab40 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.607806 Jul 30 21:10:33.037525 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1315/2519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:32 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:33.272582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:33.273333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:33.276450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:33.282425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:33.282893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:33.283746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:33.284208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:33.425380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:33.433644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a348c962-56b7-414f-8cf2-e77e14d3d913 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.165774 Jul 30 21:10:33.434993 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1205/2520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:33 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:33.906301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:33.908900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:33.927821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:33.929793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:33.931071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:33.932070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:34.062592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:34.063159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:34.070329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:34.071072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:34.072132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:34.072776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:34.309787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:34.322832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03f9066f-8755-4267-9fbd-50e5faf26ad9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.445108 Jul 30 21:10:34.341029 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1316/2521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:33 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:34.368488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:34.386979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4789556a-d3e5-4877-bbca-e26c729399c4 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.330892 Jul 30 21:10:34.391577 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1206/2522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:34 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:34.457014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:34.457939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:34.464903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:34.465679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:34.466684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:34.467436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:34.863895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:34.873305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ced4200-47ec-4881-ab86-67d043b2fdca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.420449 Jul 30 21:10:34.873903 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1317/2523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:34 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:35.350539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:35.351315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:35.370465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.371101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:35.371817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.372337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:35.411509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:35.412246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:35.426061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.426884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:35.431458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.432166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:35.858596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:35.872972 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a407d61-659d-4599-b092-fe9ba1204be9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.526255 Jul 30 21:10:35.874088 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1207/2524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:35 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:35.895981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:35.897386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:35.914687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.917082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:35.918230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:35.922885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:36.201060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:36.211802 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d68ee20f-657e-4706-943c-753e6455f027 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.805434 Jul 30 21:10:36.212871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:36.213923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1318/2525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:35 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:36.230269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:36.231622 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d53fddc2-0f20-4f55-ad57-e9c76d512bef tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.339168 Jul 30 21:10:36.232573 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1208/2526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:35 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:36.234995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:36.250038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:36.250527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:36.251633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:36.252097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:36.308644 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3dc2f8de-93d0-4007-861e-519bab9c1f67 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/ips" status: 200 len: 151 microversion: 2.20 time: 0.093276 Jul 30 21:10:36.312257 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1319/2527] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Jul 30 21:10:36 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/ips => generated 151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:10:36.896406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:36.897086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:36.918679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:36.919570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:36.921723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:36.927919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.233182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:37.234032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:37.242550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:37.243030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.244616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:37.250487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.442035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:37.463826 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8ad077e-02f3-4e90-b7e0-7dfbfa35d5e9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.571756 Jul 30 21:10:37.471043 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1209/2528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:36 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:37.484113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:37.492304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:37.512532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:37.515388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.516488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:37.517032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.623513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:37.639133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6badb6f7-a541-4add-82d5-6eaed1bb5036 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.403013 Jul 30 21:10:37.640274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1320/2529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:37 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:37.645181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e2e14f9d-1794-4197-8c9d-9bb80d21e369 req-3bf81b38-91c2-4886-a797-cecb42235362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4adc144-ea58-4187-90b0-03446f07641d", "name": "network-vif-plugged", "status": "completed", "tag": "b881dd6c-16b1-404c-b1ac-4548cd416f3e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:37.669424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e2e14f9d-1794-4197-8c9d-9bb80d21e369 req-3bf81b38-91c2-4886-a797-cecb42235362 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:37.669880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e2e14f9d-1794-4197-8c9d-9bb80d21e369 req-3bf81b38-91c2-4886-a797-cecb42235362 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:37.702144 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e2e14f9d-1794-4197-8c9d-9bb80d21e369 req-3bf81b38-91c2-4886-a797-cecb42235362 service nova] Creating event network-vif-plugged:b881dd6c-16b1-404c-b1ac-4548cd416f3e for instance d4adc144-ea58-4187-90b0-03446f07641d on nch2-master-1 Jul 30 21:10:37.713360 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e2e14f9d-1794-4197-8c9d-9bb80d21e369 req-3bf81b38-91c2-4886-a797-cecb42235362 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071269 Jul 30 21:10:37.714522 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1321/2530] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:37.876541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:37.885063 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae426a65-6370-426a-ab5d-e3a1a7a68a5f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.412621 Jul 30 21:10:37.888009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1210/2531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:37 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:38.502111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:38.502853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:38.537713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:38.541080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:38.542064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:38.543741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:38.664109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:38.664886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:38.679516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:38.686047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:38.690046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:38.690676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.038933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.056515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40a01bde-e447-43be-b5e4-960f405bc829 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.564430 Jul 30 21:10:39.058546 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1322/2532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:38 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:39.087201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:39.091124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:39.125179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.126823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.128242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.129088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.174029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.199626 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-feec6573-5d5f-4fd9-af1d-6921c25dfed1 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1291 microversion: 2.1 time: 0.540042 Jul 30 21:10:39.209186 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1211/2533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:38 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1291 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:39.211554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lazy-loading 'flavor' on Instance uuid 2d593494-4b97-4ea2-94ce-724c5346ffd6 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:10:39.229882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:39.230858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:39.256601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.257815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.260210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.264117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.521215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81590afc-0375-4fa1-a09a-9c486004f0a1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/action" status: 202 len: 0 microversion: 2.20 time: 0.458281 Jul 30 21:10:39.521835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1323/2534] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:10:39 2022] POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:10:39.545142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:39.548336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:39.565975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.568773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.572583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:39.573249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:39.623669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:39.683070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.701587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4099b5b1-cee2-4b71-9ea9-44c0a874b0e9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.487890 Jul 30 21:10:39.702469 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1212/2535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:39 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:39.898337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.907157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.913630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:39.924837 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d6c835b4-78aa-4474-9a8d-612448851533 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.398197 Jul 30 21:10:39.925710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1324/2536] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:39 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:40.081410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:40.082045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:40.097494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.099724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:40.100921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.103686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:40.328706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1478286988", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:40.440852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] validate_networks() for [('4e321294-3616-467d-afa5-c47966933a44', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:40.521371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:40.532321 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f77d670-291b-4f84-8c77-95acb627d5f8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 0.454428 Jul 30 21:10:40.536104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1213/2537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:40 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:40.542114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:40.543034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:40.552455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.553947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:40.554975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.555739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:40.814385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:40.824233 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b71f35d-38a2-435e-8062-25b25aec5bbf tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1483 microversion: 2.1 time: 0.286673 Jul 30 21:10:40.835420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1214/2538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:40 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1483 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:40.848194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:40.849412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:40.856678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.857463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:40.858544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:40.859149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.040227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:41.052884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ccb98e19-e1ae-4f4a-a72d-166061ba1648 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.215825 Jul 30 21:10:41.054214 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1215/2539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:40 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:41.190447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-918420342", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:41.261194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:41.391543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:41.392083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:41.392412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:41.393023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:41.393611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:41.419459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.420203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.421240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.422262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.444974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Getting quotas for project 7e9653a81a694ec29d1fcfe2da97eaa3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:41.451058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Getting quotas for user 36fe4dfa0f564eedb8deb3491a5068a5 and project 7e9653a81a694ec29d1fcfe2da97eaa3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:41.476829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:41.479501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:41.517088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:41.557607 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ca05970b-4fb4-488b-803d-87ecf2b7a581 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.479655 Jul 30 21:10:41.558276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1325/2540] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:10:41.564365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:41.564917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:41.573421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.574137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.575105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.575800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.757586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29f720da-8204-4c05-8747-a53c45060567 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198222 Jul 30 21:10:41.758773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1326/2541] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:10:41 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:41.763741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:41.764558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:41.782877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.783370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.786462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.787099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.824286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:41.825687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:41.826847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:41.828485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:41.829143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:41.853479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.855213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.860574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:41.862662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:41.930726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:41.970315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:42.019470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:42.022194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:42.025600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:42.100087 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-84c78b4b-9f25-41bc-8223-c91cc5b9a29d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044437 Jul 30 21:10:42.100774 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1216/2542] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:10:42.106964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:42.108791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:42.117627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:42.118110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:42.118933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:42.119416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:42.200431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:42.209967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:42.217950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:42.229027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf6557e1-a357-4e34-aab9-e645fce8d6e0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.468161 Jul 30 21:10:42.231864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1327/2543] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:41 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:42.249416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4048bbe-f59c-4b9a-9bc1-eefaaee7ac8f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:42.261813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4048bbe-f59c-4b9a-9bc1-eefaaee7ac8f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:42.379025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c4048bbe-f59c-4b9a-9bc1-eefaaee7ac8f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:42.389271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4048bbe-f59c-4b9a-9bc1-eefaaee7ac8f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1214 microversion: 2.1 time: 0.156104 Jul 30 21:10:42.389866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1328/2544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:42 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:42.422924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:42.424622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:42.445937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:42.446494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:42.447371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:42.450539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:42.923098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:42.941669 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cdabd6ab-4406-4e94-8f6e-6865dfe746ce tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.548489 Jul 30 21:10:42.945133 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1329/2545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:42 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:42.968741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05eb469b-7187-4138-805c-abe78e74e752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:42.970016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05eb469b-7187-4138-805c-abe78e74e752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:43.075054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-05eb469b-7187-4138-805c-abe78e74e752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:43.093724 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05eb469b-7187-4138-805c-abe78e74e752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1214 microversion: 2.1 time: 0.146054 Jul 30 21:10:43.096693 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1330/2546] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:42 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:43.237732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-878208814", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "48e2843f-0334-41fd-a4a5-2af9cd2f654e"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:43.372791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] validate_networks() for [('48e2843f-0334-41fd-a4a5-2af9cd2f654e', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:43.417191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:43.428895 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-96449905-1275-4c62-8f9b-de493e9f1fbb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 1.327033 Jul 30 21:10:43.431268 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1217/2547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:42 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:43.444674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:43.445970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:43.472241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:43.472935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:43.476295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:43.478533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:43.988593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:43.989815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:43.990561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:43.991195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:43.991986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:44.008523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.009332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.010892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.011572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.037211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:44.045603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for user f5f8f28630a3430f81fa884985963a9b and project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:44.061987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:44.064722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:44.132717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.147031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.153018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.158393 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fd886015-d225-4553-950a-828ba7ae71d1 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.722273 Jul 30 21:10:44.159855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1218/2548] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:43 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:44.195680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:44.196439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:44.208714 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf5af8ab-bcd2-47b6-b841-4059605a97d3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107737 Jul 30 21:10:44.209627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1331/2549] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:10:44.213695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.214165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.214966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.215556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:44.216316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:44.219882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.224502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.226166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:44.226917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.228831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.229504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.522757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.555178 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e6aaee2-9cb7-4b72-a3ae-5403cf5de9a6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.343675 Jul 30 21:10:44.556728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1332/2550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:44 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:44.584488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:44.587506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:44.609874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.613228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.614819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.615316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.633682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.647543 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58ca0091-922c-4b54-a758-4bb1d944db4d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1272 microversion: 2.1 time: 0.477789 Jul 30 21:10:44.660247 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1219/2551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:44 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:44.674614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f9f894-91c0-47f9-959a-1e5551ad4574"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:44.681390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:44.698574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.700868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.703606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:44.706289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:44.751142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:44.762213 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-93bf47aa-725a-4454-9984-d40fdb75dfe0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1272 microversion: 2.1 time: 0.203149 Jul 30 21:10:44.763190 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1333/2552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:44 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:44.775813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-227275427", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "48e2843f-0334-41fd-a4a5-2af9cd2f654e"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:44.874688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] validate_networks() for [('48e2843f-0334-41fd-a4a5-2af9cd2f654e', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:45.211209 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "POST /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549373 Jul 30 21:10:45.219540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1220/2553] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:10:44 2022] POST /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:45.239763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:45.241844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:45.268112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.269881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:45.271537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.272263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:45.701875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:45.702357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:45.702805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:45.703237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:45.703697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:45.722612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.724636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:45.725945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.727892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:45.758129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:45.769424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for user f5f8f28630a3430f81fa884985963a9b and project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:45.803800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:45.806320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:45.896469 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d40eaaf-cc61-4827-864f-5be6695eb254 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131944 Jul 30 21:10:45.897708 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1334/2554] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:10:45.915315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:45.916253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:45.923535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.924249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:45.925539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:45.926278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.131695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.151970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.154933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.156597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fd2a596-0867-4878-af6d-76d58cc5d70b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.257632 Jul 30 21:10:46.157548 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1335/2555] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:45 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:46.165046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:46.165886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:46.173129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.173727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.175261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.179212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.610889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.620775 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-772ecf07-a5ef-4ea8-a758-782b4fb79d04 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1542 microversion: 2.1 time: 1.398575 Jul 30 21:10:46.622085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1221/2556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:45 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1542 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:46.627698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:46.630297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:46.638800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.639601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.641111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.642418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.707562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.728305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1ea6c243-39c0-43f5-9a46-0301ea5b2fa3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.569534 Jul 30 21:10:46.728924 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1336/2557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:46 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:46.753063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:46.760384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:46.761025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:46.775947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.776654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.777623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:46.778222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:46.779174 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6bc215b7-a664-4534-94e5-31ba0deff614 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1272 microversion: 2.1 time: 0.155544 Jul 30 21:10:46.798732 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1222/2558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:46 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:46.820081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-150072189", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "451", "networks": [{"uuid": "48e2843f-0334-41fd-a4a5-2af9cd2f654e"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:46.951747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] validate_networks() for [('48e2843f-0334-41fd-a4a5-2af9cd2f654e', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:10:47.432171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:47.468496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55c46f60-e850-4cd1-bcdf-64dbc14353cd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1272 microversion: 2.1 time: 0.715656 Jul 30 21:10:47.470041 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1337/2559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:46 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1272 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:47.488687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:47.491619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:47.530331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:47.531050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:47.532363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:47.533099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:47.865514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:47.882694 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8aad302c-75de-4c80-b408-141ddc36dbbd tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1483 microversion: 2.1 time: 0.411031 Jul 30 21:10:47.889242 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1338/2560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:47 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1483 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:47.914260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-15347914-aa43-4383-b71e-d06474197588 req-ebad4e15-a800-4eae-b7d2-60e873bc346f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4adc144-ea58-4187-90b0-03446f07641d", "tag": "b881dd6c-16b1-404c-b1ac-4548cd416f3e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:47.941323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-15347914-aa43-4383-b71e-d06474197588 req-ebad4e15-a800-4eae-b7d2-60e873bc346f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:47.942863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-15347914-aa43-4383-b71e-d06474197588 req-ebad4e15-a800-4eae-b7d2-60e873bc346f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:47.970633 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-15347914-aa43-4383-b71e-d06474197588 req-ebad4e15-a800-4eae-b7d2-60e873bc346f service nova] Creating event network-changed:b881dd6c-16b1-404c-b1ac-4548cd416f3e for instance d4adc144-ea58-4187-90b0-03446f07641d on nch2-master-1 Jul 30 21:10:47.983982 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-15347914-aa43-4383-b71e-d06474197588 req-ebad4e15-a800-4eae-b7d2-60e873bc346f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092713 Jul 30 21:10:47.984657 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1339/2561] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:47.991225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:47.992309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:48.010249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.011089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.012099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.016685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.706013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:10:48.707041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:10:48.708339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:10:48.708924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:10:48.709515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:10:48.730159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.730790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.737511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.737986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.794127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:48.800422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Getting quotas for user f5f8f28630a3430f81fa884985963a9b and project 07faa65e8ff5420a92cab2a17cd2cc74. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:48.812305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:48.832781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:10:48.835218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:10:48.835391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:48.840894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:48.843547 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2e7a4c9-5c6d-490e-be6e-76a54f15bd4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.857404 Jul 30 21:10:48.846519 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1340/2562] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:47 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:48.857983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:48.858849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:48.876718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.877866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.878840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.879606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.949124 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-537a2bef-0f9c-441b-9498-353a3786d93f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.148943 Jul 30 21:10:48.955837 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1223/2563] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:10:48.966652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:48.967559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:48.975818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.976772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:48.987076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:48.988222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:49.563486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:49.571866 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6616ec8-1d9a-4001-a911-e7c0d46eb147 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1541 microversion: 2.1 time: 0.724065 Jul 30 21:10:49.572457 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1341/2564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:48 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1541 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:49.586350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:49.587244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:49.609220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:49.609876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:49.611046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:49.611703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.093082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.104611 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3769a648-4143-4089-b16c-c6105eaea4d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 1.147337 Jul 30 21:10:50.120133 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1224/2565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:48 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:50.126061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:50.127529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:50.136890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.137669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.138745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.139386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.278272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.295850 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e42a4aad-69b3-4ffe-b39d-b48f12e4eb14 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.719102 Jul 30 21:10:50.296427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1342/2566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:49 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:50.302617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:50.303623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:50.311882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.312813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.313646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.314102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.416753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.425356 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0049e22-1fd4-4e23-923f-708719ef5b9a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1272 microversion: 2.1 time: 0.126974 Jul 30 21:10:50.431274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1343/2567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:50 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:50.436584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:50.439753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:50.451329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.452293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.453959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.454635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:50.835499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.849837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.852451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:50.853927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1734579-5059-421e-b610-001e1d51f39c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.421279 Jul 30 21:10:50.854708 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1344/2568] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:50 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:50.981886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-unplugged", "status": "completed", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:50.994138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:50.995124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.032605 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] Creating event network-vif-unplugged:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch2-master-1 Jul 30 21:10:51.046369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:10:51.081761 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-511574d1-c3aa-4244-97ed-75f949ef34a9 req-a4a99bd3-c466-4985-9734-e37a8cca1b65 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.225563 Jul 30 21:10:51.084492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1345/2569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:51.091110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:51.105583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:51.125519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.126581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.127669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.128629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.168025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:51.196410 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec84a9cc-9ac1-4d97-a2f5-42f709a1c9a9 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110339 Jul 30 21:10:51.197440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1346/2570] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:10:51 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:51.203474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:51.204359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:51.215379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.216095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.217052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.217672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.219956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:51.236455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce288561-ebde-4bd4-8e18-9c4425d82006 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 1.114383 Jul 30 21:10:51.259486 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1225/2571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:50 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:51.265100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:51.267176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:51.276082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.276858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.278109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.279000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.788674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:51.800104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b6590fc-d5bb-41ab-963c-8df2c7117bf8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1541 microversion: 2.1 time: 0.601369 Jul 30 21:10:51.801296 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1347/2572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:51 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1541 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:51.807213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:51.808011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:51.811142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:51.814915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.815390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.816617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.817765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.819347 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e215e13d-f8b1-458e-bf69-8ec9eef7ccc0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1522 microversion: 2.1 time: 0.558185 Jul 30 21:10:51.820331 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1226/2573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:51 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:51.825097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:51.825949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:51.840622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.841111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.842117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:51.842580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:51.975021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lazy-loading 'services' on Instance uuid 914fd755-9940-4f50-9f38-378ea723e33e {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:10:52.115482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61e6adb0-1397-409e-a645-592b139dda46 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments/90f9f894-91c0-47f9-959a-1e5551ad4574" status: 202 len: 0 microversion: 2.1 time: 0.311568 Jul 30 21:10:52.116279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1348/2574] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:10:51 2022] DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments/90f9f894-91c0-47f9-959a-1e5551ad4574 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:52.126168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:52.128519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:52.136343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.137228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.138541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.139185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.272121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.284554 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-529ee2aa-57ec-4506-8f6b-da0831a7442e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.462758 Jul 30 21:10:52.291399 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1227/2575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:51 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:52.298617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:52.299260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:52.306737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.307331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.309419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.309882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.494069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.502786 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-701afea1-cf93-479f-9f02-f2679959728f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1278 microversion: 2.1 time: 0.384517 Jul 30 21:10:52.503449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1349/2576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:52 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1278 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:52.521036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:52.521914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:52.539161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.539665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.540475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.540932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.721047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.750244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.761286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.771929 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c65f86e-4bee-47b4-9f83-9b53b9c6e656 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.478700 Jul 30 21:10:52.772538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1228/2577] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:52 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:52.785935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a4610b4b-0906-4107-84fd-5eafb98c59fd req-d156ac8b-d9c3-463a-b6cc-96dc14abebf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a61d8b-8384-4314-9ba4-a04db0c365f9", "tag": "0ecc0204-cc29-4504-aff5-71b18acfd90d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:52.805648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a4610b4b-0906-4107-84fd-5eafb98c59fd req-d156ac8b-d9c3-463a-b6cc-96dc14abebf2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.806666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a4610b4b-0906-4107-84fd-5eafb98c59fd req-d156ac8b-d9c3-463a-b6cc-96dc14abebf2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.826993 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a4610b4b-0906-4107-84fd-5eafb98c59fd req-d156ac8b-d9c3-463a-b6cc-96dc14abebf2 service nova] Creating event network-changed:0ecc0204-cc29-4504-aff5-71b18acfd90d for instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 on nch1-master-1 Jul 30 21:10:52.840936 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a4610b4b-0906-4107-84fd-5eafb98c59fd req-d156ac8b-d9c3-463a-b6cc-96dc14abebf2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062295 Jul 30 21:10:52.842788 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1229/2578] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:52.850196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:52.850932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:52.859818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.860580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.862082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.862567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.957892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:52.966927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ba646f2-e5f2-4fbb-a292-e9619777888d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.457926 Jul 30 21:10:52.967787 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1350/2579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:52 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:52.972991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:52.973886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:52.980947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.981642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:52.982607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:52.983217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.328235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:53.340935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6cc6a867-513b-4fb6-833b-906c3ca44b9a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1541 microversion: 2.1 time: 0.496300 Jul 30 21:10:53.341537 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1230/2580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:52 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1541 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:53.347564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}, {"name": "network-changed", "server_uuid": "6a092da1-0ff1-4237-8612-037fb25c74fe", "tag": "a0c54e07-0e75-4b84-8ecb-22cbbc118348"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:53.367886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.368629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.388469 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Creating event network-changed:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch2-master-1 Jul 30 21:10:53.389254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Creating event network-changed:a0c54e07-0e75-4b84-8ecb-22cbbc118348 for instance 6a092da1-0ff1-4237-8612-037fb25c74fe on nch2-master-1 Jul 30 21:10:53.398320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:10:53.399659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:53.411674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5044006-c6bf-4d7a-b9ad-c0df9d0ed4c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1502 microversion: 2.1 time: 0.442535 Jul 30 21:10:53.412469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1351/2581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:52 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1502 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:53.417925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:53.419215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:53.427726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.428683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.429699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.430285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.433278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6f0a0472-059b-4011-8608-8dee4ee187e6 req-98914f6d-1db3-4f7d-9466-0238133b127c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.090487 Jul 30 21:10:53.434386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1231/2582] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:53.440443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:53.441446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:53.451426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.452102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.453123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.453793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.788318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:53.816337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d92e839-cf59-4dfa-a0b8-fcea187959ac tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.402476 Jul 30 21:10:53.820895 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1352/2583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:53 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:53.837926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:53.838675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:53.849728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.850737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.850869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:53.854780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.855522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.867388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0000ccf-1ce0-4713-a057-b714d5eadb37 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1515 microversion: 2.1 time: 0.431217 Jul 30 21:10:53.871760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1232/2584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:53 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1515 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:53.883166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:53.884182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:53.899341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.900064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:53.901034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:53.901670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.196870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.205238 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72290cd8-73fa-440e-bb39-f83e85153594 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.380996 Jul 30 21:10:54.205996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1353/2585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:53 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:54.216094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:54.219365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 483be809-4bb7-4962-8371-e7b4bd412006] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.226432 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/483be809-4bb7-4962-8371-e7b4bd412006/action HTTP/1.1 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 14 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: {"rescue": {}} Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '483be809-4bb7-4962-8371-e7b4bd412006', 'body': {'rescue': {}}} Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:54.232675 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:54.237446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 404 to user: Instance 483be809-4bb7-4962-8371-e7b4bd412006 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:54.238868 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8be034b-3ced-4bf9-bf2d-ae7766cbc845 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/483be809-4bb7-4962-8371-e7b4bd412006/action" status: 404 len: 111 microversion: 2.1 time: 0.031597 Jul 30 21:10:54.239628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1354/2586] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:54 2022] POST /compute/v2.1/servers/483be809-4bb7-4962-8371-e7b4bd412006/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:10:54.245095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:54.246064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.253992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.255240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.256165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.256728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.509539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.518410 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2714bdf7-aa66-461a-b840-3cd86e871572 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.277018 Jul 30 21:10:54.519168 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1355/2587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:54 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:54.536846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:54.537805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.546512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.546512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.547064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.547573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.548084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.562015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.567600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.570694 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-207b41b0-fa72-46ce-bd2b-cd8d7cb02ac4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.697375 Jul 30 21:10:54.572398 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1233/2588] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:53 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:54.579211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:54.580154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.591142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.591650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.592524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.592993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.644967 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-092536c9-7c74-4a17-86ea-2b95cd5ca0a7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action" status: 202 len: 0 microversion: 2.1 time: 0.124093 Jul 30 21:10:54.646110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1356/2589] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:54 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:54.651318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:54.653724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.661462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.662141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.662946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.663431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.696259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb572898-b4a2-4cea-a9d7-b1663c0f2845 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049127 Jul 30 21:10:54.697108 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1357/2590] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:10:54 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:54.702729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:54.703653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.709590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:54.711689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.712360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.713417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.714032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.857427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:54.867421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2386acc-469d-4185-be74-869142127a23 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1473 microversion: 2.1 time: 0.292679 Jul 30 21:10:54.868123 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1234/2591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:54 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:54.873406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:54.874108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:54.881367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.881920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.882782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:54.883503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:54.997376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.008911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-899f26f2-7656-4cb5-8104-bcb9b8bea7c7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1520 microversion: 2.1 time: 0.310460 Jul 30 21:10:55.009498 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1358/2592] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:54 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:55.023197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.024979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21acb434-81bc-4b5a-9933-73289bc11bbc", "tag": "3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f"}, {"name": "network-changed", "server_uuid": "b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5", "tag": "cd4985e8-18b4-466b-9a4b-fe89d5868a12"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:55.031558 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1464bae8-69a7-4e17-b319-83d61196a6d0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.161733 Jul 30 21:10:55.037638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.038146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.046052 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1235/2593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:54 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:55.057209 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] Creating event network-changed:3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f for instance 21acb434-81bc-4b5a-9933-73289bc11bbc on nch1-master-1 Jul 30 21:10:55.057731 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] Creating event network-changed:cd4985e8-18b4-466b-9a4b-fe89d5868a12 for instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 on nch2-master-1 Jul 30 21:10:55.065936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-613116cf-e7c7-4778-bb5b-7cff1ac88492 req-57c96829-926f-49a3-8352-2b3dfe0a214c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044496 Jul 30 21:10:55.066552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1359/2594] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:55.226662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.227331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.234250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.234743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.235585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.236035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.240306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:55.376238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.383941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-318a49d0-beb0-4e45-af8c-32f3a05d68ed tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.161866 Jul 30 21:10:55.384528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1236/2595] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:55.462704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-37c977a5-7d37-4e79-b578-dace59f00315 req-f3b1e2a9-86ad-464c-8566-6835ac52cf72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d322740c-3e04-4dba-904f-beae55e00106", "tag": "07cbad0d-ef17-4854-9ac6-c28e12b9d723"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:55.472389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-37c977a5-7d37-4e79-b578-dace59f00315 req-f3b1e2a9-86ad-464c-8566-6835ac52cf72 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.472854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-37c977a5-7d37-4e79-b578-dace59f00315 req-f3b1e2a9-86ad-464c-8566-6835ac52cf72 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.483767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-37c977a5-7d37-4e79-b578-dace59f00315 req-f3b1e2a9-86ad-464c-8566-6835ac52cf72 service nova] Creating event network-changed:07cbad0d-ef17-4854-9ac6-c28e12b9d723 for instance d322740c-3e04-4dba-904f-beae55e00106 on nch1-master-1 Jul 30 21:10:55.488699 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-37c977a5-7d37-4e79-b578-dace59f00315 req-f3b1e2a9-86ad-464c-8566-6835ac52cf72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031335 Jul 30 21:10:55.489284 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1360/2596] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:55.540222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.540854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.547228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.547808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.548511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.548971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.595690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.596415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.603266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.603769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.604567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.605025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.680090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.687855 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ebadebe-310d-490d-a524-48311396b879 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.151553 Jul 30 21:10:55.688549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1237/2597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:55.709514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.711827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.717851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.718311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.719103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.719580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.736413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.744996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.746670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:55.747911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60b64a8b-3f29-4abd-9464-8bdc1dd74d2a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.156556 Jul 30 21:10:55.748477 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1361/2598] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:10:55.750594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddf917a1-2474-4091-a301-cbe70de696be tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045591 Jul 30 21:10:55.751444 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1238/2599] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:10:55.812777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.815531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.818439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:55.819902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=22 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:55.828386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.828857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.829839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.830431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.863655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7311720-36a4-4924-af65-c16b5a09be71 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055313 Jul 30 21:10:55.864607 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1362/2600] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:10:55.889321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.890354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.898494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.899256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.900460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.901066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.958284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:55.959160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:55.967565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.968364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:55.969234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:55.969761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.011584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:10:56.015568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:56.069485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.077524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-597fe14d-c247-4f30-91b8-276a95b27ea8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1473 microversion: 2.1 time: 0.192932 Jul 30 21:10:56.080264 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1239/2601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:55 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:56.083273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.083962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.091157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.091936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.092674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.093137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.121014 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed7bb124-c130-4e12-a3f0-6d160388610d tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 204 len: 0 microversion: 2.1 time: 0.166494 Jul 30 21:10:56.122406 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1363/2602] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:10:55 2022] DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:10:56.135576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.136760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.143258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.143768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.144655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.145118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.304098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.312206 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d4c521a-5cdb-4c7b-ae0b-982006feb55b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.187481 Jul 30 21:10:56.313014 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1364/2603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:56.313127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.321220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f817352b-8b33-4dfb-8c04-36e43ef0fb55 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1520 microversion: 2.1 time: 0.241953 Jul 30 21:10:56.331976 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1240/2604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:56.344063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.344063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.356002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.356740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.357973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.359794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.405788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.406417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.417923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.418390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.419183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.419666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.688785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.697653 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb489fcc-562d-4a97-b408-344256bf8aaf tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.295850 Jul 30 21:10:56.698585 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1241/2605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:56.715565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.716387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.723248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.724071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.724919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.725555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.747646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.775048 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-68edc2e5-09df-45ec-96cf-46465b646cfb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1681 microversion: 2.1 time: 0.445446 Jul 30 21:10:56.783323 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1365/2606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1681 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:56.791513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:56.792158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:56.799179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.799743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.800853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:56.801037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:56.957419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:56.971901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8231dab7-b1ac-4fc5-8310-3c71d0c0d96c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.262198 Jul 30 21:10:56.972940 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1242/2607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:57.100898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.101761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.109881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.111600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.112467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.113012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.256661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.266342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.269146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.270601 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a88b1acc-9854-457a-971c-ea7d1c6633a7 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1743 microversion: 2.20 time: 0.488612 Jul 30 21:10:57.271704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1366/2608] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:56 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1743 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:57.290568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.299349 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5175cc23-5f82-4538-9aeb-b21f0f7cc140 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1470 microversion: 2.1 time: 0.204852 Jul 30 21:10:57.300506 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1243/2609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:57.321203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:57.321760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.328022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.328498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.329278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.329734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.332996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.334274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.340622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.341101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.341899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.342362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.371086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.371571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.372353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.372805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.397142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:10:57.402500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:10:57.483326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.491408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29744c82-6810-44bc-ad47-a47781fcd8b3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.162407 Jul 30 21:10:57.492166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1244/2610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:10:57.502105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.503326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.510847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.511353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.512169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.512785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.535363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dd31c5d9-5bfc-414a-842e-fef8dbe2fc2d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07/action" status: 202 len: 0 microversion: 2.1 time: 0.217908 Jul 30 21:10:57.538020 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1367/2611] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:57 2022] POST /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:57.553288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.554476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.565354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.568165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.569277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.569956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.706567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.715142 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30a0a68f-dd5f-443c-8c9b-3d93881c0b25 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1500 microversion: 2.1 time: 0.221874 Jul 30 21:10:57.716066 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1245/2612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:57.722447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.723194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.743748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.744377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.746243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.746812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.881601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:57.890679 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-661e5dd7-c693-428f-8199-1dc5d1fe3db3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1469 microversion: 2.1 time: 0.347386 Jul 30 21:10:57.900501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1368/2613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:57.907471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:57.913807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.922352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.922832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.923842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.925678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.954748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'flavor' on Instance uuid 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:10:57.968160 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Cannot 'rescue' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state paused Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action HTTP/1.1 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 14 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: {"rescue": {}} Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'rescue' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state paused Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6cdffb63-cce7-4f8c-93e6-1e91d1a86b33', 'body': {'rescue': {}}} Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 in vm_state paused. Cannot rescue while the instance is in this state. Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state paused Jul 30 21:10:57.970030 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state paused Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 409 to user: Cannot 'rescue' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state paused {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37a8fb50-43fd-45a7-8be3-7ceddea06576 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action" status: 409 len: 144 microversion: 2.1 time: 0.068878 Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1369/2614] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:57 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:57.979027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:57.986025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.986490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.987313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:57.987765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:57.990929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:58.019143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8a62b7a-b608-48a5-bdc3-829da1e20901 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.299935 Jul 30 21:10:58.032301 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1246/2615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:58.039877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:58.040455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:58.047327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.047826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.048783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.049238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.129591 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfbc271e-1c32-470e-97ae-38c4e3d06d63 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action" status: 202 len: 0 microversion: 2.1 time: 0.095789 Jul 30 21:10:58.133654 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1247/2616] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:10:58 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:10:58.138076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:58.138076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:58.144479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.144949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.145747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.146247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.368398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:58.376542 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92945935-dfdd-4b7a-a3df-5261c65369cb tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1681 microversion: 2.1 time: 0.402667 Jul 30 21:10:58.377321 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1370/2617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:57 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1681 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:58.397927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:58.398917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:58.415641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.416310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.417127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.417582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.687045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:58.697751 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98c29381-ff8c-46a0-8a9d-79b44e300fb3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.565592 Jul 30 21:10:58.701284 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1248/2618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:58 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:58.709763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:58.711150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:58.724625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.725096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.725945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.726965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.758943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:58.807692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:58.896642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:58.904771 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a7e31b7-c99f-489b-89b4-27f619f3080a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1515 microversion: 2.1 time: 0.512292 Jul 30 21:10:58.905349 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1371/2619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:58 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:58.943112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:58.946036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:58.961191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.961871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:58.963416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:58.976087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.395565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:59.405863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-314a8473-4cf2-4a93-8d6a-4f826ef2ea0e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.488794 Jul 30 21:10:59.406488 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1372/2620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:58 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:59.416065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-plugged", "status": "completed", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:10:59.445151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.445617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.484292 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] Creating event network-vif-plugged:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch2-master-1 Jul 30 21:10:59.500287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:10:59.527190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-15314625-5b8b-4dc5-99d8-91f08909ddf4 req-27624d68-6fde-4b48-b500-7e00f0fb0444 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113257 Jul 30 21:10:59.529311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1373/2621] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:10:59.537838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:59.538555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:59.564049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.564536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.569924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.570399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.611687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:59.628334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:59.634011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:59.643762 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3db7d6ad-459a-46b6-a34a-94f7d579284d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1743 microversion: 2.20 time: 0.933970 Jul 30 21:10:59.644941 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1249/2622] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:10:58 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1743 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:10:59.653388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:59.654381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:59.666252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.666870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.667904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.668600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.826910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:10:59.836403 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-38194dd3-68cb-44a8-bcd6-d01d20228f3f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1469 microversion: 2.1 time: 0.305845 Jul 30 21:10:59.840145 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1374/2623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:59 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:10:59.845045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:10:59.851755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:10:59.862393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.863115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:10:59.864473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:10:59.866554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.037300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:00.046785 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-641d3cd8-6308-40e7-b81b-cfa7e04740d4 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.400087 Jul 30 21:11:00.053785 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1250/2624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:59 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:00.076225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:00.080476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:00.085879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:00.088867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5fda9fe3-00a9-4e7e-82ed-db34aeb7eafd tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1613 microversion: 2.1 time: 0.246712 Jul 30 21:11:00.091433 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1375/2625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:10:59 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:00.096059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.096747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.097829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.098446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.441227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:00.442237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:00.450618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.451500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.453381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.454160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.460202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:00.845277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:00.853069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:00.858951 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a0aadde-bbdf-4e67-8e40-cce348b38b84 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.800346 Jul 30 21:11:00.859707 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1251/2626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:00 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:00.872557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:00.873517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:00.895572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.900604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:00.903947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:00.907550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.028451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.043963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d858b60c-cb50-4d51-ad47-24fd1ed7e708 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 0.614774 Jul 30 21:11:01.045744 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1376/2627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:00 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:01.056916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:01.086056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:01.108382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.113014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.114106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.114896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.212357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'flavor' on Instance uuid 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:11:01.219390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.237517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.241533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.254403 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ae30160-1ff0-4698-be19-29ee38271e00 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.389518 Jul 30 21:11:01.257863 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1252/2628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:00 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:01.266066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:01.267379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:01.287430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.293306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.296948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.298688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.378271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c78082e3-a61c-47e1-ba96-996d85532d32 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action" status: 200 len: 32 microversion: 2.1 time: 0.330794 Jul 30 21:11:01.379105 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1377/2629] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:01 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:11:01.397384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:01.397712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:01.405355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.406390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.407187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.407927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.569676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.578506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1414558-05e4-472a-bb49-9f43a3d4bae7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1469 microversion: 2.1 time: 0.318537 Jul 30 21:11:01.585465 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1253/2630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:01 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:01.594724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:01.595555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:01.605083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.605817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.606797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.607520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.699706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.709199 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7bc38724-2a8b-4971-a9dd-c26f6cd14cd0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.328251 Jul 30 21:11:01.722628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:01.727328 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1378/2631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:01 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:01.732646 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72373361-cf3d-46ad-8da8-2c58283aee58 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1613 microversion: 2.1 time: 0.145870 Jul 30 21:11:01.732923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:01.733646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:01.746788 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1254/2632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:01 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:01.746788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21acb434-81bc-4b5a-9933-73289bc11bbc", "name": "network-vif-plugged", "status": "completed", "tag": "3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f"}, {"server_uuid": "6a092da1-0ff1-4237-8612-037fb25c74fe", "name": "network-vif-plugged", "status": "completed", "tag": "a0c54e07-0e75-4b84-8ecb-22cbbc118348"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:01.752359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.752828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.755009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.756542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.759103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.759899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:01.777699 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] Creating event network-vif-plugged:3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f for instance 21acb434-81bc-4b5a-9933-73289bc11bbc on nch1-master-1 Jul 30 21:11:01.778213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] Creating event network-vif-plugged:a0c54e07-0e75-4b84-8ecb-22cbbc118348 for instance 6a092da1-0ff1-4237-8612-037fb25c74fe on nch2-master-1 Jul 30 21:11:01.800454 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2f71d252-07ca-4027-95ab-a830dd97fe12 req-478cc2a8-da19-4bf8-85d3-38bc57946fb1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065166 Jul 30 21:11:01.801319 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1255/2633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:01.964479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0e6543db-5728-4fbb-8bbd-4b3c3de8b8a9 req-64128b57-f7bc-4271-9bfd-4dd03b6ffaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914fd755-9940-4f50-9f38-378ea723e33e", "name": "network-vif-deleted", "tag": "8745a6b9-a208-4303-b33c-e934968b161e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:01.988442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0e6543db-5728-4fbb-8bbd-4b3c3de8b8a9 req-64128b57-f7bc-4271-9bfd-4dd03b6ffaea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:01.989209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0e6543db-5728-4fbb-8bbd-4b3c3de8b8a9 req-64128b57-f7bc-4271-9bfd-4dd03b6ffaea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.036049 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0e6543db-5728-4fbb-8bbd-4b3c3de8b8a9 req-64128b57-f7bc-4271-9bfd-4dd03b6ffaea service nova] Creating event network-vif-deleted:8745a6b9-a208-4303-b33c-e934968b161e for instance 914fd755-9940-4f50-9f38-378ea723e33e on nch2-master-1 Jul 30 21:11:02.055038 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0e6543db-5728-4fbb-8bbd-4b3c3de8b8a9 req-64128b57-f7bc-4271-9bfd-4dd03b6ffaea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251668 Jul 30 21:11:02.057651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1256/2634] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:02.072604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:02.073762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:02.080230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:02.092178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.093098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.096267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.096947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.163164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:02.174719 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b5a83bd7-c33f-4716-b236-45bf988dd570 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.446070 Jul 30 21:11:02.175340 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1379/2635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:01 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:02.187322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:02.202491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:02.231116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.233545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.237547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.238968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.892375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:02.905569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b669a6b4-f117-4fdb-bf43-4f930bbaaa3d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.845889 Jul 30 21:11:02.919562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1257/2636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:02 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:02.927370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:02.928331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:02.938651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.939848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:02.947278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:02.948155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.243280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.252365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.253576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.254802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f22a1321-abdf-4fba-8018-37a2eb444200 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.336489 Jul 30 21:11:03.266194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.275911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be19502a-3904-4998-93c6-7e5c48743d49 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1314 microversion: 2.1 time: 1.092307 Jul 30 21:11:03.280651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1258/2637] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:02 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:03.285520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:03.286260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:03.291703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1380/2638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:02 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1314 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:03.305360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:03.306668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:03.320209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.321582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.323666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.324154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.324928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.325078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.325420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.326022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.576372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.584859 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-57e1f2ab-8362-44cb-aaae-e8c5f26b7aae tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1469 microversion: 2.1 time: 0.302644 Jul 30 21:11:03.586162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.595355 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1259/2639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:03 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:03.595355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:03.595355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:03.606428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0446d456-b181-4151-b97c-90158b04d1d0 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.313496 Jul 30 21:11:03.623638 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1381/2640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:03 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:03.629720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:03.630919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:03.633008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.633834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.634886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.635528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.657224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.657953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.659009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.659724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.691693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.692521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.693850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lazy-loading 'fault' on Instance uuid 914fd755-9940-4f50-9f38-378ea723e33e {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:11:03.742820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e94018c474c838b1b989f3d4013a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcec3648d3843dd96bfed76e793598a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:03.753561 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb087171-d0d6-45e5-8e39-ae426af16372 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 200 len: 1331 microversion: 2.1 time: 0.164923 Jul 30 21:11:03.767870 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1260/2641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:03 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:03.934648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:03.936468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:03.956385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.957699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.958641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:03.959140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:03.966743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.001952 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4ae0b2a4-075f-4a02-b408-6cd161bcfab1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.376567 Jul 30 21:11:04.030220 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1382/2642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:03 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:04.037865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b22355a5-3d01-485c-a3be-619963eacb99 req-1cdb7552-89e1-41b3-abf4-97c2ed83755b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a61d8b-8384-4314-9ba4-a04db0c365f9", "name": "network-vif-plugged", "status": "completed", "tag": "0ecc0204-cc29-4504-aff5-71b18acfd90d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:04.056626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b22355a5-3d01-485c-a3be-619963eacb99 req-1cdb7552-89e1-41b3-abf4-97c2ed83755b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.057307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b22355a5-3d01-485c-a3be-619963eacb99 req-1cdb7552-89e1-41b3-abf4-97c2ed83755b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.090076 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b22355a5-3d01-485c-a3be-619963eacb99 req-1cdb7552-89e1-41b3-abf4-97c2ed83755b service nova] Creating event network-vif-plugged:0ecc0204-cc29-4504-aff5-71b18acfd90d for instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 on nch1-master-1 Jul 30 21:11:04.099564 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b22355a5-3d01-485c-a3be-619963eacb99 req-1cdb7552-89e1-41b3-abf4-97c2ed83755b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067122 Jul 30 21:11:04.100422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1383/2643] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:04.308096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:04.309699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:04.321893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.322625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.323629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.326547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.342125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.351044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-003411c6-3fed-46ad-a777-1d5d6867f845 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.425894 Jul 30 21:11:04.354984 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1261/2644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:03 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:04.359902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:04.360532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:04.368288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.368492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.369193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.369647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.572943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.600212 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c2d6e29-3c11-47a3-b1fa-f3ee139efd7a tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1501 microversion: 2.1 time: 0.243963 Jul 30 21:11:04.600925 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1262/2645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:04 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:04.630701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:04.631648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:04.647829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.648536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.650071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.650759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.657708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.676051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.683885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.698794 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-826706ec-eb44-4331-b98c-a7cc565fa4e8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.395186 Jul 30 21:11:04.699685 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1384/2646] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:04 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:11:04.704909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:04.740563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:04.756321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.757074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.760765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.761442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.808257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lazy-loading 'flavor' on Instance uuid 21acb434-81bc-4b5a-9933-73289bc11bbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:11:04.938394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:04.948786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-edbcbb3f-5e70-4e52-aed0-eba24f5c8224 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1535 microversion: 2.1 time: 0.334017 Jul 30 21:11:04.954851 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-faaa30b7-23bf-45fb-b9ff-08c8da34c7cb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "POST /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc/action" status: 200 len: 32 microversion: 2.1 time: 0.253728 Jul 30 21:11:04.956154 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1385/2647] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:04 2022] POST /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:11:04.962652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:04.963620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:04.971168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.972070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1263/2648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:04 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1535 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:04.972463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.974162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:04.974799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:04.982877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:04.983549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:05.030024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.030504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.031327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.031794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.069163 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] HTTP exception thrown: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Request method failure captured: Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e HTTP/1.1 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z3KnAQzgpxK50KlrMyFeLExZf2vdyY1paViV5jed6Ak1l0tmVwxf5PG3bPgI4Ej3HA92DoXvR4OMWFv5Ps2LWpsKbQcA6kZvm38QFSFNgpejw_B6o-_LSYir7PzAVmkSf8Kbz5fOE2sABhrq7LUn-A2lZzBvbIcgkOhe8R8K7QuTJc Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dcec3648d3843dd96bfed76e793598a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 879e94018c474c838b1b989f3d4013a0 Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '914fd755-9940-4f50-9f38-378ea723e33e'} Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:05.072264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:05.077444 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:05.079779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Returning 404 to user: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:05.082089 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b30c1fc-106a-410c-b819-af5777c64701 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 404 len: 111 microversion: 2.1 time: 0.108874 Jul 30 21:11:05.084501 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1264/2649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:04 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:05.090732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:05.091865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:05.098950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.099825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.100822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.101463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.460510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:05.476455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d89fafec-5178-46c3-8903-8311feb068c3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.390070 Jul 30 21:11:05.490989 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1265/2650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:05 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:05.496551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-unplugged", "status": "completed", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:05.507893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.508286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.524241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:05.539470 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] Creating event network-vif-unplugged:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:11:05.540802 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-819c6763-b7c4-4496-97f0-a6148db0561f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.581577 Jul 30 21:11:05.546415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:11:05.563054 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1386/2651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:04 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:05.563581 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-acd467ef-dcf6-44a2-a7f7-a99656b1c6d3 req-9eca9b8d-0e67-4be2-873e-4de9348ce51e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070932 Jul 30 21:11:05.564585 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1266/2652] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:05.569783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:05.570583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc2f176c-e80b-41ec-94a7-0d3f79593c02 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '.version_select at 0x7fbb629dc820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:05.570713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:05.580687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.581341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.582280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.582894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.606395 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc2f176c-e80b-41ec-94a7-0d3f79593c02 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567046396" status: 202 len: 0 microversion: 2.1 time: 0.040330 Jul 30 21:11:05.609997 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1267/2653] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:11:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567046396 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:11:05.628003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:05.631962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:05.651031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.651609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.652869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:05.653474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:05.995577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.010856 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b851eee7-5011-45df-bbb6-f1364aff509c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1314 microversion: 2.1 time: 0.399657 Jul 30 21:11:06.013102 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1268/2654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:05 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:06.023439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:06.025660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:06.034496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.035383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.036701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.037549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.210349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.224554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af6fd01f-72a0-4923-b8ae-a0bb310b547f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.659041 Jul 30 21:11:06.227276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1387/2655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:05 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:06.237647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:06.238707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:06.254634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.256378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.257539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.259347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4dbdc9ac-4d14-4152-8691-10010afacb9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.554770 Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1269/2656] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:06 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:06.582679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d322740c-3e04-4dba-904f-beae55e00106", "name": "network-vif-plugged", "status": "completed", "tag": "07cbad0d-ef17-4854-9ac6-c28e12b9d723"}, {"server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "name": "network-vif-plugged", "status": "completed", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}, {"server_uuid": "b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5", "name": "network-vif-plugged", "status": "completed", "tag": "cd4985e8-18b4-466b-9a4b-fe89d5868a12"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:06.587919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.588391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.605223 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Creating event network-vif-plugged:07cbad0d-ef17-4854-9ac6-c28e12b9d723 for instance d322740c-3e04-4dba-904f-beae55e00106 on nch1-master-1 Jul 30 21:11:06.605764 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Creating event network-vif-plugged:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:11:06.606299 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] Creating event network-vif-plugged:cd4985e8-18b4-466b-9a4b-fe89d5868a12 for instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 on nch2-master-1 Jul 30 21:11:06.625814 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5638a437-8abb-4573-8db5-097cb351d23f req-de3060a7-20d8-4151-860d-7700b7738aea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054421 Jul 30 21:11:06.636981 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1270/2657] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:06.643235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:06.643835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:06.658986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.659393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.661074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.662297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.840177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:06.856337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f49f556-f0c4-4991-83ed-443e564b4aaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1535 microversion: 2.1 time: 0.627637 Jul 30 21:11:06.875425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1388/2658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:06 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1535 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:06.893326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:06.894448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:06.937888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.939575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:06.948536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:06.950342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.019517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:07.156742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:07.169044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4c3362e-ffe9-45a6-b979-0bbf628f438f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.530028 Jul 30 21:11:07.185203 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1271/2659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:06 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:07.206752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:07.207624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:07.217691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.218384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.219189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.219819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.228381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:07.238401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:07.250146 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41208bff-3d39-4bc0-aa3c-0ae6253f33c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.372779 Jul 30 21:11:07.250755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1389/2660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:06 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:07.268970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:07.269832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:07.282002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.282622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.284500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.284986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.383123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:07.504118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:07.516156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc5c1a35-0bb3-41da-9b50-ffa2764bd753 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1502 microversion: 2.1 time: 0.329504 Jul 30 21:11:07.521405 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1272/2661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:07 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:07.539639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:07.539982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:07.550941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.551437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.552271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.552928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.572215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:07.592034 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa9090c6-7792-4a7c-8975-149220b50439 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.339456 Jul 30 21:11:07.593409 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1390/2662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:07 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:07.601674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:07.602725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:11:07.619983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.621876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.646757 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] Creating event network-changed:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:11:07.671956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:11:07.697277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-17294c1c-c232-4017-a1ec-0dbcbf007f52 req-46b1d470-b18d-4650-872c-9a76496548c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099498 Jul 30 21:11:07.704435 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1391/2663] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:07.717637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:07.721286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:07.732637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.734238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.735258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.736577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.758845 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fba2c688-7192-4ed9-99af-e0e3f1ba285b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 204 len: 0 microversion: 2.1 time: 0.223268 Jul 30 21:11:07.760707 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1273/2664] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:07 2022] DELETE /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:11:07.772520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:07.774477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:07.782119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.782676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:07.783827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:07.784538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.038527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.053038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.055153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.060399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f176d885-603f-453d-9db2-a8d647d638d0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.351820 Jul 30 21:11:08.062213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.072661 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1392/2665] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:07 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:08.072886 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77e4b612-e83b-4ddb-a284-84de2d72220e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1508 microversion: 2.1 time: 0.305237 Jul 30 21:11:08.079608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:08.079608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:08.090551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1274/2666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:07 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:08.093733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.094429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.095495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.096090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.195522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:08.200888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:08.218318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.221849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.223918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.228108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.536104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.549416 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-679c8294-6199-43a5-bcf3-de86624a5f04 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.363994 Jul 30 21:11:08.564796 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1275/2667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:08 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:08.572032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:08.572989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:08.580563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.581034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.581763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.583001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.596429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.600760 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5c40295-b1ab-4d48-9e5d-3c04b03eb121 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1535 microversion: 2.1 time: 0.536662 Jul 30 21:11:08.607848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1393/2668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:08 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1535 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:08.639804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:08.640667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:08.659894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.660515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.665023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:08.665754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:08.921458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:08.939806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-200d04c0-00a5-485d-8206-09da73367b0e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.373310 Jul 30 21:11:08.953820 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1276/2669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:08 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:09.016838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.026229 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-02474348-3da2-48e8-bd37-7a93ce2a0033 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.416120 Jul 30 21:11:09.030060 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1394/2670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:08 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:09.088641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:09.089770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:09.097390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:09.099266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:09.129405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.142250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.144919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.148348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.149456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.151154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.158531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.159724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.427645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.427645 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-480842bc-d6ff-4838-8f81-30e337ab2781 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1508 microversion: 2.1 time: 0.334027 Jul 30 21:11:09.428757 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1395/2671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:09 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:09.473113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.486455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.488435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.490346 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83b5e71c-3730-410c-a5d9-fdb607e47d85 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.405840 Jul 30 21:11:09.491563 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1277/2672] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:09 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:09.576137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:09.577209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:09.585986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.586629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.587744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.588364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.638243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:09.638834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:09.671851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.673722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.674936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.675480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.813237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.822951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86191869-760e-4c58-9637-e3ff86d1127f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.251384 Jul 30 21:11:09.824200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1396/2673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:09 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:09.878813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:09.889827 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3023899e-51d0-4c0b-a219-cac1898481f1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1535 microversion: 2.1 time: 0.255540 Jul 30 21:11:09.904030 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1278/2674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:09 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1535 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:09.966332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:09.967314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:09.975249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.975765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:09.976795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:09.977391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.057889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.058809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.070762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.071235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.072109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.072569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.205686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.216283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-644e0fb6-c3ec-4d6f-96e5-003b042fc799 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1320 microversion: 2.1 time: 0.254028 Jul 30 21:11:10.217258 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1397/2675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:09 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:10.289471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.300475 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-394bca6c-94dc-4b16-bd13-f9e3391ae7bb tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.246899 Jul 30 21:11:10.301247 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1279/2676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:10.449449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.450036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.452423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:10.460469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.460865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.484498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.485060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.491877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.492969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.500448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.501402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.502498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.503107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.524448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] HTTP exception thrown: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Request method failure captured: Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e HTTP/1.1 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z3KnAQzgpxK50KlrMyFeLExZf2vdyY1paViV5jed6Ak1l0tmVwxf5PG3bPgI4Ej3HA92DoXvR4OMWFv5Ps2LWpsKbQcA6kZvm38QFSFNgpejw_B6o-_LSYir7PzAVmkSf8Kbz5fOE2sABhrq7LUn-A2lZzBvbIcgkOhe8R8K7QuTJc Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dcec3648d3843dd96bfed76e793598a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 879e94018c474c838b1b989f3d4013a0 Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '914fd755-9940-4f50-9f38-378ea723e33e'} Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:10.526817 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.531344 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.537524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Returning 404 to user: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:10.541009 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e79ed5ee-f49b-42ad-a08d-2b660dc4e1c4 tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 404 len: 111 microversion: 2.1 time: 0.069233 Jul 30 21:11:10.541782 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1280/2677] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:10 2022] DELETE /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:11:10.550932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.554154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.562823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.563833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.565961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.566809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.714807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.725140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3fb472f2-3de8-4c0b-a2f6-c4f1815d84c1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1508 microversion: 2.1 time: 0.279598 Jul 30 21:11:10.738886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1398/2678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:10.748206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.749346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] [instance: 914fd755-9940-4f50-9f38-378ea723e33e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.760090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.761422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.763840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.764575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.785318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] HTTP exception thrown: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Request method failure captured: Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e HTTP/1.1 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z3KnAQzgpxK50KlrMyFeLExZf2vdyY1paViV5jed6Ak1l0tmVwxf5PG3bPgI4Ej3HA92DoXvR4OMWFv5Ps2LWpsKbQcA6kZvm38QFSFNgpejw_B6o-_LSYir7PzAVmkSf8Kbz5fOE2sABhrq7LUn-A2lZzBvbIcgkOhe8R8K7QuTJc Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dcec3648d3843dd96bfed76e793598a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dcec3648d3843dd96bfed76e793598a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6dcec3648d3843dd96bfed76e793598a Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-523155028 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 879e94018c474c838b1b989f3d4013a0 Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-523155028-project Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '914fd755-9940-4f50-9f38-378ea723e33e'} Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:10.788781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. Jul 30 21:11:10.794050 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:10.795716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] Returning 404 to user: Instance 914fd755-9940-4f50-9f38-378ea723e33e could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:10.796818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16f45080-bc54-46e5-82e2-68b2a858550c tempest-AttachSCSIVolumeTestJSON-523155028 tempest-AttachSCSIVolumeTestJSON-523155028-project] 10.222.0.17 "GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e" status: 404 len: 111 microversion: 2.1 time: 0.053546 Jul 30 21:11:10.801866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1399/2679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/914fd755-9940-4f50-9f38-378ea723e33e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:10.824236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.836212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.838215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:10.844136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-363b45cc-5ce0-457f-864a-0ddc84c163ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.300216 Jul 30 21:11:10.845233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1281/2680] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:10.847426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.848758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.857111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.857980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.858927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.859587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.916413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:10.917194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:10.933576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.934307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:10.935899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:10.936511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:11.193419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:11.202977 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a566276-1649-49e6-a5fe-f0d66a77316e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.360409 Jul 30 21:11:11.216008 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1400/2681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:11.238679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:11.239729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:11.250381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:11.256535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:11.257643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:11.258581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:11.812946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:11.828284 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6986d614-dff4-4128-b03d-e8f661fec4c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1528 microversion: 2.1 time: 0.919281 Jul 30 21:11:11.843722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1282/2682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:10 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1528 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:11.850240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:11.850880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:11.857737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:11.858475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:11.859491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:11.860107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:11.955386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:11.971675 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf7b471c-d1de-44b0-8736-5b505638d368 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1511 microversion: 2.1 time: 0.736504 Jul 30 21:11:11.987679 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1401/2683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:11 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1511 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:11.994679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:11.995985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:12.013989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.014719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.015618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.016099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.225781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.237426 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fbcef939-afa7-4d1c-82c1-e53b076ef095 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1508 microversion: 2.1 time: 0.246470 Jul 30 21:11:12.240616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1402/2684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:11 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:12.252646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:12.253527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:12.261735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.262421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.263398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.264061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.300038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.313208 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c38df30-01fe-4842-ae78-9019b2474294 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.468066 Jul 30 21:11:12.314528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1283/2685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:11 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:12.320689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:12.321640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:12.329217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.330786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.331977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.333943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.539381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.548544 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23156b87-370a-4b40-b373-6c4ab4f5c0a8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1528 microversion: 2.1 time: 0.306630 Jul 30 21:11:12.549545 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1403/2686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:12 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:12.555022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:12.555763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:12.563022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.563022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.564090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.564537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.790543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.803951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed835978-d95f-4a86-89df-1c78c92f0c1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1510 microversion: 2.1 time: 0.251291 Jul 30 21:11:12.804874 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1404/2687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:12 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:12.827268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:12.827992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:12.835442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.835923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.836709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:12.837959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:12.920921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.939269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.941231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:12.945003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f73196e3-724a-4a0b-ad38-320ebec42e8a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.628986 Jul 30 21:11:12.946139 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1284/2688] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:12 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:12.972474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84970d94-4d2c-4f3c-be43-b3573584dcd9 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:12.976065 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:11:12.976065 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:11:12.983702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-84970d94-4d2c-4f3c-be43-b3573584dcd9 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] HTTP exception thrown: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84970d94-4d2c-4f3c-be43-b3573584dcd9 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Request method failure captured: Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/flavors/55b98233-bb62-4348-9dd0-b7ca4dca6f12 HTTP/1.1 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2GhOAqlMofF7NzeJIo80ZS0miNTZGG-dwZlzFOGmroJMppIKIyo8rrNx7ayM_WBGM91dbuDYOFSovi7HDv-cJw0WHZnSq1UN68hLLDZUR52-2vR7Pu0yDra4SqgdawIn_EGoSs8JWk0-HTNK9pszh63vNRYg7uoBlQJgcMjtrfnGQ Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 43b34535abfb4f5d86e5091998a6823b Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-MigrationsAdminTest-814394737 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/43b34535abfb4f5d86e5091998a6823b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_43b34535abfb4f5d86e5091998a6823b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43b34535abfb4f5d86e5091998a6823b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43b34535abfb4f5d86e5091998a6823b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-MigrationsAdminTest-814394737 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 43b34535abfb4f5d86e5091998a6823b Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-MigrationsAdminTest-814394737 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-MigrationsAdminTest-814394737-project-admin Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 042c41b5f14d4a87979147530adccda3 Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-MigrationsAdminTest-814394737-project-admin Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: exception: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '55b98233-bb62-4348-9dd0-b7ca4dca6f12'} Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:13.002079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. Jul 30 21:11:13.008748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:13.013814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84970d94-4d2c-4f3c-be43-b3573584dcd9 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Returning 404 to user: Flavor 55b98233-bb62-4348-9dd0-b7ca4dca6f12 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:13.014956 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-84970d94-4d2c-4f3c-be43-b3573584dcd9 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/55b98233-bb62-4348-9dd0-b7ca4dca6f12" status: 404 len: 109 microversion: 2.1 time: 0.067442 Jul 30 21:11:13.016057 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1285/2689] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:12 2022] DELETE /compute/v2.1/flavors/55b98233-bb62-4348-9dd0-b7ca4dca6f12 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:13.039196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-790ff025-5fea-4928-8234-c64aefc79f08 req-6aad047c-d6b5-42d4-a616-a6fcd52cccae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a61d8b-8384-4314-9ba4-a04db0c365f9", "name": "network-vif-deleted", "tag": "0ecc0204-cc29-4504-aff5-71b18acfd90d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:13.053881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-790ff025-5fea-4928-8234-c64aefc79f08 req-6aad047c-d6b5-42d4-a616-a6fcd52cccae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.054628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-790ff025-5fea-4928-8234-c64aefc79f08 req-6aad047c-d6b5-42d4-a616-a6fcd52cccae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.111661 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-790ff025-5fea-4928-8234-c64aefc79f08 req-6aad047c-d6b5-42d4-a616-a6fcd52cccae service nova] Creating event network-vif-deleted:0ecc0204-cc29-4504-aff5-71b18acfd90d for instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 on nch1-master-1 Jul 30 21:11:13.119645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:13.132409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-790ff025-5fea-4928-8234-c64aefc79f08 req-6aad047c-d6b5-42d4-a616-a6fcd52cccae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097400 Jul 30 21:11:13.135757 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1286/2690] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:13.136831 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2792868-5ca1-4e41-913b-01346a555ff1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.313524 Jul 30 21:11:13.139615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1405/2691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:12 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:13.151072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:13.154210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:13.170030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.173121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.175047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.178122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.262298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:13.263003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:13.279546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.280829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.281800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.282552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.321648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.322874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.323603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'fault' on Instance uuid 17a61d8b-8384-4314-9ba4-a04db0c365f9 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:11:13.378945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:13.389548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:13.392703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52de531f-d9fe-4255-b74d-4a4a1626782a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 200 len: 1304 microversion: 2.1 time: 0.134550 Jul 30 21:11:13.406100 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1406/2692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:13 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:13.430594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1988657269", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:13.509448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] validate_networks() for None {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:13.628915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:13.653858 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a6f67e64-e853-406f-90ae-e926ab1bf93c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1511 microversion: 2.1 time: 0.511267 Jul 30 21:11:13.654540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1287/2693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:13 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:13.666690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:13.669613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:13.680576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.681364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.682347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.682990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.871775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:13.872484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:13.873071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:13.873915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:13.874441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:13.888558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.888558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.889602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:13.890780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:13.913580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:13.919714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Getting quotas for user 25cff561a2d14c45b71920346aee5d57 and project 61ed7d57264748e1907d9c2f3743667a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:13.930946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:13.936963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:13.940132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:13.942524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-937dce9f-5e8f-48c6-8919-e810f357e8b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.281977 Jul 30 21:11:13.946174 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1288/2694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:13 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:14.009595 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b95bc8f7-034e-42b1-a859-7f015bc7b8b2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599981 Jul 30 21:11:14.010808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1407/2695] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:14.016331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.024707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.026932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:14.047644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.048415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.049574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.050309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.077727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2aab2a73-7e70-4e4c-bb13-a95baa50b78c req-0ae3327c-c498-46de-b240-4345b6577755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-plugged", "status": "completed", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:14.094991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2aab2a73-7e70-4e4c-bb13-a95baa50b78c req-0ae3327c-c498-46de-b240-4345b6577755 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.102493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2aab2a73-7e70-4e4c-bb13-a95baa50b78c req-0ae3327c-c498-46de-b240-4345b6577755 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.125316 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2aab2a73-7e70-4e4c-bb13-a95baa50b78c req-0ae3327c-c498-46de-b240-4345b6577755 service nova] Creating event network-vif-plugged:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:11:14.137055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2aab2a73-7e70-4e4c-bb13-a95baa50b78c req-0ae3327c-c498-46de-b240-4345b6577755 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188869 Jul 30 21:11:14.140542 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1289/2696] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:14.155630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.156386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:14.179877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.180451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:14.180581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.181303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.181761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.193983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:14.324140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.330839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.331315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.524420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.534628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b7d7c76-9d04-45d5-9bdb-daafd099176e tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.522370 Jul 30 21:11:14.535738 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1408/2697] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:14.543416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-97224299-b04b-4bf0-8025-29c3dd78ea27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.544367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-97224299-b04b-4bf0-8025-29c3dd78ea27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:14.549677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.551222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.559670 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3974b6e9-9675-4595-acd9-35892d651529 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.415562 Jul 30 21:11:14.577779 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1290/2698] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:14.586343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.586972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:14.606868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.607584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.609407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.611895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.694881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97224299-b04b-4bf0-8025-29c3dd78ea27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.703560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-97224299-b04b-4bf0-8025-29c3dd78ea27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1213 microversion: 2.1 time: 0.165917 Jul 30 21:11:14.716099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1409/2699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:14.721016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.728703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:14.737403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.737867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.739197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.739685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.756927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 HTTP/1.1 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '17a61d8b-8384-4314-9ba4-a04db0c365f9'} Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:14.759686 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-605e765d-4b23-4782-acaf-a3de040c57c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 404 len: 111 microversion: 2.1 time: 0.043959 Jul 30 21:11:14.764794 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1410/2700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:14.766956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:14.775337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:14.776021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-878208814', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:14.783241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.783767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.784697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:14.785300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:14.929925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:15.042827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:15.052833 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2a54930-e25f-41c2-8f92-ad78d86cc8dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.474271 Jul 30 21:11:15.067893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1291/2701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:15.074433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1298578662", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:15.075721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:15.091408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.091830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:15.174592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:15.316561 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-027e0636-16ee-4459-905c-bad7cc5da765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-878208814" status: 200 len: 1513 microversion: 2.1 time: 0.551878 Jul 30 21:11:15.319886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1411/2702] 10.222.0.17 () {58 vars in 1261 bytes} [Sat Jul 30 21:11:14 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-878208814 => generated 1513 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:15.341786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:15.343090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:15.352267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.353175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:15.354155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.356357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:15.570408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:15.579142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0dff690-569d-4c7f-8a20-4b0ca425da14 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.242239 Jul 30 21:11:15.580195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1412/2703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:15 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:15.588049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:15.593841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:15.593841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:15.599486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.599983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:15.600770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.601218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:15.769855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:15.936656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:15.952084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:15.952901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.178734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d184615c-ddc4-4ff9-b4c8-8193aa61fcca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.594390 Jul 30 21:11:16.179399 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1413/2704] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 30 21:11:15 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:16.184760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:16.185548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:16.196128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.198605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.199695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.209114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.438323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.453696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.455926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.457359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2966822c-e21e-44f9-9c71-deaebda8715f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.276680 Jul 30 21:11:16.473315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1414/2705] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:16 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:16.482603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:16.483663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:16.492504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.493346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.494433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.495176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.618925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.620615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:16.621650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:16.622595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:16.623921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:16.624862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:16.640836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-acba7924-ad1f-450c-adee-bd49231a87c2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1271 microversion: 2.1 time: 0.162413 Jul 30 21:11:16.648295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1415/2706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:16 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:16.650597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.652920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.653897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.655719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.664464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:16.665514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:16.675801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.676333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.677223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.677702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.701143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:16.710961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:16.731658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:16.734125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:16.831019 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-35e1538f-027f-4e24-8041-0df08c5b81fd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761397 Jul 30 21:11:16.834435 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1292/2707] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:16.848347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:16.871000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.871795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.servers [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Removing options 'limit' from query {{(pid=130983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 30 21:11:16.873009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:16.884218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.884955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.886543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.888027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.929906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.938431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.939250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.956861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:16.969898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e862ad9-ff99-4ab7-9799-5dda6ee96462 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.318297 Jul 30 21:11:16.970494 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1416/2708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:16 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:16.976866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:16.977488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:16.995035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.995583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:16.996398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:16.996887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.284297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.298448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-298e5e5e-cea6-4bad-9a84-c941abdc7e06 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.326840 Jul 30 21:11:17.299746 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1417/2709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:16 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:17.307463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1617032-f163-4254-aca6-95d64285648b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:17.308653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1617032-f163-4254-aca6-95d64285648b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:17.390654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1617032-f163-4254-aca6-95d64285648b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.405140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1617032-f163-4254-aca6-95d64285648b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1215 microversion: 2.1 time: 0.100658 Jul 30 21:11:17.408091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1418/2710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:17 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:17.486614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:17.488074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:17.498023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.498876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.500440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.501514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.722133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.732671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.743359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.743359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a724f9d-87ca-40c3-b8ed-62f661817d6b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.255563 Jul 30 21:11:17.752124 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1419/2711] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:17 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:11:17.760383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:17.761075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:17.768496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.769137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.769937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.770413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.819768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3d3a124-d6d5-4f83-8e8d-92b06fd54bc1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.971881 Jul 30 21:11:17.819768 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1293/2712] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:11:16 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:17.850620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:17.861034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:17.861787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:17.897040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:17.901414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.901897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.906532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:17.907968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:17.999927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.018951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef5637aa-35be-4e0a-b509-44ebb99089ba tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1271 microversion: 2.1 time: 0.265437 Jul 30 21:11:18.020225 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1420/2713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:17 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.026900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.027557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:18.058724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.060824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.061750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:18.063146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.065433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.146244 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf350926-1cd2-4803-b12a-c53fc3fe351f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.309220 Jul 30 21:11:18.147256 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1294/2714] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:11:17 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.161991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.171480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.177506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.servers [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Removing options 'limit' from query {{(pid=130983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 30 21:11:18.178424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:18.208796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.209567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.210575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.211201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.350175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.367867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3e49362-7195-42f2-96d1-bb1867bb4878 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.344918 Jul 30 21:11:18.368450 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1421/2715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.374008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.375148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:18.376332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:18.383194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.384070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.386887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.387702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.510412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1d8cac9-1bb3-4f63-9516-ea3b60bd741b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.353863 Jul 30 21:11:18.520085 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1295/2716] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.532250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.533124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:18.547975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.550678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.551948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.555364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.760543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.776740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-634e0bb8-4425-404f-8c02-8fe5f06ef767 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1267 microversion: 2.1 time: 0.248956 Jul 30 21:11:18.780392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1296/2717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.806066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.821402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.822886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:18.843078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.846001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.847104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.851711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.882443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:18.906255 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b180446-36dc-4601-8d81-41692336d3d8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.536138 Jul 30 21:11:18.908599 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1422/2718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:18.928894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:18.929514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:18.948939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:18.949706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.951509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:18.957272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:18.958538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.053058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-33077cd5-f441-4981-9033-ef031cc1598f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.256613 Jul 30 21:11:19.070101 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1297/2719] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers => generated 1009 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:19.079608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.080612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:19.087787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.088573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.089580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.090244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.275718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.300595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.302933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.304296 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8685275e-e861-437c-bacf-83468d106825 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.393802 Jul 30 21:11:19.312475 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1423/2720] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:18 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:19.326525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.334885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.337779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:19.399590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.401141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.403509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.405083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.499997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.518665 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-413e5fdf-d5b4-4a2c-bbaf-5d5a560d3eca tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.447188 Jul 30 21:11:19.524377 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1298/2721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:19.546303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.547187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:19.558512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.559399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.560858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.561624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.624971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:19.668129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:19.774165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-879044d8-0bed-43b5-a9f3-20a784a942a3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.457339 Jul 30 21:11:19.775380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1424/2722] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:19.789312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.794399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.795053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.servers [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Removing options 'limit' from query {{(pid=130984) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 30 21:11:19.795700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:19.813940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.816586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.819856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.820342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.874228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42da7796-54f7-456f-906b-ebba9c9e2371 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.089725 Jul 30 21:11:19.874847 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1425/2723] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:19.890480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.891207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:19.904025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.904684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.909697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:19.911746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:19.955991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.966437 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-867520dd-7986-444b-a9e4-9e7eadaff756 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.424516 Jul 30 21:11:19.986336 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1299/2724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:19.991770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:19.997534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:19.999234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-878208814', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:20.006025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.006822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.007912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.008580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.053425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.063882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-58681af7-9ae7-4540-8dcf-2e79bff1b30a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1273 microversion: 2.1 time: 0.187713 Jul 30 21:11:20.064511 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1426/2725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:20.077568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:20.082012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:20.095437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.097043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.098115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.099976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.110938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:20.215661 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77b13e3b-536d-487a-be2c-e14ceff28c9c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-878208814" status: 200 len: 345 microversion: 2.1 time: 0.227612 Jul 30 21:11:20.217018 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1300/2726] 10.222.0.17 () {58 vars in 1240 bytes} [Sat Jul 30 21:11:19 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-878208814 => generated 345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:20.230590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-616fb59c-f3eb-4c84-95ba-79631557ae4f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:20.238062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616fb59c-f3eb-4c84-95ba-79631557ae4f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.238670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616fb59c-f3eb-4c84-95ba-79631557ae4f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.316386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-616fb59c-f3eb-4c84-95ba-79631557ae4f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:11:20.350288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.375587 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82928fee-2108-4c45-8ea2-f06ba0520a88 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.305835 Jul 30 21:11:20.386645 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1427/2727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:20 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:20.403344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:20.403344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:20.405920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.407339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.408149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.409141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.422112 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-616fb59c-f3eb-4c84-95ba-79631557ae4f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "POST /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe/action" status: 202 len: 0 microversion: 2.1 time: 0.195154 Jul 30 21:11:20.422909 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1301/2728] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:20 2022] POST /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:11:20.450213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:20.451101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:20.468596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.470221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.472523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.474074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.793378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.804730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.806726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.808549 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2bd131f-55d0-4faf-bd4f-2d75ea24ea4e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1738 microversion: 2.20 time: 0.429572 Jul 30 21:11:20.809581 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1428/2729] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:20 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:20.815217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:20.816273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:20.829375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.830263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.831467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:20.831930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:20.970167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:20.983944 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a60b8b0-e64e-4c55-b070-f1eba781bf13 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.555203 Jul 30 21:11:20.998523 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1302/2730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:20 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:21.017477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:21.019585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.039329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.043992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.045053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.048408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.249687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:21.260865 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69933693-cb12-43e0-b449-36437bde6984 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.449980 Jul 30 21:11:21.276440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1429/2731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:20 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:21.289240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:21.290846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.311772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.313169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.314859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.316224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.380711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:21.390764 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f0169f4a-dce7-4db3-bcb8-bf4d71b4b41f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.388264 Jul 30 21:11:21.391712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1303/2732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:21 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:21.400412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-daadbcc5-ecce-42df-85e6-cfc88fc77554 req-fd285989-a88b-45a4-bd04-e52d55c7fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:21.449887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-daadbcc5-ecce-42df-85e6-cfc88fc77554 req-fd285989-a88b-45a4-bd04-e52d55c7fa42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.450500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-daadbcc5-ecce-42df-85e6-cfc88fc77554 req-fd285989-a88b-45a4-bd04-e52d55c7fa42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.469380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-daadbcc5-ecce-42df-85e6-cfc88fc77554 req-fd285989-a88b-45a4-bd04-e52d55c7fa42 service nova] Creating event network-changed:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:11:21.476477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-daadbcc5-ecce-42df-85e6-cfc88fc77554 req-fd285989-a88b-45a4-bd04-e52d55c7fa42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082788 Jul 30 21:11:21.477144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1304/2733] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:21.483035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:21.484033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.491710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.492633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.494594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.495279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.730236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:21.734171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:21.743198 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbeb8ce6-9877-4097-afa0-f3cf8798dd74 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1501 microversion: 2.1 time: 0.264183 Jul 30 21:11:21.743567 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1305/2734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:21 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:21.744440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:21.754233 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-767fddd1-5a60-4910-871d-dfbabf6d5270 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.475551 Jul 30 21:11:21.768208 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1430/2735] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:21 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:21.773076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614115ca-d5a6-460a-a6c0-928cfeb56502"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:21.775762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.782435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.782832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.783658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.784103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.809455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Cannot 'attach_volume' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state rescued Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/os-volume_attachments HTTP/1.1 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 74 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: {"volumeAttachment": {"volumeId": "614115ca-d5a6-460a-a6c0-928cfeb56502"}} Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'attach_volume' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state rescued Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': '6cdffb63-cce7-4f8c-93e6-1e91d1a86b33', 'body': {'volumeAttachment': {'volumeId': '614115ca-d5a6-460a-a6c0-928cfeb56502'}}} Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 30 21:11:21.811571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state rescued Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state rescued Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 409 to user: Cannot 'attach_volume' instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 while it is in vm_state rescued {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:21.816211 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cbaf3b21-db8f-4112-ac21-828fcb1ea73b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048898 Jul 30 21:11:21.822331 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1306/2736] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:11:21 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:11:21.826373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:21.827024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.833851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:21.834502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.834781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.835510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.836639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.837459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.844597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.845076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.846553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.847018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.923693 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc587d67-2f6b-4336-b5bc-2c92331fdb62 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action" status: 202 len: 0 microversion: 2.1 time: 0.101370 Jul 30 21:11:21.924989 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1431/2737] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:21 2022] POST /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:11:21.934028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:21.935078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:21.942769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.943682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:21.944663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:21.945266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.090184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.099122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.100707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.101912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-837334a0-37ee-4e08-b6ac-910946586c49 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1720 microversion: 2.20 time: 0.273124 Jul 30 21:11:22.102623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1307/2738] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:21 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:11:22.114828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:22.116066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:22.124089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.124689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.125721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.126596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.292145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.300514 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-45fa38e8-62f6-4729-8c88-feb5c86b8389 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.196484 Jul 30 21:11:22.301167 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1308/2739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:22 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:22.306312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:22.306935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:22.313201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.313820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.314614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.315072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.457802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.466525 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-91a2b3db-9b08-4343-924a-f5258415ebd3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.163744 Jul 30 21:11:22.467111 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1309/2740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:22 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:22.471717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:22.472327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:22.480720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.481181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.481975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.482421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.594865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.603906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7fe0d0ce-a424-47da-9f1a-30c473a4528c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1509 microversion: 2.1 time: 0.673942 Jul 30 21:11:22.619780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1432/2741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:21 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1509 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:22.628544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.636838 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02a578c8-2dbc-4669-9c4e-8fd1513ab630 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.168653 Jul 30 21:11:22.637445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1310/2742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:22 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:22.725625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c2367ea0-349e-4835-a186-f7dfcf43594d req-9915b765-f336-4385-9504-a7ff70ed7974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f329f20-3dfe-4874-8c91-5ec9e9fe36a6", "tag": "5b554dfd-1200-4642-8537-7ec6f9dbf7b7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:22.732823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:22.741151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2367ea0-349e-4835-a186-f7dfcf43594d req-9915b765-f336-4385-9504-a7ff70ed7974 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.741832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2367ea0-349e-4835-a186-f7dfcf43594d req-9915b765-f336-4385-9504-a7ff70ed7974 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.755723 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c2367ea0-349e-4835-a186-f7dfcf43594d req-9915b765-f336-4385-9504-a7ff70ed7974 service nova] Creating event network-changed:5b554dfd-1200-4642-8537-7ec6f9dbf7b7 for instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 on nch2-master-1 Jul 30 21:11:22.760477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c2367ea0-349e-4835-a186-f7dfcf43594d req-9915b765-f336-4385-9504-a7ff70ed7974 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039492 Jul 30 21:11:22.761266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1433/2743] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:22.774893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:22.775561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:22.781684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.782143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.782921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:22.783402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:22.922514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:22.930546 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ecaf51b6-752b-4d1b-bf7b-ed0312e8efb4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.159563 Jul 30 21:11:22.931216 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1311/2744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:22 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:23.127094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.128866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.136315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.136942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.137672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.138118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.322844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.323497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.330081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.330547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.331404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.331854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.435223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.446695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.448699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.450825 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-32ab586f-147a-4a6c-9e6e-a63680e4db4d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1720 microversion: 2.20 time: 0.328414 Jul 30 21:11:23.467740 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1434/2745] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:23.476411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.485702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-42bd6c55-d2b8-426e-a554-1b2ac53462ea tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.166767 Jul 30 21:11:23.486526 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1312/2746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:23.495573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.495573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.495573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.496566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.497092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.497746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.626382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.627010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.635874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.636336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.637132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.637578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.753591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.766688 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d32f5217-9b0f-483b-83ae-0b182096b1f9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.282135 Jul 30 21:11:23.767303 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1435/2747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:23.772326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.772866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.778942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.779443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.780291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.780753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.798386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:23.807236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-132cb25b-e275-4595-bfd2-4abc754d2bca tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1509 microversion: 2.1 time: 0.185068 Jul 30 21:11:23.808056 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1313/2748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:23.953026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:23.953672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:23.960258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.960721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:23.961514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:23.961969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.110425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:24.119268 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6767139-0c24-4f88-8c52-19b3ccdfee48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.170554 Jul 30 21:11:24.120226 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1314/2749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:24.136534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:24.145020 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d82c94d-3ef7-4592-98fe-83cf0b18a706 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.376349 Jul 30 21:11:24.146001 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1436/2750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:23 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:24.478285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:24.478956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:24.486020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.486413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.487455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.488127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.508768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:24.509459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:24.517479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.518193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.519225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.519881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.699831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:24.712534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:24.714668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:24.716222 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cec4db0-053a-4c99-b9be-34ae1278a762 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1723 microversion: 2.20 time: 0.242593 Jul 30 21:11:24.716826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1315/2751] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:24 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:24.744780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22ff22c-052a-42ef-9649-a89754fa834d"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:24.748227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:24.758283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.758283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:24.759029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:24.759816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.221287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a906df95-70d5-4a8a-88c1-6e92df5e0d81 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.484702 Jul 30 21:11:25.228872 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1316/2752] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Jul 30 21:11:24 2022] POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments => generated 188 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:11:25.229302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:25.229862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:25.241185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.242951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.246262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.246806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.425618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:25.440741 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9186c600-29b9-476e-9502-76923d8c20ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.930529 Jul 30 21:11:25.454544 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1437/2753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:24 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:25.462017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:25.462997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:25.471943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.472657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.474719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.475360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.499738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:25.509517 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8bfbe0a8-e5c8-43a3-a5cd-80910c93054a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.285943 Jul 30 21:11:25.510891 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1317/2754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:25 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:25.516007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:25.517642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:25.528592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.529529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.530605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.531279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.682462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:25.690472 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-524e6886-871f-40dd-9d19-3d01efb5b506 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.178517 Jul 30 21:11:25.701076 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1318/2755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:25 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:25.701076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:25.701076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:25.705090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.705253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.706291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.706753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.847613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:25.857184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd7ae180-9275-419a-9686-4a88641ba206 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.164951 Jul 30 21:11:25.871410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1319/2756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:25 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:25.871410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-24bff1de-a90b-4645-8751-65d0b18fa794 req-f9bb4e24-31b2-4268-8b1c-05e2d57a3cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "name": "network-vif-unplugged", "status": "completed", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:25.871901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:25.873649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-24bff1de-a90b-4645-8751-65d0b18fa794 req-f9bb4e24-31b2-4268-8b1c-05e2d57a3cb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.874109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-24bff1de-a90b-4645-8751-65d0b18fa794 req-f9bb4e24-31b2-4268-8b1c-05e2d57a3cb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.879061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:25.879233 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2da92977-7775-4c88-9ac6-5aef4c6906de tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1509 microversion: 2.1 time: 0.422671 Jul 30 21:11:25.879967 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1438/2757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:25 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:25.886110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:25.886921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:25.895956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.897402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.898491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:25.899022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:25.902596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.server_external_events [req-24bff1de-a90b-4645-8751-65d0b18fa794 req-f9bb4e24-31b2-4268-8b1c-05e2d57a3cb3 service nova] Unable to find a host for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6. Dropping event network-vif-unplugged {{(pid=130983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 21:11:25.903554 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-24bff1de-a90b-4645-8751-65d0b18fa794 req-f9bb4e24-31b2-4268-8b1c-05e2d57a3cb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044757 Jul 30 21:11:25.904575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1320/2758] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 30 21:11:26.050362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130984) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 21:11:26.127920 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/action" status: 202 len: 0 microversion: 2.20 time: 0.245989 Jul 30 21:11:26.129063 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1439/2759] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:11:25 2022] POST /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:11:26.137772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:26.138404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:26.147070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.147636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.148472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.148931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.316006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:26.327331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:26.330383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:26.331925 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83a9a123-ed09-47ea-a7b4-6ef8f9b65f9d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1749 microversion: 2.20 time: 0.198296 Jul 30 21:11:26.333609 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1321/2760] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:26 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:11:26.469657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:26.471013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:26.479133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.479865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.482393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.482725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.503020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:26.537149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:26.538310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:26.546809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.547282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.548123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.548968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.916511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:26.925299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:26.931055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b5a47224-3283-4679-9b82-7eaa36997704 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.401611 Jul 30 21:11:26.939371 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1322/2761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:26 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:26.945048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:26.947751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:26.965152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.967649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.968772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:26.970585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:26.984969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.021157 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-130ccac1-0e11-4f93-8265-53e2800f3a1f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.558582 Jul 30 21:11:27.022884 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1440/2762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:26 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:27.028702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:27.029625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:27.042414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.043276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.044988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.046290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.219351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.230309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7b53507-640c-49e3-b8b6-b9116ac9cdd0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.295392 Jul 30 21:11:27.245528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1323/2763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:26 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:27.253941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:27.256150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:27.269255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.269976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.270961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.271601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.398520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.401558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:27.435391 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8075743b-aba2-4a97-a477-179159c54285 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.410369 Jul 30 21:11:27.436425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1441/2764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:27 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:27.441777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:27.442406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:27.449439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.450163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.451121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.451692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.639368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.640390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.650859 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-948c477a-5631-41f2-bf41-7eb813364719 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1509 microversion: 2.1 time: 0.403766 Jul 30 21:11:27.651739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1324/2765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:27 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:27.655190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.657005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:27.658390 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a4b71d2-3b09-43d3-a948-774ff59acc84 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1749 microversion: 2.20 time: 0.220791 Jul 30 21:11:27.659059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1442/2766] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:27 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1749 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:27.955482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:27.956331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:27.963900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.964362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:27.965410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:27.966291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.048380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:28.049282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:28.057424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.058087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.058885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.059524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.212492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.214745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.221249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6ff05e1f-c210-4e19-a03a-f4530c47ae25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.176669 Jul 30 21:11:28.222194 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1443/2767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:28 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:28.231425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2f6b4ce-fe5d-4306-8a3f-c137a7ef618e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.280230 Jul 30 21:11:28.247015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1325/2768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:27 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:28.253029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:28.253889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:28.261484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.261956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.262855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.263393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.416648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.424998 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-372b7ef7-1f5a-4de2-8157-eac07ba02de0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.176177 Jul 30 21:11:28.425627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1444/2769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:28 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:28.457962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:28.459154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:28.466499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.466899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.467715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.468405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.636290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.654912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3bab89f1-57f4-498a-8a95-496791bc87d5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.201384 Jul 30 21:11:28.657470 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1326/2770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:28 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:28.675465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:28.677504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:28.684311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:28.685090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:28.686191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.686853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.687987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.688600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.698008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.698476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.699537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:28.700456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:28.905456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.921980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.923856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.928568 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ac3f5b5-0fa0-4346-9bc4-f6405bdfca59 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1749 microversion: 2.20 time: 0.244998 Jul 30 21:11:28.930457 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1327/2771] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:28 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1749 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:28.951690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:28.968876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52fd8087-dd26-4b7f-a9c1-6f8be825dc0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1509 microversion: 2.1 time: 0.300030 Jul 30 21:11:28.969485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1445/2772] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:28 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:29.045886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f9a20501-efa9-4884-bb46-bcdbf5c6f738 req-b70f4630-f318-4320-a6ab-fc83d134a993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f329f20-3dfe-4874-8c91-5ec9e9fe36a6", "name": "network-vif-plugged", "status": "completed", "tag": "5b554dfd-1200-4642-8537-7ec6f9dbf7b7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:29.062620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f9a20501-efa9-4884-bb46-bcdbf5c6f738 req-b70f4630-f318-4320-a6ab-fc83d134a993 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.063491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f9a20501-efa9-4884-bb46-bcdbf5c6f738 req-b70f4630-f318-4320-a6ab-fc83d134a993 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.078343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f9a20501-efa9-4884-bb46-bcdbf5c6f738 req-b70f4630-f318-4320-a6ab-fc83d134a993 service nova] Creating event network-vif-plugged:5b554dfd-1200-4642-8537-7ec6f9dbf7b7 for instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 on nch2-master-1 Jul 30 21:11:29.085541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f9a20501-efa9-4884-bb46-bcdbf5c6f738 req-b70f4630-f318-4320-a6ab-fc83d134a993 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044340 Jul 30 21:11:29.086796 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1328/2773] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:29.244508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:29.245355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:29.257742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:29.258666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:29.276796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.280228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.283174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.284085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.284231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.285488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.288757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.292399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.515994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:29.531008 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49260fe8-344a-478a-957e-27a29e9b0bdc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.291888 Jul 30 21:11:29.532453 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1446/2774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:29.546249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:29.547879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:29.548745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:29.558741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.558933 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-037b8572-90b7-4439-bac4-4b60482e8dd2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.308390 Jul 30 21:11:29.559747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.560222 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1329/2775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:29.560924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.561423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.682545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:29.684139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:29.693286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.694063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.695365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.696441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.763019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:29.772639 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef73260d-af1b-41dd-bd0f-f11a035b4dd8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.238760 Jul 30 21:11:29.773563 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1447/2776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:29.881776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:29.899231 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-71342501-5b51-43d7-af82-131613d884f1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.222575 Jul 30 21:11:29.911962 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1330/2777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:29.959011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:29.960022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:29.962328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=12 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:29.971510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.972228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:29.974253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:29.975025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.006656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:30.007694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:30.018323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.019091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.020388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.021108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.056336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:30.221397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.228477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.244878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.246281 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb16ccee-5b08-452d-8681-37adc65b6cdc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1515 microversion: 2.1 time: 0.251439 Jul 30 21:11:30.247027 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1331/2778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:30.248984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.250428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3fa529a1-8b9d-41ff-b61f-382860ef66a0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1751 microversion: 2.20 time: 0.299087 Jul 30 21:11:30.252363 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1448/2779] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:29 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1751 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:30.555884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:30.556764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:30.580230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.580904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.581879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.583129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.586410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:30.590969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:30.603765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.604786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.605818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.606274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.839701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.850602 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57da7d9f-aa6a-466a-be2f-e87a2443c865 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.269814 Jul 30 21:11:30.853299 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1449/2780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:30 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:30.859058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:30.865739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:30.866385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:30.871947 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc86ec6a-8e16-48ab-8646-c87b951c21d6 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.320837 Jul 30 21:11:30.883001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.885856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.886725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.887191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.888620 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1332/2781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:30 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:30.922564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:30.923213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:30.941333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.942149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:30.943316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:30.943768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.087318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:31.102094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3ac8aaf-535d-4546-b2f8-fbc66e44f08a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1315 microversion: 2.1 time: 0.246718 Jul 30 21:11:31.103102 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1450/2782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:30 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:31.216904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:31.228407 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26d87d22-fbb3-4541-9f5c-c60318026deb tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.310537 Jul 30 21:11:31.229317 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1333/2783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:30 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:31.280678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:31.281917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:31.291806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:31.292538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.293585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:31.294065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.364304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e3ec5406-39bd-4549-96f7-569880457a94 req-ca37bef5-70ed-409c-8569-deb3ed476d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-plugged", "status": "completed", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:31.377118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e3ec5406-39bd-4549-96f7-569880457a94 req-ca37bef5-70ed-409c-8569-deb3ed476d91 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:31.378410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e3ec5406-39bd-4549-96f7-569880457a94 req-ca37bef5-70ed-409c-8569-deb3ed476d91 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.393083 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e3ec5406-39bd-4549-96f7-569880457a94 req-ca37bef5-70ed-409c-8569-deb3ed476d91 service nova] Creating event network-vif-plugged:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:11:31.400711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e3ec5406-39bd-4549-96f7-569880457a94 req-ca37bef5-70ed-409c-8569-deb3ed476d91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040792 Jul 30 21:11:31.401980 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1334/2784] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:31.685814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cac00660-a6f8-4009-8fa9-0071c3856497 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: .version_select at 0x7fbb5cefab80>, body: {"keypair": {"name": "tempest-keypair-1700715327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKaaaiLFaSA0Dbdz1LbrbreQ7ZvlQB7lmsEgtbEzpTYY2/ZFh+LZX4BYcgqJvontlGZr780abivgCNpTYwTZ+Py87b7gfdsJqOkoTzYrn7BcGwiqYRMdUlJctUiN8EWSg=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:31.704907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cac00660-a6f8-4009-8fa9-0071c3856497 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for project aef0a07428164b708be97eebe5547697. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:31.715085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-cac00660-a6f8-4009-8fa9-0071c3856497 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for user 8b930b074300497fa17ae36dc074c586 and project aef0a07428164b708be97eebe5547697. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:31.753332 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cac00660-a6f8-4009-8fa9-0071c3856497 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072889 Jul 30 21:11:31.755060 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1335/2785] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:11:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:11:31.875831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:31.876844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:31.897956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:31.898923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.900528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:31.901333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:31.945937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:31.967054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:31.969804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:31.977844 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c5b283f-c223-42da-b004-a8f11529bb2f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.702572 Jul 30 21:11:31.979657 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1451/2786] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:31 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:31.997243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:31.998217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:32.007806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.008507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.009477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.010076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.241318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:32.251844 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6128e05-cc61-4db7-b3f7-1a3b03f6a6bc tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.270789 Jul 30 21:11:32.253718 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1452/2787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:31 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:32.262092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:32.263022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:32.277138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.277891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.278922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.279550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.281356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:32.299870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02c4e9b9-a4f2-4b27-9c9c-50139a55ceaf tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.428354 Jul 30 21:11:32.303089 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1336/2788] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:31 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:32.308117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:32.320126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:32.333529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.334649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.335209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:32.337798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:32.558440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:32.577807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-78799540-5cad-42b8-88e2-2432d72d22db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1502 microversion: 2.1 time: 0.317120 Jul 30 21:11:32.592215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1453/2789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:32 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:32.647785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:32.657217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b48447e-048d-4b31-8c71-053b8471d38d tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.352406 Jul 30 21:11:32.658190 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1337/2790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:32 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:33.003613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:33.004751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:33.024564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.025032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.025819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.040743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.238569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:33.274333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:33.276805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:33.278115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ab223adf-4e9a-400a-b1b3-2e6eea5a67e3 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.278757 Jul 30 21:11:33.282204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:33.283455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:33.298283 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1454/2791] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:32 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:33.308689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.309160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.309962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.310411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.328935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:33.329688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:33.350317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.351570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.352585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.354070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.638974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:33.648288 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e92b8464-d375-4929-b328-5023a274c5b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1313 microversion: 2.1 time: 0.327925 Jul 30 21:11:33.649203 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1455/2792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:33 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:33.678858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:33.679693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:33.687468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.687468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.688665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:33.689172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:33.701754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:33.714326 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbaf1412-9815-44fd-9c1a-f14a9cd1c4de tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.434924 Jul 30 21:11:33.728699 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1338/2793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:33 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:34.115706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f81f5558-43b4-4c6a-a9ba-6e695e56d674"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:34.119882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:34.121494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:34.128035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.130042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:34.135262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.135762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:34.300388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:34.328721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:34.383635 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e69cdba-0cce-4e40-833b-ce9f218cdfce tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.704845 Jul 30 21:11:34.384280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1456/2794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:33 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:34.400737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:34.403095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:34.424012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.427378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:34.430577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.431420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:34.445506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:34.728912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5369044a-cbed-450b-a9c0-35d63226d752 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611449 Jul 30 21:11:34.728912 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1339/2795] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:11:34 2022] POST /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:34.752868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:34.758730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:34.777711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.778669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:34.793247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:34.795761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.140200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:35.163476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:35.165708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:35.169707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3d1202a-0a87-4263-bba9-f1ab1671a625 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.778648 Jul 30 21:11:35.170534 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1457/2796] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:34 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:35.180809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:35.184725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:35.209316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.209859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.215016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.215720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.430304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:35.461725 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-597bb6ba-575b-4143-ae83-bd4656657c4c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1463 microversion: 2.1 time: 0.736374 Jul 30 21:11:35.466377 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1340/2797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:34 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1463 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:35.481312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:35.486872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:35.514014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.514952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.517697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.519138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.815023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:35.831923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18657ca0-59d5-4bb0-9281-c4668aa74d01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.659159 Jul 30 21:11:35.835194 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1458/2798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:35 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:35.859320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:35.862141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:35.882828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.884745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:35.890422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:35.890422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:36.036118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:36.058634 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebf08223-e794-44e7-85ce-fe48aee25486 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.578933 Jul 30 21:11:36.086086 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1341/2799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:35 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:36.195348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:36.195614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:36.219249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:36.220468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:36.221461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:36.222671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:36.380525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff238055-9dd9-4cff-ad1b-1ec27fed9e1c tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1614 microversion: 2.1 time: 0.544366 Jul 30 21:11:36.381134 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1459/2800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:35 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1614 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:36.409141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:36.409744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:36.422844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:36.424083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:36.425295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:36.425941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:36.581595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '042c41b5f14d4a87979147530adccda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b34535abfb4f5d86e5091998a6823b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:36.582134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: be732443-5139-4e34-8f54-6072d2b0072b] flavor_id is None. Assuming migration. {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 30 21:11:36.583172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:11:36.753271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:36.770841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:36.776651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:36.779609 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31d634dd-b2b6-46b4-a962-2c5e78bdf6cf tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.589558 Jul 30 21:11:36.782627 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1342/2801] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:36 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:36.792798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-613620501", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "017caf28-79cd-4ffa-9be8-ca1d78ee7a8b"}], "security_groups": [{"name": "tempest-securitygroup--2143408650"}], "key_name": "tempest-keypair-1700715327", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:37.073856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] validate_networks() for [('017caf28-79cd-4ffa-9be8-ca1d78ee7a8b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:37.548655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c935ec8b-1497-4760-9904-6337816ba654 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b/action" status: 202 len: 0 microversion: 2.1 time: 1.145322 Jul 30 21:11:37.551373 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1460/2802] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:36 2022] POST /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b/action => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:11:37.564046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:37.565921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:37.593491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:37.597030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:37.605710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:37.606468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:37.949451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:37.951445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:37.952326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:37.953063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:37.954600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:37.962159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:37.970190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:37.971129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:37.972476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:37.973882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:37.978859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15fa4084-6f6b-4181-bab4-fe94aacd0508 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.424441 Jul 30 21:11:37.980885 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1461/2803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:37 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:37.992734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:37.996439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:37.999600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:38.007245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Getting quotas for user 8b930b074300497fa17ae36dc074c586 and project aef0a07428164b708be97eebe5547697. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:38.010334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.013818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.014745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.015215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.026306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:38.029980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:38.110178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eac92495-d6e7-4551-9b41-21a2367a6a9e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.325180 Jul 30 21:11:38.119132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1343/2804] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:38.125237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:38.126742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:38.137923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.140818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.140818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.146201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.463018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.475752 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ed0c81a-ad78-4c90-9356-0b9df9ceb3b7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.352795 Jul 30 21:11:38.477195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1344/2805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:38 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:38.490922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:38.492048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:38.508827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.512664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.514750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:38.516602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:38.524620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.552928 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b4c6da4c-06d4-4574-b86d-59fbb227317f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.569707 Jul 30 21:11:38.554859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1462/2806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:37 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:38.569682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-445df6bd-39ab-4ea7-8966-c5c9c1ce0e35 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:38.570633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-445df6bd-39ab-4ea7-8966-c5c9c1ce0e35 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:38.710771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-445df6bd-39ab-4ea7-8966-c5c9c1ce0e35 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.728401 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-445df6bd-39ab-4ea7-8966-c5c9c1ce0e35 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1245 microversion: 2.1 time: 0.172113 Jul 30 21:11:38.745252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1463/2807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:38 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1245 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:38.845170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.857630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.859864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:38.865407 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-133f1dbc-85a9-40e5-ba63-09c41f9cc347 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.385231 Jul 30 21:11:38.868462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1345/2808] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:38 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:39.039435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:39.050513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:39.106906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.113420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:39.116572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.119463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:39.502989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:39.503874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:39.521005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.525417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:39.528557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.530205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:39.922257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:39.938033 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3f771323-fb0e-4254-ac03-9117745091ef tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.934869 Jul 30 21:11:39.942650 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1464/2809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:39 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:39.966910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:39.967831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:39.983080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.984039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:39.987664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:39.988528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.024177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:40.038656 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf267b20-0aa6-4d49-a1cb-2b61312dd947 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.543762 Jul 30 21:11:40.049805 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1346/2810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:39 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:40.072829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:40.075800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:40.100724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.101431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.104267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.105099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.289777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:40.315450 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b95dceb-a481-4ac2-9cfa-33929a7820f8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1297 microversion: 2.1 time: 0.259646 Jul 30 21:11:40.317533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1347/2811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:40 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1297 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:40.333942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:40.336737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:40.371157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.371852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.372960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.373460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.452660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:11:40.535183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:40.544330 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57191ffd-05c3-49c0-9a3f-463729f0265b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.597589 Jul 30 21:11:40.553016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1465/2812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:39 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:40.560260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:40.562977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:40.575082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.577076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.579149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.580638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.695837 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd883313-816e-4a61-8bce-db5fba699531 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 204 len: 0 microversion: 2.1 time: 0.375533 Jul 30 21:11:40.706890 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1348/2813] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:40 2022] DELETE /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:11:40.728596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:40.732680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:40.752167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.752821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:40.753665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:40.755740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.107554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.134184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.135995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.137286 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0a088bd-f6c6-45e9-b18b-52770e5067ec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.582900 Jul 30 21:11:41.138090 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1466/2814] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:40 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:41.155657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.169174 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c50bdce-7458-47c6-82d5-91fd8837d827 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1554 microversion: 2.1 time: 0.450478 Jul 30 21:11:41.169827 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1349/2815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:40 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1554 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:41.179967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:41.179967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:41.180580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:41.180580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:41.193807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.202045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.203013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.203519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.218631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.219104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.219952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.220471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.584593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.612055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fd967b3-6a78-44f0-b0ed-41efb7c4093c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.426302 Jul 30 21:11:41.627797 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1350/2816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:41 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:41.640667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:41.641794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:41.649795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.650705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.652634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.653557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.797741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:41.813176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed4b9418-ce6d-4017-b725-3b0a4dedb8f9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1305 microversion: 2.1 time: 0.183338 Jul 30 21:11:41.821219 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1351/2817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:41 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1305 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:41.829262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:41.830771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:41.853899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.854853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:41.857523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:41.858120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.032641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.052944 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75fa93be-572f-4c94-b673-6572f51e4d08 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1520 microversion: 2.1 time: 0.883122 Jul 30 21:11:42.053588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1467/2818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:41 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1520 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:42.114664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.124857 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f83e0460-2f12-424e-989d-eb2ca3b0bfb1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.302268 Jul 30 21:11:42.125897 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1352/2819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:41 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:42.164989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:42.166317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:42.176287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.178414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.179974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.180913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.196902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:42.200458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:42.225978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.228763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.235333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.235333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.540108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.553327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b93562f7-a602-4d2b-99fb-ba0b64d934a2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1554 microversion: 2.1 time: 0.363081 Jul 30 21:11:42.554074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1353/2820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:42 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1554 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:42.569227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.582699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.585987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:42.587408 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16f5eca5-e06a-4a78-ade5-addf5600c36b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.427636 Jul 30 21:11:42.608470 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1468/2821] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:42 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:11:42.640466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:42.641399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:42.667861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.668393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.673617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:42.674706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:42.881034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1296175664", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ec23a4a5-aac1-4d5c-a634-33223559f0f5"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:42.984864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] validate_networks() for [('ec23a4a5-aac1-4d5c-a634-33223559f0f5', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:43.023399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:43.040639 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e00f836-df18-4f42-a7f7-7d24b58a3183 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.405689 Jul 30 21:11:43.041247 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1469/2822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:42 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:43.069112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:43.070228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:43.083812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.087539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.088563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.089053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.238114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:43.246904 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44a1a52a-bc81-4b60-8b6d-b9621a35ce0f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1305 microversion: 2.1 time: 0.204360 Jul 30 21:11:43.252049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1470/2823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:43 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:43.268546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:43.269333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:43.282252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.282983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.284079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.285321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.611557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:43.629942 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0274b2f1-f06f-4a92-95b8-8b454b0467b3 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1497 microversion: 2.1 time: 0.376624 Jul 30 21:11:43.635848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1471/2824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:43 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:43.653803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:43.654846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:43.671021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.671902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.676562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.677370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.683792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:43.684262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:43.684757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:43.685519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:43.686011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:43.713058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.713672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.722680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.727057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.738943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:43.778129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Getting quotas for project b6c50d273347476986fe5cff264295c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:43.799420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Getting quotas for user d9d75013f5714db097bb2975b57d5328 and project b6c50d273347476986fe5cff264295c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:43.837625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:43.842239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:43.941184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09bea960-2bf4-4b8c-a35e-1ef59c46f17c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338543 Jul 30 21:11:43.942407 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1354/2825] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:43.960835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:43.968857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:43.987103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.990004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:43.990004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:43.993629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.148273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.163117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6234585-d355-437c-8908-7824c859d172 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.523026 Jul 30 21:11:44.173033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.179332 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1472/2826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:43 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:44.185854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:44.186445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1cafccb3-d83e-4e56-95f7-d64cdd960055 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 200 len: 1346 microversion: 2.1 time: 0.242615 Jul 30 21:11:44.186588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:44.196308 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1355/2827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:43 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 1346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:44.213536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.214010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.216514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:44.217117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.217620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.231558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:44.256258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.258766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:44.288963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.293020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.299527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.300458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.361713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:44.440193 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7614c6d1-1e3e-48c3-bdcd-335f7653772d tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.240033 Jul 30 21:11:44.443236 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1356/2828] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 30 21:11:44 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:44.460778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-38e9364a-75a5-4f96-af24-1831961072c7 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:44.463838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-38e9364a-75a5-4f96-af24-1831961072c7 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:44.541638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.555331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.558463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.560061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c80b0396-c5f2-486c-b738-9df721839846 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.378704 Jul 30 21:11:44.560935 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1473/2829] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:44 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:44.566503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-916d2dd5-b071-46e1-9269-97daeced0775 req-86ad4c5f-1864-47a9-8946-fcc29a727a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f329f20-3dfe-4874-8c91-5ec9e9fe36a6", "name": "network-vif-deleted", "tag": "5b554dfd-1200-4642-8537-7ec6f9dbf7b7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:44.583428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-38e9364a-75a5-4f96-af24-1831961072c7 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.592864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-38e9364a-75a5-4f96-af24-1831961072c7 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1224 microversion: 2.1 time: 0.144860 Jul 30 21:11:44.604064 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1357/2830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:44 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:44.609859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-916d2dd5-b071-46e1-9269-97daeced0775 req-86ad4c5f-1864-47a9-8946-fcc29a727a46 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.611921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-916d2dd5-b071-46e1-9269-97daeced0775 req-86ad4c5f-1864-47a9-8946-fcc29a727a46 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.617329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:44.620717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:44.628789 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-916d2dd5-b071-46e1-9269-97daeced0775 req-86ad4c5f-1864-47a9-8946-fcc29a727a46 service nova] Creating event network-vif-deleted:5b554dfd-1200-4642-8537-7ec6f9dbf7b7 for instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 on nch2-master-1 Jul 30 21:11:44.630981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.631578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.632394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.637286 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-916d2dd5-b071-46e1-9269-97daeced0775 req-86ad4c5f-1864-47a9-8946-fcc29a727a46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073674 Jul 30 21:11:44.639382 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1474/2831] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:44.642979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.660979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:44.667238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:44.686779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.688768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.690097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.692312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.907976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.918929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:44.919106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbf309a7-0a5f-4236-aeec-1da25c4f992f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.313645 Jul 30 21:11:44.919695 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1358/2832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:44 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:44.924942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe6a048b-feac-4c33-978b-4ac82dea15c9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:44.931805 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea43b843-2958-4105-97b0-c8719cea9d72 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1305 microversion: 2.1 time: 0.290348 Jul 30 21:11:44.932141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a048b-feac-4c33-978b-4ac82dea15c9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:44.932841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a048b-feac-4c33-978b-4ac82dea15c9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:44.933421 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1475/2833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:44 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1305 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:44.977486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe6a048b-feac-4c33-978b-4ac82dea15c9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Going to try to start instance {{(pid=130983) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:11:45.042917 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe6a048b-feac-4c33-978b-4ac82dea15c9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "POST /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe/action" status: 202 len: 0 microversion: 2.1 time: 0.121347 Jul 30 21:11:45.044106 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1359/2834] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:11:44 2022] POST /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:11:45.053777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.054702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.070114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.070352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.074059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.075319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.190800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.192543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.213484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.216874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.221031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.221565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.552759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.569818 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed2ff58d-aa16-4067-841f-1426fb567bb5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.385972 Jul 30 21:11:45.589916 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1360/2835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:45.595010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.595667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.616949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.616949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.616949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.616949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.652843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 HTTP/1.1 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7f329f20-3dfe-4874-8c91-5ec9e9fe36a6'} Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:45.654600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56cdff93-8b02-45e0-b826-992df3549b26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 404 len: 111 microversion: 2.1 time: 0.065074 Jul 30 21:11:45.659061 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1361/2836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:45.667092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.668346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.693347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.694443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.695549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.696237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.696826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.716717 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15ab10c7-53dc-4634-be8d-8b20bff5cc95 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1506 microversion: 2.1 time: 0.667022 Jul 30 21:11:45.719427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1476/2837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:45.729287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.734122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.749836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.750317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.751175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.751849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.864180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.875718 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0aca1162-39fb-43d8-865f-ec9d0d217b3f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1276 microversion: 2.1 time: 0.155063 Jul 30 21:11:45.890241 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1477/2838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:45.895723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.898176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.904435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:45.906076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.906834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.907838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.910021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.944702 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6/os-volume_attachments HTTP/1.1 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': '7f329f20-3dfe-4874-8c91-5ec9e9fe36a6'} Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:45.946815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:11:45.950510 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:45.954206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:45.955524 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a16f04f-433b-4ea9-b9b2-28eb46dcfb91 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064019 Jul 30 21:11:45.956349 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1478/2839] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:45.961329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.962697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:45.963471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:45.970574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.971660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.973582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:45.974096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:45.975590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.982011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:45.984732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5e5ef9f-8ae2-4d21-a785-8173480969c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.326915 Jul 30 21:11:45.987933 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1362/2840] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:46.000874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:46.004117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:46.017976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:46.020351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:46.021496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:46.023877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:46.212329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:46.229806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d329157-97f6-4677-a845-d921b2b6c67c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1305 microversion: 2.1 time: 0.239467 Jul 30 21:11:46.231427 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1363/2841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:46.418805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-187625345", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:46.546323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:46.745989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:46.760061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60e49dc5-3d71-4923-9d53-56e14ed181ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.802445 Jul 30 21:11:46.760834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1479/2842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:45 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:46.767977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:46.768613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:46.789617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:46.790705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:46.793104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:46.793798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.158453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:47.174248 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26c69e58-875c-4afb-b963-4bed3067b959 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.410776 Jul 30 21:11:47.175813 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1480/2843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:46 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:47.187145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:47.189023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:47.212368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.212850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.213836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.214365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.508288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:47.509438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:47.509993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:47.510409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:47.511009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:47.526489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.527755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.528914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.529535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.553417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:47.574437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b4163924-f499-4768-86d9-774ca6318ec9 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1506 microversion: 2.1 time: 0.397178 Jul 30 21:11:47.575127 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1481/2844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:47 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:47.575127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:47.575127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:47.591945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.592816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.593645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.594104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.607866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:47.618142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:47.634647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:47.637400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:47.651931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:47.762335 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d762db3b-2ac6-45ff-9f68-939735668dd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347682 Jul 30 21:11:47.787752 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1364/2845] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:11:47.794713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:47.811714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:47.817908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:47.833482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29e30067-ecd1-4862-8315-65fe60ce7485 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1282 microversion: 2.1 time: 0.253108 Jul 30 21:11:47.834350 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1482/2846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:47 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:47.845975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.846453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.847258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.847779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.871614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:47.873641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:47.883277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.884151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:47.885455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:47.886446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.023144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.031901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80cbd5b6-1f4d-41ef-8acd-7a58a33090b0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1305 microversion: 2.1 time: 0.195803 Jul 30 21:11:48.032899 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1483/2847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:47 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1305 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:48.038958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.039579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.046011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.046496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.047427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.048007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.140950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.153333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.154861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.156389 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ffffac61-a319-4d2c-b08f-b18ac9559a71 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.367108 Jul 30 21:11:48.160041 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1365/2848] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:47 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:48.165269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67e33a1e-8597-45d4-ae70-4d220a478909 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.165888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67e33a1e-8597-45d4-ae70-4d220a478909 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.246596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.257191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d9b503a-c06c-4265-9d49-191833bbbe8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.222829 Jul 30 21:11:48.258129 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1484/2849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:48 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:48.263086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.263962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.270892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.271395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.272473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.272944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.280471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67e33a1e-8597-45d4-ae70-4d220a478909 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.308176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67e33a1e-8597-45d4-ae70-4d220a478909 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a" status: 200 len: 1214 microversion: 2.1 time: 0.146461 Jul 30 21:11:48.313959 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1366/2850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:48 2022] GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:48.341012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d230f092-78e9-4bc4-8322-cba6399903ea tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.341950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d230f092-78e9-4bc4-8322-cba6399903ea tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.367806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d230f092-78e9-4bc4-8322-cba6399903ea tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:11:48.623789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:48.636528 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-04c11a6b-e0c6-40da-bba4-4489c82350d6 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1507 microversion: 2.1 time: 0.377049 Jul 30 21:11:48.641746 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1485/2851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:48 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:48.676252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.682470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.703405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.705225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.711644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.712272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.772079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:48.913870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.scheduler.client.report [None req-d230f092-78e9-4bc4-8322-cba6399903ea tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Deleted allocations for instance 1995038e-9833-4bc9-8b5f-b63cca34a74a Jul 30 21:11:48.937121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d230f092-78e9-4bc4-8322-cba6399903ea tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a" status: 204 len: 0 microversion: 2.1 time: 0.600839 Jul 30 21:11:48.938384 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1367/2852] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:48 2022] DELETE /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:11:48.946073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:48.947140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:48.955111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.956031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:48.957665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:48.958367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.002574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.014765 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35e6bf7b-4f2e-4bac-98b4-4b7996f3a93a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1510 microversion: 2.1 time: 0.371153 Jul 30 21:11:49.015490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1486/2853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:48 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:49.026106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.026963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.034003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.034551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.035504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.036023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.054286 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a HTTP/1.1 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1995038e-9833-4bc9-8b5f-b63cca34a74a'} Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:11:49.055892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:11:49.060545 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:11:49.061684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:11:49.062549 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1fab80db-a35c-4686-82a1-23cf05d76f02 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a" status: 404 len: 111 microversion: 2.1 time: 0.045970 Jul 30 21:11:49.063434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1487/2854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:11:49.069915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.076430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.076898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.servers [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Removing options 'limit' from query {{(pid=130984) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 30 21:11:49.077819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:49.079761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.080368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.081317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.081870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.083568 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a517f9e-2df9-4528-9a95-fc81991e184b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018957 Jul 30 21:11:49.084656 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1488/2855] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:11:49.090176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.090990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.099093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.099594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.100389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.100838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.164944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.172606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-752bfe0a-cc0d-49b2-91c4-4af11ecb0c23 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1303 microversion: 2.1 time: 0.086825 Jul 30 21:11:49.173186 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1489/2856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:49.178348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.178970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.184893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.185530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.186470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.187071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.195371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.203102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1986a8e3-52df-452a-8481-09f2d3a52b77 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.263157 Jul 30 21:11:49.203712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1368/2857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:48 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:49.217816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-357076699", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:49.277875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:49.337750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.345677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92a925a4-76f1-4e1f-be08-af0c0735b232 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1510 microversion: 2.1 time: 0.171378 Jul 30 21:11:49.355507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1490/2858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:49.355507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.355507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.357450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.357912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.358684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.359130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.506479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.516047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.517862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.519060 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d232ffa-0d13-4f04-aa9e-9102ce9841ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.171842 Jul 30 21:11:49.519717 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1491/2859] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:49.524228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.525054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.531396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.532079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.533055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.533520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.670872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.673338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:49.681099 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-972cad43-2897-4e77-905f-41ed2f7504a2 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.160352 Jul 30 21:11:49.681821 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1492/2860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:49.686788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:49.687434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:49.694710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.695201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.696015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:49.696463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:49.978935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:49.989020 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8fff170-1e81-4e50-89fa-f8d15e1dd4e5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1511 microversion: 2.1 time: 0.304959 Jul 30 21:11:49.994258 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1493/2861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.010112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.011580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.021250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.021796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.022759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.023222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.221059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:50.221551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:50.222357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:50.222850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:50.223562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:50.234920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.235543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.236551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.237099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.258696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:50.264784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:50.278739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:50.282674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:50.357520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:50.364381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d678f24-659b-4e57-9190-ce964af5b790 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158405 Jul 30 21:11:50.370577 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1369/2862] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:50.371593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c2dff49c-3e02-4348-a297-3bd6d18d0fdd req-03b9c580-8245-4625-8ca3-7a769f39e9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:50.384677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c2dff49c-3e02-4348-a297-3bd6d18d0fdd req-03b9c580-8245-4625-8ca3-7a769f39e9d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.385150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c2dff49c-3e02-4348-a297-3bd6d18d0fdd req-03b9c580-8245-4625-8ca3-7a769f39e9d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.396948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c2dff49c-3e02-4348-a297-3bd6d18d0fdd req-03b9c580-8245-4625-8ca3-7a769f39e9d6 service nova] Creating event network-changed:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:11:50.397280 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4922cd2e-581a-4ee0-9a39-8bcc699e41e4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1487 microversion: 2.1 time: 0.391515 Jul 30 21:11:50.398571 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1494/2863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:49 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1487 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.410112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.411730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.413982 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c2dff49c-3e02-4348-a297-3bd6d18d0fdd req-03b9c580-8245-4625-8ca3-7a769f39e9d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046706 Jul 30 21:11:50.414924 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1370/2864] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:50.422092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.423685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.437367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.437562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.437967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.439220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.439389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.439758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.440092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.440558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.588474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:50.599501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d8481490-087e-4abd-a8f2-386cae648410 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1303 microversion: 2.1 time: 0.182542 Jul 30 21:11:50.603714 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1371/2865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:50 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.615875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.620775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.648321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.648718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.649519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.649973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.791326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:50.808277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05fd50af-36a2-4d0e-ad78-084d649216ba tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1511 microversion: 2.1 time: 0.406925 Jul 30 21:11:50.812647 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1495/2866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:50 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.818130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2c93809b-b26a-4443-b7e3-c06d9d4f2af9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.819486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c93809b-b26a-4443-b7e3-c06d9d4f2af9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.822348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:50.831754 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a731f67-2d83-45aa-923e-07ddd9fceb4a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.225871 Jul 30 21:11:50.832880 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1372/2867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:50 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.838744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:50.839792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:50.846010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.846486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.847274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:50.847792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:50.909460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2c93809b-b26a-4443-b7e3-c06d9d4f2af9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:50.916661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2c93809b-b26a-4443-b7e3-c06d9d4f2af9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1214 microversion: 2.1 time: 0.105627 Jul 30 21:11:50.917829 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1496/2868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:50 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:50.924497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1200581734", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:51.001143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] validate_networks() for [('4e321294-3616-467d-afa5-c47966933a44', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:11:51.042529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.054199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.055603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.056791 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c1403b8e-e834-46cc-9cfb-b768ed753e40 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.222539 Jul 30 21:11:51.063353 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1373/2869] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:50 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:51.063990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.064279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:51.072093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.072709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.073508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.073964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.208288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.216038 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b6b4443c-8a78-43b2-b780-201b433ca2c5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1472 microversion: 2.1 time: 0.157065 Jul 30 21:11:51.216622 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1374/2870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:51.221190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.226619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.227503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:51.337471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.338382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.339269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.339941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.434481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:51.449947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:51.497285 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1476c9ef-c226-4390-9e9c-a9f019821b0a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.279580 Jul 30 21:11:51.497886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1375/2871] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:51.510202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.510831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:51.518402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.518867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.520209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.520662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.562585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:11:51.563070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:11:51.563855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:11:51.564455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:11:51.564989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:11:51.575113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.575740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.576779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.577246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.606771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Getting quotas for project 7e9653a81a694ec29d1fcfe2da97eaa3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:11:51.614236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Getting quotas for user 36fe4dfa0f564eedb8deb3491a5068a5 and project 7e9653a81a694ec29d1fcfe2da97eaa3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:11:51.630638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:11:51.633489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:11:51.687623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.698912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d73427f-7c04-4e95-8bad-d5490f43c226 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.778837 Jul 30 21:11:51.699870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e48c17e6-fa5a-4519-aff2-410741a82c07 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1510 microversion: 2.1 time: 0.192696 Jul 30 21:11:51.701142 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1376/2872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:51.705889 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1497/2873] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:11:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:11:51.709999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.710953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:51.712193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45ac29cc-0c7b-464b-a50d-1f1e02afe351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.712833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45ac29cc-0c7b-464b-a50d-1f1e02afe351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:51.720354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.721143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.722814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:51.723481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:51.952840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:51.969835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e3d5be3-5870-4f10-ab22-7cba64406968 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.267366 Jul 30 21:11:51.972391 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1377/2874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:51.980684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:51.981401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.008881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.009769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.011130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.015860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.166546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45ac29cc-0c7b-464b-a50d-1f1e02afe351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.177553 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45ac29cc-0c7b-464b-a50d-1f1e02afe351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1214 microversion: 2.1 time: 0.466798 Jul 30 21:11:52.178734 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1498/2875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1214 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.189820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.190670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.205121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.205852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.207005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.207643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.325457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.347716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b1ddfed-7b13-4ea6-94b7-52695ed13a26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1511 microversion: 2.1 time: 0.371383 Jul 30 21:11:52.358678 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1378/2876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:51 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.364728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.365438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.372320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.373764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.374563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.375069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.447479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.456121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7bae31b2-14fc-40f8-a340-95397aafd6d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1266 microversion: 2.1 time: 0.096977 Jul 30 21:11:52.456716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1379/2877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.461613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.462237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.468527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.469239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.470222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.470878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.471254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.482917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-757a916c-4f0e-4282-8108-a4b170cb0c9f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.302354 Jul 30 21:11:52.483548 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1499/2878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.491429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.492057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.499318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.499811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.500709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.501973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.715572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.727480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.729540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.731715 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48827122-a674-4210-be2f-912e9610b507 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.273989 Jul 30 21:11:52.732759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1380/2879] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:52.736996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.739623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.740618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:52.748776 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa378de7-660b-4136-bc1b-1ea07bb9a70e tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.263309 Jul 30 21:11:52.748973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.749380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1500/2880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.765284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.766139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:52.767427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:52.971940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:52.981666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fac55767-4644-45d6-8aff-cdf47e183737 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1511 microversion: 2.1 time: 0.247563 Jul 30 21:11:52.982356 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1381/2881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:52.997204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:52.998968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:53.004857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.010509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.011384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.011739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.012539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:53.013398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.014087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.018764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.020265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.021643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.022237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.077240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:53.150751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.158265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.158731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.373898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.382430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e3a1555-f16c-49cc-9748-aea663b7ae0b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.390543 Jul 30 21:11:53.390595 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7525bea8-5422-4d61-9f74-8958f9881ff2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.391788 Jul 30 21:11:53.392001 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1382/2882] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:53.403613 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1501/2883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:52 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:53.415488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-366f4168-fdbf-4db6-b386-d567a84657a3 req-274d5a7f-1056-47a9-b095-55e9a4bdbb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:53.419325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.420269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:53.430292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-366f4168-fdbf-4db6-b386-d567a84657a3 req-274d5a7f-1056-47a9-b095-55e9a4bdbb2a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.430292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-366f4168-fdbf-4db6-b386-d567a84657a3 req-274d5a7f-1056-47a9-b095-55e9a4bdbb2a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.431982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.433326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.434376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.435188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.450836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-366f4168-fdbf-4db6-b386-d567a84657a3 req-274d5a7f-1056-47a9-b095-55e9a4bdbb2a service nova] Creating event network-changed:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:11:53.456354 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-366f4168-fdbf-4db6-b386-d567a84657a3 req-274d5a7f-1056-47a9-b095-55e9a4bdbb2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058461 Jul 30 21:11:53.457426 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1502/2884] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:53.463823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.469387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.470447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:53.524716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.537202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7265ad71-5f93-4186-aae8-fab68bdc1351 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1274 microversion: 2.1 time: 0.131813 Jul 30 21:11:53.537799 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1383/2885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:53.557207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.558131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:53.567417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.568134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.569114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.569872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.648860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.659164 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce9a9127-7270-469a-a0df-5bdbe5be8787 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1272 microversion: 2.1 time: 0.116802 Jul 30 21:11:53.661200 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1384/2886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:53.665918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.666537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:53.673849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.674337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.675514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.676287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.820759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.821385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.822599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.823269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.827523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:53.836850 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c9e256f-b16e-4cd2-be05-c1566faf3513 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.173876 Jul 30 21:11:53.837814 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1385/2887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:53.843839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:53.844465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:53.851413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.851879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.853307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:53.853774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:53.920619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:53.987242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe1a408c-bee9-4bfd-a115-3922d5a84bd2 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.528050 Jul 30 21:11:53.991578 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1503/2888] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.008021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.010408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:54.024100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.024651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.026068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.026739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.045292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.055226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.056786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.058011 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f306fb32-e02c-4075-ab94-3560d4873900 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.219076 Jul 30 21:11:54.071767 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1386/2889] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:54.080297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.086456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.087173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:54.092952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.093410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.094228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.094729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.187812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:54.493086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51c99a13-699b-4ad3-aa48-84a3179a24fa tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.419986 Jul 30 21:11:54.494087 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1387/2890] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.498382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.498950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:54.504428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.506219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.506685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.507500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.507948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.518968 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d15a6841-19a5-4807-becc-16f646396226 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.525445 Jul 30 21:11:54.521538 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1504/2891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:53 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.527125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.533812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.534505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:54.541452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.555562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.556864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.557563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.684558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:54.687351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.699390 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-170c8864-b001-4855-bdf5-d465103cb559 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.204585 Jul 30 21:11:54.700229 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1388/2892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.728642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.729625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:54.736480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.737612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.739195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.739708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.769522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac5e46ad-912f-4bae-aa9e-b21a7f4a24ca tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.246350 Jul 30 21:11:54.777263 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1505/2893] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.783572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.784328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:54.793248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.793721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.795439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.795918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.835250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.848538 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-45e5e5f1-f63e-410a-b139-2f45010a46c1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1272 microversion: 2.1 time: 0.133143 Jul 30 21:11:54.850202 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1389/2894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:54.856275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:54.862611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:54.864720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': '-878208814', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:54.871423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.872355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:54.873507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:54.874762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.014283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:55.084051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:55.103864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3f568aa-6b43-4243-98e4-808e76c2ae2c tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-878208814" status: 200 len: 345 microversion: 2.1 time: 0.252286 Jul 30 21:11:55.104720 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1390/2895] 10.222.0.17 () {58 vars in 1156 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers?name=-878208814 => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:55.109736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.110499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:55.117574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.118223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.119139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.120079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.278472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.280029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.288148 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb31870f-713b-40ca-bfa7-48a8f5384257 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.182279 Jul 30 21:11:55.302003 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1391/2896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:55.308864 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4724755b-4937-46b0-a862-408f5baa1547 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.529289 Jul 30 21:11:55.311044 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1506/2897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:54 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:55.313145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.313836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:55.320934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.321408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.322606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.323793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.327717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.335606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.336646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:55.344069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.344856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.346208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.346933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.484707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:55.541544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.560328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.561901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.563106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2a00eb2-c7af-4f8c-8c7d-61c11c503c3e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.272387 Jul 30 21:11:55.563910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1392/2898] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:55.569136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.569757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:55.577127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.577596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.578395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.578846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.591868 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27b11d32-10cc-4e59-a03a-beb539059438 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.276823 Jul 30 21:11:55.600201 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1507/2899] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:55.605150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.610734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.611860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-87820881', 'deleted': False, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:11:55.619630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.620043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.621466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.621730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.752583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:55.760524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:11:55.764803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7338145-98df-4210-98d9-8d1fdd26a10f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.200011 Jul 30 21:11:55.765571 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1393/2900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:55.786284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-90d02e53-cd00-4e7a-8223-f32e36ddda17 req-ab727270-4f1c-4e5d-9a17-25c4e0b02282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "name": "network-vif-plugged", "status": "completed", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:55.797227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90d02e53-cd00-4e7a-8223-f32e36ddda17 req-ab727270-4f1c-4e5d-9a17-25c4e0b02282 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.797612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90d02e53-cd00-4e7a-8223-f32e36ddda17 req-ab727270-4f1c-4e5d-9a17-25c4e0b02282 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.811891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-90d02e53-cd00-4e7a-8223-f32e36ddda17 req-ab727270-4f1c-4e5d-9a17-25c4e0b02282 service nova] Creating event network-vif-plugged:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:11:55.823271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-90d02e53-cd00-4e7a-8223-f32e36ddda17 req-ab727270-4f1c-4e5d-9a17-25c4e0b02282 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041741 Jul 30 21:11:55.823961 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1394/2901] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:55.830039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.830763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:55.850672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.851331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.852706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.853022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.867131 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c0ddea5-1d22-4e2f-9f9e-b5e1bab95846 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87820881" status: 200 len: 345 microversion: 2.1 time: 0.265699 Jul 30 21:11:55.877232 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1508/2902] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87820881 => generated 345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:55.883003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:55.887149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:55.903499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.907594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:55.908045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:55.908845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.058629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:56.068982 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-009c46ae-2fc7-43da-86f0-a6f9f754e013 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.243492 Jul 30 21:11:56.070313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1395/2903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:56.080874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.081836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.090946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.092067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.092930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.093640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.129749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:11:56.206496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:56.218706 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8dc166f-b4b4-4bdf-a5cd-a758faebc0f5 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 204 len: 0 microversion: 2.1 time: 0.146698 Jul 30 21:11:56.220505 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1396/2904] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:11:56 2022] DELETE /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:11:56.229259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.230184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.240127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.240590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.241398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.241850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.385468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:56.394059 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67642b36-f8c1-46bb-a4bd-abf2e60863ff tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1517 microversion: 2.1 time: 0.169690 Jul 30 21:11:56.394708 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1397/2905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:56 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:11:56.413308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.413938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.420281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.420747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.421538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.421988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.565549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:56.574658 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-697b64d3-1d8b-4c61-bab2-a4ecf23398e8 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.165678 Jul 30 21:11:56.575281 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1398/2906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:56 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:56.580220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.582292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.589258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.589738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.590583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.591058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.672364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:56.684179 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5e690c1-dd18-4f17-a6a2-61f74cd2be28 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.806712 Jul 30 21:11:56.685397 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1509/2907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:55 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:56.692852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.693687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.700666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.701838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.702792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.703431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.758144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:56.767989 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b0eeca0-72c2-491f-aed9-db1f8088edda tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.191525 Jul 30 21:11:56.769093 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1399/2908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:56 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:56.774579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2999195f-bcf1-4814-b42a-3c38501c05ce req-5a01c6a1-7200-43cd-b765-4539e37cd14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc48a8b-9966-4fac-91a0-8ad341a31b96", "tag": "7eda5990-db51-4f03-872a-a1874b53ce72"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:56.787097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2999195f-bcf1-4814-b42a-3c38501c05ce req-5a01c6a1-7200-43cd-b765-4539e37cd14f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.788063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2999195f-bcf1-4814-b42a-3c38501c05ce req-5a01c6a1-7200-43cd-b765-4539e37cd14f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.800418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2999195f-bcf1-4814-b42a-3c38501c05ce req-5a01c6a1-7200-43cd-b765-4539e37cd14f service nova] Creating event network-changed:7eda5990-db51-4f03-872a-a1874b53ce72 for instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 on nch2-master-1 Jul 30 21:11:56.806027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2999195f-bcf1-4814-b42a-3c38501c05ce req-5a01c6a1-7200-43cd-b765-4539e37cd14f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034971 Jul 30 21:11:56.806648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1400/2909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:56.812052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:56.812792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:56.819422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.819946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:56.820793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:56.821244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.008618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.017290 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03715523-d600-48a9-9565-01636bd088be tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.209219 Jul 30 21:11:57.018096 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1401/2910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:56 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:57.089215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.104862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.105090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:57.105933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:57.111980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.114788 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16b11e63-7c49-42ea-811c-f4fff5e70bd8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.428230 Jul 30 21:11:57.116270 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1510/2911] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:56 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:57.118810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.119604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.120608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.121201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.293351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.304032 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8fb8b0b-6580-4811-b109-08bd56d1db39 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.208681 Jul 30 21:11:57.305136 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1402/2912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:57 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:57.417667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:57.418331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:57.427316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.428820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.430032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.430524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.462952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:57.598378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:57.599007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:57.608144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.608928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.609929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.610339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.787490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.798351 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4a6fb4f-47d0-41fd-844d-32df0f27ab1c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.204764 Jul 30 21:11:57.799376 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1403/2913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:57 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:57.804829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:57.806086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:57.812393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.812957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.813813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.814273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.860373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:57.872437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20c32c68-cbbc-49eb-b393-4fa6adf46f8b tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1517 microversion: 2.1 time: 0.459711 Jul 30 21:11:57.873208 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1511/2914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:57 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:57.880240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:57.881109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:57.896326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.896712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.897763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:57.898271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:57.988011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.011376 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-895f3b3b-6fbb-4ccb-b97b-bb7c8d0f5346 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.204520 Jul 30 21:11:58.026666 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1404/2915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:57 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:58.032536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6dab1afe-79ec-4afb-8774-219ee1380d75 req-d3cb6e2e-779a-4838-ae46-9718c5ba95a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "name": "network-vif-plugged", "status": "completed", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:58.043825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6dab1afe-79ec-4afb-8774-219ee1380d75 req-d3cb6e2e-779a-4838-ae46-9718c5ba95a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.044297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6dab1afe-79ec-4afb-8774-219ee1380d75 req-d3cb6e2e-779a-4838-ae46-9718c5ba95a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.059374 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6dab1afe-79ec-4afb-8774-219ee1380d75 req-d3cb6e2e-779a-4838-ae46-9718c5ba95a5 service nova] Creating event network-vif-plugged:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:11:58.065236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6dab1afe-79ec-4afb-8774-219ee1380d75 req-d3cb6e2e-779a-4838-ae46-9718c5ba95a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036729 Jul 30 21:11:58.066572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1405/2916] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:58.073042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:58.074311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:58.081614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.083022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.083954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.084454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.164419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.173157 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be7e105f-2661-413a-baaf-6de7a37245f6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.298068 Jul 30 21:11:58.174173 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1512/2917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:57 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:58.178680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:58.179331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:58.186951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.186951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.186951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.187385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.253330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.263013 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90ccfbf3-a8f3-49ec-9411-0617f945a9ab tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.194708 Jul 30 21:11:58.263725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1406/2918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:58 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:58.327569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:58.328325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:58.336680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.337180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.338059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.338689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.376798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.387165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.389136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.391974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e023f8ba-d3b6-4712-ab34-13bbf0545f20 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.216773 Jul 30 21:11:58.407839 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1513/2919] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:58 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:58.489237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:58.493279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:58.498878 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4d064bd-3a76-48bf-b8f2-98cde9ad7ba9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.176366 Jul 30 21:11:58.499540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1407/2920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:58 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:58.821603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:58.822586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:58.832703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.833179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.834013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.834490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.855826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a34e5348-1c6d-422d-82ef-af9d31acfc71 req-12e307c6-28e8-41ff-82d8-694ad1c9f012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c340ed-f101-4df1-ae45-7124b8c144ce", "tag": "2001fb80-09c8-4828-909d-db7cd072c7ac"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:11:58.883086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a34e5348-1c6d-422d-82ef-af9d31acfc71 req-12e307c6-28e8-41ff-82d8-694ad1c9f012 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.885302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a34e5348-1c6d-422d-82ef-af9d31acfc71 req-12e307c6-28e8-41ff-82d8-694ad1c9f012 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.916095 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a34e5348-1c6d-422d-82ef-af9d31acfc71 req-12e307c6-28e8-41ff-82d8-694ad1c9f012 service nova] Creating event network-changed:2001fb80-09c8-4828-909d-db7cd072c7ac for instance a0c340ed-f101-4df1-ae45-7124b8c144ce on nch2-master-1 Jul 30 21:11:58.923309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a34e5348-1c6d-422d-82ef-af9d31acfc71 req-12e307c6-28e8-41ff-82d8-694ad1c9f012 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070170 Jul 30 21:11:58.924490 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1408/2921] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:11:58.931968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:58.932709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:58.942409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.943002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:58.944203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:58.947201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.157121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.167102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61c5f441-d9e0-45dc-9248-775f9ddc89f7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1517 microversion: 2.1 time: 0.241291 Jul 30 21:11:59.180129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1409/2922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:58 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:59.186821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:59.187486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:59.194985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.195490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.196328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.196856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.339818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.352286 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec8fbdaf-e7b8-4008-b1f8-7f95386bfa9b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.535801 Jul 30 21:11:59.353880 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1514/2923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:58 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:59.359969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:59.360860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:59.379553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.382747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.385633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.386888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.389021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.391913 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a934baf5-083e-476f-89b0-2c661c41537c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.210496 Jul 30 21:11:59.393568 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1410/2924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:59 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:59.401969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:59.402727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:59.417544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.417959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.418784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.419256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.618427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.633018 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e95c0a3-65c5-408b-a549-28cba60dd797 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.235447 Jul 30 21:11:59.649605 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1411/2925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:59 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:11:59.649605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:59.649605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:59.669114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.671879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.672497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.672945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.950228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.964217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.966203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:11:59.967689 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bd6f015-b890-4f17-a271-42c92ce1d31b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1807 microversion: 2.20 time: 0.325818 Jul 30 21:11:59.979311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1412/2926] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:11:59 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1807 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:11:59.984633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:11:59.986124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:11:59.995808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:11:59.997003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:11:59.999548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.000854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.200572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.214333 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-121e381c-31f8-4ec6-baec-db2b7424db51 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.238022 Jul 30 21:12:00.215830 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1413/2927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:59 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.221087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-86725f3b-9f65-4a61-a680-07819f73fb1a req-3b4a51e3-551e-4ea5-be15-6a9dc0e883a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "name": "network-vif-plugged", "status": "completed", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:00.233207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-86725f3b-9f65-4a61-a680-07819f73fb1a req-3b4a51e3-551e-4ea5-be15-6a9dc0e883a8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.233791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-86725f3b-9f65-4a61-a680-07819f73fb1a req-3b4a51e3-551e-4ea5-be15-6a9dc0e883a8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.249037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-86725f3b-9f65-4a61-a680-07819f73fb1a req-3b4a51e3-551e-4ea5-be15-6a9dc0e883a8 service nova] Creating event network-vif-plugged:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:12:00.252956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.270597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5a0bf092-64da-4732-acb8-265132960148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.915234 Jul 30 21:12:00.286230 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1515/2928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:11:59 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.289191 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-86725f3b-9f65-4a61-a680-07819f73fb1a req-3b4a51e3-551e-4ea5-be15-6a9dc0e883a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072010 Jul 30 21:12:00.289811 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1414/2929] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:00.293092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:00.293752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:00.306650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.307122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.307964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.308610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.344144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.344800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.345076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lazy-loading 'fault' on Instance uuid d322740c-3e04-4dba-904f-beae55e00106 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:00.381183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:00.382100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:00.390581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.391222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.392189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.392820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.420944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.434861 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-785ba167-7bc7-4e2f-b612-c6a018e3dd41 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 200 len: 1310 microversion: 2.1 time: 0.145281 Jul 30 21:12:00.436042 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1516/2930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:00 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.447279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:00.450519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:00.466711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.467564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.470062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.471034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.557421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.567093 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c8ceba0-e56d-4b17-87b3-1bcff205ff36 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1324 microversion: 2.1 time: 0.193793 Jul 30 21:12:00.567805 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1415/2931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:00 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.662694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:00.663740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:00.673769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.674476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.675643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.676591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.855088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.867082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e3a2a96-20e1-4750-8c74-f90538fcebf7 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.209764 Jul 30 21:12:00.868343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1416/2932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:00 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.892134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:00.901300 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4672758e-82a1-415d-9b5c-0dfd57e5c940 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.463349 Jul 30 21:12:00.915420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1517/2933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:00 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:00.947013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2fa37f30-dc78-4429-ac52-ac3f08e50da6 req-3df79348-3c9a-4935-a98e-c4c66b4af6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d322740c-3e04-4dba-904f-beae55e00106", "name": "network-vif-deleted", "tag": "07cbad0d-ef17-4854-9ac6-c28e12b9d723"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:00.958735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2fa37f30-dc78-4429-ac52-ac3f08e50da6 req-3df79348-3c9a-4935-a98e-c4c66b4af6e2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:00.959383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2fa37f30-dc78-4429-ac52-ac3f08e50da6 req-3df79348-3c9a-4935-a98e-c4c66b4af6e2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:00.971776 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2fa37f30-dc78-4429-ac52-ac3f08e50da6 req-3df79348-3c9a-4935-a98e-c4c66b4af6e2 service nova] Creating event network-vif-deleted:07cbad0d-ef17-4854-9ac6-c28e12b9d723 for instance d322740c-3e04-4dba-904f-beae55e00106 on nch1-master-1 Jul 30 21:12:00.977835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2fa37f30-dc78-4429-ac52-ac3f08e50da6 req-3df79348-3c9a-4935-a98e-c4c66b4af6e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Jul 30 21:12:00.978477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1417/2934] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:00.996036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:00.996871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.003726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.004528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.005783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.006247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.159260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.170034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.171330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.172526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1b03e16b-57d4-47dc-93f0-569788ad73fd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1794 microversion: 2.20 time: 0.181693 Jul 30 21:12:01.173098 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1518/2935] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:00 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:01.238467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.239191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.246359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.246833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.247675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.248170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.297541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.298259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.305298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.305789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.306633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.307165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.398931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.408003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aab9c383-e30a-4d86-9244-ccf04cd1844c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1371 microversion: 2.1 time: 0.174364 Jul 30 21:12:01.408703 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1418/2936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:01.455056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.461784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.462893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: d322740c-3e04-4dba-904f-beae55e00106] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.469456 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16b614a7-ee32-48d2-8dab-588385e960d5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.175192 Jul 30 21:12:01.470131 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1519/2937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:01.470735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.471491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.472533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.473101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.487501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] HTTP exception thrown: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Request method failure captured: Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 HTTP/1.1 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5SW7H2XBrMx7kMv-ZDACp80j4Tqr6yKNwaIR_TTfSKzuFhJin_YQiec0hS_mRE_pjJ-rNfx3ToihNG_ruZVcZUEfU2iyMlz-hn9FphfARB5rSbw1VmkyIKKuGFMYGlWOV-UAlG39MfGSkjaQO6_RXnr7HmCDOaGV-_pC3D2MyDXuM Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07faa65e8ff5420a92cab2a17cd2cc74", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f5f8f28630a3430f81fa884985963a9b Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd322740c-3e04-4dba-904f-beae55e00106'} Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:01.489519 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Returning 404 to user: Instance d322740c-3e04-4dba-904f-beae55e00106 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae0088bd-e31e-4485-a7ac-05c0b6d10f25 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106" status: 404 len: 111 microversion: 2.1 time: 0.034104 Jul 30 21:12:01.493944 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1419/2938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/d322740c-3e04-4dba-904f-beae55e00106 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:01.500491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.501095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.507461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:01.509550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.510024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.510813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.511266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.542030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:01.590383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.591261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.598747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.599443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.600249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.600807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.631686 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-993913df-bcce-4dc8-b169-ca29909c224a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 204 len: 0 microversion: 2.1 time: 0.135195 Jul 30 21:12:01.632856 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1520/2939] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:01 2022] DELETE /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:01.641298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.642101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.650017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.650534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.651428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.651967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.746899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.756250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-574db6e4-90d8-4a87-a9a6-7ce93c991138 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1521 microversion: 2.1 time: 0.171223 Jul 30 21:12:01.757022 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1420/2940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:01.780006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c19822a5-f6b3-48f4-b82e-69c7d3baf878 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'create', calling method: .version_select at 0x7fbb5cee80d0>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:01.806225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:01.815080 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53945550-d607-48a8-a6f8-07e02952490f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1517 microversion: 2.1 time: 0.177819 Jul 30 21:12:01.816808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1521/2941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:01.889542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:01.890388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:01.898619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.899518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:01.900529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:01.901117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.105090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:02.114610 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-31164ac1-0b93-4af3-881b-ba43dbf3d3e0 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.229543 Jul 30 21:12:02.115204 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1522/2942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:01 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:02.119967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:02.120581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:02.132301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.132759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.133754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.134233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.171906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:02.292596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:02.303397 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-003a3f04-2c6c-48bc-bb3b-b9cc0fba04da tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.186858 Jul 30 21:12:02.304299 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1523/2943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:02 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:02.431873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:02.433496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:02.438747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.439216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.440040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.440486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.582054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:02.589522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0343010-bd48-450e-af9f-2a982625563d tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1565 microversion: 2.1 time: 0.161518 Jul 30 21:12:02.603877 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1524/2944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:02 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:02.603877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:02.603877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:02.609215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.609810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.610786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.611239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.749709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:02.758021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29ae708a-cd5e-4a5e-b98e-8473a82465f5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.166955 Jul 30 21:12:02.758873 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1525/2945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:02 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:02.763644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:02.764232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:02.776473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.777019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.778014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.778603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.781430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:02.862225 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-83b9f911-3ca6-4816-a7b5-52d094d48bd7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102362 Jul 30 21:12:02.862870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1526/2946] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:12:02 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:02.872298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:02.873064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:02.885640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.886134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.886934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:02.887779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:02.970122 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c19822a5-f6b3-48f4-b82e-69c7d3baf878 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.195283 Jul 30 21:12:02.971231 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1421/2947] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:12:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:03.044570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-646210967", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ec23a4a5-aac1-4d5c-a634-33223559f0f5"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:03.110036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] validate_networks() for [('ec23a4a5-aac1-4d5c-a634-33223559f0f5', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:12:03.147769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=36 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:03.209161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:03.221960 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e63f5c83-dcbb-4b9c-bb39-e238b81056d7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1517 microversion: 2.1 time: 0.357280 Jul 30 21:12:03.222858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1527/2948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:02 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:03.232433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cc30f1d9-1a8b-4f62-abc1-8e88f25beabc req-15cf9f9e-b6d6-4345-9440-03ac76ebf6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc48a8b-9966-4fac-91a0-8ad341a31b96", "name": "network-vif-plugged", "status": "completed", "tag": "7eda5990-db51-4f03-872a-a1874b53ce72"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:03.244015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cc30f1d9-1a8b-4f62-abc1-8e88f25beabc req-15cf9f9e-b6d6-4345-9440-03ac76ebf6a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.244480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cc30f1d9-1a8b-4f62-abc1-8e88f25beabc req-15cf9f9e-b6d6-4345-9440-03ac76ebf6a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.258780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cc30f1d9-1a8b-4f62-abc1-8e88f25beabc req-15cf9f9e-b6d6-4345-9440-03ac76ebf6a6 service nova] Creating event network-vif-plugged:7eda5990-db51-4f03-872a-a1874b53ce72 for instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 on nch2-master-1 Jul 30 21:12:03.263873 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cc30f1d9-1a8b-4f62-abc1-8e88f25beabc req-15cf9f9e-b6d6-4345-9440-03ac76ebf6a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Jul 30 21:12:03.264491 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1528/2949] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:03.270511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:03.271233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:03.278406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.279250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.279830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.280285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.632681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:12:03.634513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:12:03.635215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:12:03.635931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:12:03.636584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:12:03.657898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.659721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.661354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.662129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.674224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=19 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:03.688321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Getting quotas for project b6c50d273347476986fe5cff264295c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:12:03.696291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Getting quotas for user d9d75013f5714db097bb2975b57d5328 and project b6c50d273347476986fe5cff264295c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:12:03.711094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:12:03.713977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:12:03.773088 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be39617c-a59d-413d-9b4b-d64268d8d263 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732541 Jul 30 21:12:03.775255 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1422/2950] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:12:03.784273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:03.787105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:03.796024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.796512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.797350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.798712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.918643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:03.955405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea3f5ca4-cd5b-4f70-b0ae-3c8a06cd92ee tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.688622 Jul 30 21:12:03.962544 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1529/2951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:03 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:03.973763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:03.982681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:03.984478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Searching by: {'deleted': False, 'project_id': '7174018ac671484ab204d0ad1559d683'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:12:03.993890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.996068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:03.998007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:03.999003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.042626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:12:04.084517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc7532de-60d6-4eb7-bda0-5cd9502996d9 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.119202 Jul 30 21:12:04.086426 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1530/2952] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:12:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:04.093635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.094183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.095350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:04.106855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.107068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2bba2dff-1bbf-4ee4-b9fc-48c188f57865 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.328290 Jul 30 21:12:04.107784 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1423/2953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:03 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:04.114631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d52a6c22-597a-4644-b97b-ca2ae2671563 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.115259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d52a6c22-597a-4644-b97b-ca2ae2671563 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:04.119945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.125653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.126991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.237633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d52a6c22-597a-4644-b97b-ca2ae2671563 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.246482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d52a6c22-597a-4644-b97b-ca2ae2671563 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1223 microversion: 2.1 time: 0.135461 Jul 30 21:12:04.247337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1424/2954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:04.253957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.259379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.260286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Searching by: {'deleted': False, 'project_id': '7174018ac671484ab204d0ad1559d683'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:12:04.273731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.274286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.275114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.275690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.309944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:12:04.353032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.360957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.361433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.501345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a378a98c-dc0f-4b1d-8262-b16472b9af7e tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.253094 Jul 30 21:12:04.502508 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1425/2955] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:04.509519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.510286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:04.523932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.524632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.525702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.526251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.603230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.612871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-915e3bf0-e5eb-4a3f-b0dd-6c236256b0c7 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1475 microversion: 2.1 time: 0.108435 Jul 30 21:12:04.613480 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1426/2956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1475 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:04.625222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9592ea71-4d75-415a-9080-241bbe3a93bb req-75799cc2-0bd6-427b-84c7-8310a75da070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5", "name": "network-vif-deleted", "tag": "cd4985e8-18b4-466b-9a4b-fe89d5868a12"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:04.638430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9592ea71-4d75-415a-9080-241bbe3a93bb req-75799cc2-0bd6-427b-84c7-8310a75da070 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:04.639381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9592ea71-4d75-415a-9080-241bbe3a93bb req-75799cc2-0bd6-427b-84c7-8310a75da070 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:04.653884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9592ea71-4d75-415a-9080-241bbe3a93bb req-75799cc2-0bd6-427b-84c7-8310a75da070 service nova] Creating event network-vif-deleted:cd4985e8-18b4-466b-9a4b-fe89d5868a12 for instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 on nch2-master-1 Jul 30 21:12:04.659342 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9592ea71-4d75-415a-9080-241bbe3a93bb req-75799cc2-0bd6-427b-84c7-8310a75da070 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038541 Jul 30 21:12:04.660944 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1427/2957] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:04.667036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e89126b4-71c9-45ea-9635-28b259842a9b tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.678621 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e89126b4-71c9-45ea-9635-28b259842a9b tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015976 Jul 30 21:12:04.683497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1428/2958] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:04.873620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:04.882215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa5dec09-b427-4729-8485-7238a24a8aac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1314 microversion: 2.1 time: 0.794112 Jul 30 21:12:04.891379 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1531/2959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:04.983999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:04.985841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.019116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.019683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.021315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.021938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.034387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.035024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.045088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.045795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.046738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.047197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.108414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:05.257805 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 204 len: 0 microversion: 2.1 time: 0.226596 Jul 30 21:12:05.258862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1532/2960] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:05 2022] DELETE /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:12:05.274415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.275363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.284105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:05.285204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.285861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.292270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.293320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.298847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1fa40273-a431-4452-b051-295eb78071a5 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.321253 Jul 30 21:12:05.299481 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1429/2961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:04 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:05.316931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.317436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.328308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.328761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.329570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.330033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.412045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:05.415614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:05.421924 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74cc1791-311c-4b42-84fb-85b413c34d43 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1283 microversion: 2.1 time: 0.119751 Jul 30 21:12:05.422877 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1430/2962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:05 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:05.447994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.448550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.464984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.465575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.466492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.467066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.546506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:05.558202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa3b0a3e-7a1c-4dd2-b92b-89d3f223a777 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.292139 Jul 30 21:12:05.559128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1533/2963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:05 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:05.570307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8a819028-888c-4e3a-b4a5-bc888615966d req-d922e404-f748-4d74-9d96-fd47b08bb19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:05.593433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a819028-888c-4e3a-b4a5-bc888615966d req-d922e404-f748-4d74-9d96-fd47b08bb19c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.593903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8a819028-888c-4e3a-b4a5-bc888615966d req-d922e404-f748-4d74-9d96-fd47b08bb19c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.628467 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8a819028-888c-4e3a-b4a5-bc888615966d req-d922e404-f748-4d74-9d96-fd47b08bb19c service nova] Creating event network-changed:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:12:05.641958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8a819028-888c-4e3a-b4a5-bc888615966d req-d922e404-f748-4d74-9d96-fd47b08bb19c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081512 Jul 30 21:12:05.646256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1534/2964] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:05.661457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.662542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.676986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.681378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.682595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.683270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.690805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:05.705013 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef056245-6a4a-4239-82e6-51d35ad8e2c6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1608 microversion: 2.1 time: 0.280859 Jul 30 21:12:05.705760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1431/2965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:05 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1608 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:05.752536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.754623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.755109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lazy-loading 'fault' on Instance uuid b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:05.850683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:05.862150 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1e6edab-5621-4cf7-9136-cded35b23765 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1310 microversion: 2.1 time: 0.213135 Jul 30 21:12:05.863134 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1535/2966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:05 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1310 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:05.904279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:05.904923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:05.914442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.914857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:05.915706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:05.916172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.161152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:06.173506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c0d9634-764d-4ca1-b875-88f167822c30 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1501 microversion: 2.1 time: 0.272947 Jul 30 21:12:06.174679 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1432/2967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:05 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1501 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:06.196146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:06.197483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:06.205634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.206419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.208140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.208923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.296096 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5a47ea9-305d-4b46-adc8-9778acc2d652 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96/action" status: 202 len: 0 microversion: 2.1 time: 0.103788 Jul 30 21:12:06.298085 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1536/2968] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:06 2022] POST /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:06.311219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:06.312121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:06.322599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:06.323361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:06.325281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.328677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.328815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.329207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.330735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.331220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.332158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.332631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.653413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:06.667035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61d11adc-5bd0-49d1-873e-b4ca60b1def4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.348582 Jul 30 21:12:06.668565 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1537/2969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:06 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:06.676597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:06.678351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:06.687670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.689248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.690294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.692307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.955093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:06.965979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed939223-6d31-49da-9bdd-5a1e17127693 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.295951 Jul 30 21:12:06.966846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1538/2970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:06 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:06.975962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:06.976599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:06.993922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:06.998164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.998644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:06.999720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:06.999917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.005107 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1aaa442d-d912-4864-8af8-f2a71333e670 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1506 microversion: 2.1 time: 0.701489 Jul 30 21:12:07.013186 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1433/2971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:06 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:07.032910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:07.035062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:07.046026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.052031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.054203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.055781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.298109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:07.311098 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1d24ab0f-d50f-4d10-8b67-fee7e19eb9b9 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.343176 Jul 30 21:12:07.322614 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1539/2972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:06 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:07.322614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:07.322614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:07.329594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.329594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.329594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.329594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.345528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:07.356498 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb6234d3-9b95-4077-853e-e73f31a8cd00 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1608 microversion: 2.1 time: 0.341839 Jul 30 21:12:07.365135 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1434/2973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:07 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1608 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:07.378977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.379716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.379953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lazy-loading 'fault' on Instance uuid b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:07.460621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:07.463045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:07.470830 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-571d48c8-e3bf-486a-8606-4cf5e78e11a1 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 200 len: 1310 microversion: 2.1 time: 0.157227 Jul 30 21:12:07.471466 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1540/2974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:07 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:07.564606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3dbd0478-c220-4a95-96c6-c026489a07e6 req-b3ca47da-3412-4e01-8881-49afa316ebba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c340ed-f101-4df1-ae45-7124b8c144ce", "name": "network-vif-plugged", "status": "completed", "tag": "2001fb80-09c8-4828-909d-db7cd072c7ac"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:07.602657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3dbd0478-c220-4a95-96c6-c026489a07e6 req-b3ca47da-3412-4e01-8881-49afa316ebba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.607639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3dbd0478-c220-4a95-96c6-c026489a07e6 req-b3ca47da-3412-4e01-8881-49afa316ebba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.645975 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3dbd0478-c220-4a95-96c6-c026489a07e6 req-b3ca47da-3412-4e01-8881-49afa316ebba service nova] Creating event network-vif-plugged:2001fb80-09c8-4828-909d-db7cd072c7ac for instance a0c340ed-f101-4df1-ae45-7124b8c144ce on nch2-master-1 Jul 30 21:12:07.656041 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3dbd0478-c220-4a95-96c6-c026489a07e6 req-b3ca47da-3412-4e01-8881-49afa316ebba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096427 Jul 30 21:12:07.656716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1435/2975] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:07.688286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:07.688921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:07.702369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.702843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.703694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.704159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.988824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:07.989549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:07.996641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.997112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:07.997922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:07.998398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.138320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:08.146281 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5ea887a-3e9b-4f76-8823-215801ee84df tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.162305 Jul 30 21:12:08.146876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1436/2976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:07 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:08.151720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.152350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.154301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:08.160351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.160824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.161628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.162088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.304402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:08.313492 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1c1b4f2-fafa-4126-bd22-aa7239f69479 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1486 microversion: 2.1 time: 0.165543 Jul 30 21:12:08.314313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1437/2977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1486 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:08.320657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bef2fef5-ea41-43fb-8b1c-a3d2fa0fb3ae req-30e500e9-4e00-4716-88ed-bf52b67b9fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0630346-b783-4226-8f47-b3bc085e30e3", "tag": "379a4f27-543f-473d-a43d-1a9c19c77e20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:08.321305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:08.333179 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f1bf083-3310-4256-af4e-d187af4d1d49 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.648532 Jul 30 21:12:08.335094 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1541/2978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:07 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:08.340284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.340931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.352714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.353254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.353561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bef2fef5-ea41-43fb-8b1c-a3d2fa0fb3ae req-30e500e9-4e00-4716-88ed-bf52b67b9fa8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.354058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.354546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.355095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bef2fef5-ea41-43fb-8b1c-a3d2fa0fb3ae req-30e500e9-4e00-4716-88ed-bf52b67b9fa8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.370157 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bef2fef5-ea41-43fb-8b1c-a3d2fa0fb3ae req-30e500e9-4e00-4716-88ed-bf52b67b9fa8 service nova] Creating event network-changed:379a4f27-543f-473d-a43d-1a9c19c77e20 for instance d0630346-b783-4226-8f47-b3bc085e30e3 on nch1-master-1 Jul 30 21:12:08.377146 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bef2fef5-ea41-43fb-8b1c-a3d2fa0fb3ae req-30e500e9-4e00-4716-88ed-bf52b67b9fa8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060548 Jul 30 21:12:08.378292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1438/2979] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:08.383939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.384539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.390936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.391432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.392229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.392932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.419959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:08.500105 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5caeb052-c6f5-4952-9f1c-8c21a226ce69 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 204 len: 0 microversion: 2.1 time: 0.120219 Jul 30 21:12:08.500706 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1439/2980] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:08 2022] DELETE /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:08.506482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.507199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.514436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.514640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.515397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.515856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.684493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:08.693215 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-050b45ce-2479-4490-80d7-3b64c60c2579 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1608 microversion: 2.1 time: 0.191259 Jul 30 21:12:08.694126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1440/2981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1608 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:08.704267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.705404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.714265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:08.715782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.716537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.718035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.718658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.725005 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-261a087f-906f-471b-911e-569266047fb4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.388574 Jul 30 21:12:08.725933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1542/2982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:08.732175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.733273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.740627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.740886 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] HTTP exception thrown: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. Jul 30 21:12:08.741552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.742491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.743331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Request method failure captured: Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 HTTP/1.1 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5SW7H2XBrMx7kMv-ZDACp80j4Tqr6yKNwaIR_TTfSKzuFhJin_YQiec0hS_mRE_pjJ-rNfx3ToihNG_ruZVcZUEfU2iyMlz-hn9FphfARB5rSbw1VmkyIKKuGFMYGlWOV-UAlG39MfGSkjaQO6_RXnr7HmCDOaGV-_pC3D2MyDXuM Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07faa65e8ff5420a92cab2a17cd2cc74", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f5f8f28630a3430f81fa884985963a9b Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5'} Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:08.743782 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Returning 404 to user: Instance b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-096250fd-25c8-4a1b-a196-2983590c425a tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5" status: 404 len: 111 microversion: 2.1 time: 0.050326 Jul 30 21:12:08.748170 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1441/2983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/b0b37ddb-2b6a-47b7-b8b9-d0fed10f25a5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:08.755248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.755813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.762784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.763397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.764310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.764995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.793104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:08.879239 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c98fbc5e-d63c-4fd0-a92d-2a96dd939b01 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 204 len: 0 microversion: 2.1 time: 0.127074 Jul 30 21:12:08.880140 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1442/2984] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:08 2022] DELETE /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:12:08.888614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:08.889334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:08.896119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.896592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:08.897394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:08.899255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.037928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.039035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.046857 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa18e8a7-5386-4e9a-8ad6-0733d0704d65 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1516 microversion: 2.1 time: 0.162311 Jul 30 21:12:09.047747 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1443/2985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:09.048699 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-decfe139-ee7d-4b8c-899a-cbf53de08eec tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1492 microversion: 2.1 time: 0.320717 Jul 30 21:12:09.049908 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1543/2986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:08 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1492 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:09.167862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:09.169230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:09.176208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.176682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.177517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.177978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.317251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.324983 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0452dcd8-e3d6-4614-8118-8c92dc2d306c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.161170 Jul 30 21:12:09.325566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1444/2987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:09 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:09.355622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:09.356305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:09.363342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.363822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.364643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.365097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.542898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.551027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-076117f7-41e4-4857-b79c-dc7ecaf21ad8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.199229 Jul 30 21:12:09.551878 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1544/2988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:09 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:09.714205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:09.715000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:09.721461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.722009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.722851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.723331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.746285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:09.746923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:09.753938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.754411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.755683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:09.756261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:09.788558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.797429 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26ff7561-6fc8-46a7-9103-b022b0ec9215 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1541 microversion: 2.1 time: 0.087144 Jul 30 21:12:09.798252 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1445/2989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:09 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1541 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:09.898378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:09.906180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae5dedd3-bc64-4f25-9ae2-f47d86e6e045 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1314 microversion: 2.1 time: 0.164046 Jul 30 21:12:09.906767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1545/2990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:09 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:10.071535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.071824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.072312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.072573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.078967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.079744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.080563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.081122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.081641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.082179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.083055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.083620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.090599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:10.236171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:10.247675 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a321cd9b-f70c-4bef-80ec-173bb4445bc6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1492 microversion: 2.1 time: 0.179971 Jul 30 21:12:10.248389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:10.261874 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb955184-e6ff-4ae0-8089-1479b2fc83ae tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1516 microversion: 2.1 time: 0.194264 Jul 30 21:12:10.263182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1546/2991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1492 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:10.271823 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1446/2992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:10.347606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.349326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.357476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.358188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.358928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.359566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.424243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a43621e2-781c-4c5d-83de-3883071f4e74 req-769023d5-900c-42b8-ad01-67f3633d3f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4adc144-ea58-4187-90b0-03446f07641d", "name": "network-vif-deleted", "tag": "b881dd6c-16b1-404c-b1ac-4548cd416f3e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:10.435251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a43621e2-781c-4c5d-83de-3883071f4e74 req-769023d5-900c-42b8-ad01-67f3633d3f03 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.435797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a43621e2-781c-4c5d-83de-3883071f4e74 req-769023d5-900c-42b8-ad01-67f3633d3f03 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.453399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a43621e2-781c-4c5d-83de-3883071f4e74 req-769023d5-900c-42b8-ad01-67f3633d3f03 service nova] Creating event network-vif-deleted:b881dd6c-16b1-404c-b1ac-4548cd416f3e for instance d4adc144-ea58-4187-90b0-03446f07641d on nch2-master-1 Jul 30 21:12:10.458958 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a43621e2-781c-4c5d-83de-3883071f4e74 req-769023d5-900c-42b8-ad01-67f3633d3f03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 Jul 30 21:12:10.459873 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1447/2993] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:10.573226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.573226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.580514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.581010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.581819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.582382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.630457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:10.638813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95ae6676-2181-48ac-9f2a-120e3ae84eb3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.296293 Jul 30 21:12:10.639121 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1547/2994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:10.736233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:10.744769 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1201c3d8-d925-4139-9f76-739e5f2f79fa tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.176253 Jul 30 21:12:10.745370 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1448/2995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:10.818061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.818806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.825256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.825930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.826780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.827315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.906508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:10.915401 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5028804-2601-450b-84fb-2d518836031a tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1251 microversion: 2.1 time: 0.101149 Jul 30 21:12:10.916193 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1548/2996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1251 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:10.926181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:10.926816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:10.933374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.934086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:10.934968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:10.935535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.068463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.076142 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-32f478a1-790e-465d-a79f-d0ae7d62a67f tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1500 microversion: 2.1 time: 0.154039 Jul 30 21:12:11.076713 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1449/2997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:10 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:11.096927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:11.099938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.106126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.106592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.107394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.107867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.130233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lazy-loading 'flavor' on Instance uuid a0c340ed-f101-4df1-ae45-7124b8c144ce {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:11.200459 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79bc29df-e33c-481e-b738-33b771dcd808 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "POST /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce/action" status: 200 len: 32 microversion: 2.1 time: 0.107502 Jul 30 21:12:11.200991 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1549/2998] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:11 2022] POST /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:12:11.211498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.212137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.219252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.219756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.220552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.221046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.273210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.274032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.281037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.281037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.281506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.281952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.357801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.365679 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff04507e-fabf-481e-b587-ebe059eacb90 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.159133 Jul 30 21:12:11.366325 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1450/2999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:11.370954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.371621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.378040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.379340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.379819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.380279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.418718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.426729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b03b39f-9ca4-46d9-8120-d59291ef30b0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1492 microversion: 2.1 time: 0.158309 Jul 30 21:12:11.427345 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1550/3000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1492 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:11.511597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.519938 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2baf91a-faaa-40ba-82e5-c21907a3fe26 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1516 microversion: 2.1 time: 0.151948 Jul 30 21:12:11.520518 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1451/3001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:11.662321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.662954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.669194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.669664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.670446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.670903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.765039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.765670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.772133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.772606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.773401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.773862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.803167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.810777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-83d1ebd0-486a-435f-b987-589aa75e47cf tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.152326 Jul 30 21:12:11.811377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1551/3002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:11.917438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:11.925645 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43263aa4-a319-4436-85ac-0e8d751686b9 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.164249 Jul 30 21:12:11.926221 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1452/3003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:11.936210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:11.936836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:11.943595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.944052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:11.944820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:11.945265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.014743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb637624ed0f48c9b4ad60e2cda88eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7174018ac671484ab204d0ad1559d683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:12.036553 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea40b29f-be8b-46f6-9da5-ffff9b1279e6 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 200 len: 1251 microversion: 2.1 time: 0.103973 Jul 30 21:12:12.037335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1552/3004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:11 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 1251 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:12.387999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:12.388647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:12.397224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.397703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.399709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.399906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.450246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:12.451620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:12.464834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.466000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.466947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.467468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.685666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:12.705761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a76d0a56-97f8-4502-a19c-e90d7876e10e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.321779 Jul 30 21:12:12.712307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1453/3005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:12 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:12.721261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:12.722414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:12.734021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.737541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.739879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.741299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.781704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:12.793285 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f61a97f-95e2-4762-84bc-e02e1a062cc9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1492 microversion: 2.1 time: 0.347889 Jul 30 21:12:12.800195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1553/3006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:12 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1492 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:12.833130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:12.834017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:12.840269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.840960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:12.841924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:12.842915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.260038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f8f28630a3430f81fa884985963a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07faa65e8ff5420a92cab2a17cd2cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:13.284617 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-762f2749-47d0-47f1-a873-371859545375 tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 200 len: 1516 microversion: 2.1 time: 0.575899 Jul 30 21:12:13.290459 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1454/3007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:12 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 1516 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:13.308791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:13.309523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:13.329590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.332023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.339869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.340651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.519410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:13.532260 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e0665b2-3dc0-4331-87e6-43bf78425bc0 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.700387 Jul 30 21:12:13.534704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1554/3008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:12 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:13.539418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:13.540310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] [instance: d4adc144-ea58-4187-90b0-03446f07641d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:13.546988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.547931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.548820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.549349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.557847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:13.563579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] HTTP exception thrown: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Request method failure captured: Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d HTTP/1.1 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z41-QnolNlurIRMaZ9lug1Y9R1FP2kTvRgEOgOJXxH5eXnhxdX8khLOND79YksjeHBQnoBYpjexwIV6ZvGW8Gr--_wO6tWUi50sK_i83CBPyz0kriwT0Y6XJtJzTZlKchbRixr2CoxKs8tBwgqdSIrDhJOcyLpwN6aaWBZQDAPcy3Q Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7174018ac671484ab204d0ad1559d683 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestBootFromVolume-340611875 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7174018ac671484ab204d0ad1559d683"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7174018ac671484ab204d0ad1559d683", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7174018ac671484ab204d0ad1559d683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7174018ac671484ab204d0ad1559d683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestBootFromVolume-340611875 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7174018ac671484ab204d0ad1559d683 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestBootFromVolume-340611875 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestBootFromVolume-340611875-project Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eb637624ed0f48c9b4ad60e2cda88eb8 Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestBootFromVolume-340611875-project Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd4adc144-ea58-4187-90b0-03446f07641d'} Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:13.565482 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Returning 404 to user: Instance d4adc144-ea58-4187-90b0-03446f07641d could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:13.570683 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85d670d2-b226-4ea5-99a8-6aa72119c380 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d" status: 404 len: 111 microversion: 2.1 time: 0.031819 Jul 30 21:12:13.571461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b6bf9224-8513-4b28-bdcd-892adcd40fd1 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1477 microversion: 2.1 time: 0.274552 Jul 30 21:12:13.571461 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1455/3010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:13 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:13.578614 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1555/3010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:13 2022] GET /compute/v2.1/servers/d4adc144-ea58-4187-90b0-03446f07641d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:13.583789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5ce961ce-179d-4096-8b0e-88ee6f63d102 req-78bf3ce2-9694-4cc1-bdf8-75eef68934ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc48a8b-9966-4fac-91a0-8ad341a31b96", "name": "network-vif-deleted", "tag": "7eda5990-db51-4f03-872a-a1874b53ce72"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:13.585396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95fa5ab1-f624-47ed-b8f6-559bf3d6fbc3 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] Calling method '.version_select at 0x7fbb5d40b670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:13.594784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5ce961ce-179d-4096-8b0e-88ee6f63d102 req-78bf3ce2-9694-4cc1-bdf8-75eef68934ff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.595253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5ce961ce-179d-4096-8b0e-88ee6f63d102 req-78bf3ce2-9694-4cc1-bdf8-75eef68934ff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.608871 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95fa5ab1-f624-47ed-b8f6-559bf3d6fbc3 tempest-ServersTestBootFromVolume-340611875 tempest-ServersTestBootFromVolume-340611875-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463920566" status: 202 len: 0 microversion: 2.1 time: 0.029040 Jul 30 21:12:13.609085 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5ce961ce-179d-4096-8b0e-88ee6f63d102 req-78bf3ce2-9694-4cc1-bdf8-75eef68934ff service nova] Creating event network-vif-deleted:7eda5990-db51-4f03-872a-a1874b53ce72 for instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 on nch2-master-1 Jul 30 21:12:13.609598 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1556/3011] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:12:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463920566 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:13.616981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5ce961ce-179d-4096-8b0e-88ee6f63d102 req-78bf3ce2-9694-4cc1-bdf8-75eef68934ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047283 Jul 30 21:12:13.617744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1456/3012] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:13.734403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:13.735206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:13.745585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.746389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.747546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.748066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.753766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:13.818492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:13.819220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:13.827607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.828283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.830527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.831619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.880215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:13.880752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:13.881269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'fault' on Instance uuid 6dc48a8b-9966-4fac-91a0-8ad341a31b96 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:13.929456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:13.946119 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bdf8996d-5ae7-4863-8bae-78efb74cd32d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 200 len: 1304 microversion: 2.1 time: 0.131939 Jul 30 21:12:13.949005 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1457/3013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:13 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:14.020257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=12 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:14.110806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:14.127338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb18871f-c516-4b81-9d61-e754f499b746 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.398930 Jul 30 21:12:14.134859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1557/3014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:13 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:14.319061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:14.320476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] [instance: 6a092da1-0ff1-4237-8612-037fb25c74fe] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:14.322888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:14.330649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.331186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.332229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.332844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.348542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] HTTP exception thrown: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Request method failure captured: Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe HTTP/1.1 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5SW7H2XBrMx7kMv-ZDACp80j4Tqr6yKNwaIR_TTfSKzuFhJin_YQiec0hS_mRE_pjJ-rNfx3ToihNG_ruZVcZUEfU2iyMlz-hn9FphfARB5rSbw1VmkyIKKuGFMYGlWOV-UAlG39MfGSkjaQO6_RXnr7HmCDOaGV-_pC3D2MyDXuM Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07faa65e8ff5420a92cab2a17cd2cc74", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07faa65e8ff5420a92cab2a17cd2cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 07faa65e8ff5420a92cab2a17cd2cc74 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1216055218 Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f5f8f28630a3430f81fa884985963a9b Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServerFiltersTestJSON-1216055218-project Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6a092da1-0ff1-4237-8612-037fb25c74fe'} Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:14.350250 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] Returning 404 to user: Instance 6a092da1-0ff1-4237-8612-037fb25c74fe could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c80a6d1b-0a78-4c2e-bca1-ddadbbf8055f tempest-ListServerFiltersTestJSON-1216055218 tempest-ListServerFiltersTestJSON-1216055218-project] 10.222.0.17 "GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe" status: 404 len: 111 microversion: 2.1 time: 0.038624 Jul 30 21:12:14.354634 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1458/3015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:14 2022] GET /compute/v2.1/servers/6a092da1-0ff1-4237-8612-037fb25c74fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:14.558024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:14.558662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:14.568644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.572565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.573931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.575683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.593608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:14.595004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:14.603946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:14.610364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.611097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.612331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.613612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.876416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:14.888482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8ffe147b-32d4-4a6a-856e-1532f5872967 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.335527 Jul 30 21:12:14.889743 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1558/3016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:14 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:14.970293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:14.971191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:14.982036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.982873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:14.983943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:14.984629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.013535 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 HTTP/1.1 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6dc48a8b-9966-4fac-91a0-8ad341a31b96'} Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:15.015826 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:12:15.021301 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:15.022924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:15.024055 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed7ac282-1101-41a9-a4c1-cd41a57ffc60 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 404 len: 111 microversion: 2.1 time: 0.058799 Jul 30 21:12:15.025508 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1559/3017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:14 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:15.063553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-unplugged", "status": "completed", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:15.083192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.084171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.086094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:15.096172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aad1a028-5a3e-45e6-9a73-64537c594590 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1476 microversion: 2.1 time: 0.508840 Jul 30 21:12:15.103787 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1459/3018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:14 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:15.114591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1276832131", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:15.131201 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] Creating event network-vif-unplugged:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch2-master-1 Jul 30 21:12:15.138825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] Instance be732443-5139-4e34-8f54-6072d2b0072b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:12:15.170322 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-401ceb03-0878-4580-8712-2af99d923e91 req-6dd46ddc-dc31-495f-9d7b-2286f41a4fc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108908 Jul 30 21:12:15.172747 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1560/3019] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:15.186905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:15.187661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:15.197099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:15.197622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:12:15.207230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.207785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.208597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.209059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.482819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:15.493035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e73a6713-8da2-47c0-972f-e1447e1e27a0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.317680 Jul 30 21:12:15.509225 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1561/3020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:15 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:15.624843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-356be2d1-0d18-447a-9c5f-ceba79c3b60c req-4c1e1b3d-aaff-468d-b266-2a62c06e9422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0630346-b783-4226-8f47-b3bc085e30e3", "name": "network-vif-plugged", "status": "completed", "tag": "379a4f27-543f-473d-a43d-1a9c19c77e20"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:15.636276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-356be2d1-0d18-447a-9c5f-ceba79c3b60c req-4c1e1b3d-aaff-468d-b266-2a62c06e9422 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.636704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-356be2d1-0d18-447a-9c5f-ceba79c3b60c req-4c1e1b3d-aaff-468d-b266-2a62c06e9422 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.649119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-356be2d1-0d18-447a-9c5f-ceba79c3b60c req-4c1e1b3d-aaff-468d-b266-2a62c06e9422 service nova] Creating event network-vif-plugged:379a4f27-543f-473d-a43d-1a9c19c77e20 for instance d0630346-b783-4226-8f47-b3bc085e30e3 on nch1-master-1 Jul 30 21:12:15.655247 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-356be2d1-0d18-447a-9c5f-ceba79c3b60c req-4c1e1b3d-aaff-468d-b266-2a62c06e9422 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Jul 30 21:12:15.656477 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1562/3021] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:15.674670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8d2c71e2-2f76-437a-85be-8de9bb9d4f47 req-f2b173ee-c8ab-4410-b540-e49b0657920e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a092da1-0ff1-4237-8612-037fb25c74fe", "name": "network-vif-deleted", "tag": "a0c54e07-0e75-4b84-8ecb-22cbbc118348"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:15.686434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d2c71e2-2f76-437a-85be-8de9bb9d4f47 req-f2b173ee-c8ab-4410-b540-e49b0657920e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.687381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d2c71e2-2f76-437a-85be-8de9bb9d4f47 req-f2b173ee-c8ab-4410-b540-e49b0657920e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.702152 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8d2c71e2-2f76-437a-85be-8de9bb9d4f47 req-f2b173ee-c8ab-4410-b540-e49b0657920e service nova] Creating event network-vif-deleted:a0c54e07-0e75-4b84-8ecb-22cbbc118348 for instance 6a092da1-0ff1-4237-8612-037fb25c74fe on nch2-master-1 Jul 30 21:12:15.707637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8d2c71e2-2f76-437a-85be-8de9bb9d4f47 req-f2b173ee-c8ab-4410-b540-e49b0657920e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037232 Jul 30 21:12:15.708963 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1563/3022] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:15.913305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:15.914919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:15.928347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.929067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:15.930083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:15.930654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.124543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:16.149378 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d465ebc4-1cc2-4d8c-8429-519c86d402a5 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.242250 Jul 30 21:12:16.156295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1564/3023] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:15 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:16.170126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:16.173130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:16.181249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.181972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.183197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.183685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.350102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:16.358188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72c2df40-a046-4fec-869e-93bfaa95d352 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1476 microversion: 2.1 time: 0.198493 Jul 30 21:12:16.358796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1565/3024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:16 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:16.518207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:16.519423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:16.526009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.526485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.527279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.527759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.549058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:12:16.550732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:12:16.551690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:12:16.552361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:12:16.553011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:12:16.592261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.592733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.593568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:16.596045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:16.639693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:12:16.647981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:12:16.668600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:12:16.671041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:12:16.704727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:16.715546 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7887ea30-385c-4b9c-8e18-7b90475ccd84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.201247 Jul 30 21:12:16.716863 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1566/3025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:16 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:16.757162 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2804b6ab-05a0-4a6d-ae4f-63394253eabf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650471 Jul 30 21:12:16.757878 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1460/3026] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:12:16.770628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a04b68e-1efd-4554-b5a8-29de9a4644b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:16.771174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a04b68e-1efd-4554-b5a8-29de9a4644b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:16.868777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a04b68e-1efd-4554-b5a8-29de9a4644b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:16.881531 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a04b68e-1efd-4554-b5a8-29de9a4644b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1215 microversion: 2.1 time: 0.115733 Jul 30 21:12:16.884500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1567/3027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:16 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:17.178734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:17.179395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:17.198809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.201243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.202962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.203779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.206083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:17.243779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.246575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.287705 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] Creating event network-changed:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch2-master-1 Jul 30 21:12:17.306131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] Instance be732443-5139-4e34-8f54-6072d2b0072b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:12:17.323918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-24655ef4-bb29-4e3e-b8a7-0958824da91f req-a01faa4d-1798-4285-bf41-3ba71d73668e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127923 Jul 30 21:12:17.329309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1568/3028] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:17.383966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:17.385448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:17.401240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.401665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.402531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.402981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.573581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:17.580848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-504ed02d-3413-43dd-a457-aae53ab11881 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1323 microversion: 2.1 time: 0.407206 Jul 30 21:12:17.595224 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1461/3029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:17 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1323 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:17.668181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:17.676972 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-086ecb31-2006-4b1f-8647-e560b46e7d0d tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1474 microversion: 2.1 time: 0.298980 Jul 30 21:12:17.678380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1569/3030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:17 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:17.738713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:17.739178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:17.746463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.747367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.748445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.748972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.907937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:17.908582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:17.921333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.923895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:17.925581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:17.927915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.116951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:18.133500 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4040ee0c-567d-477e-b595-37a3d63ace64 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.399180 Jul 30 21:12:18.140047 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1462/3031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:17 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:18.233887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:18.250902 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fa5de99-f476-40fc-a2ff-f7768c54e8e5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1219 microversion: 2.1 time: 0.347244 Jul 30 21:12:18.269262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1570/3032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:17 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1219 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:18.555470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-474497748", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:18.602879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:18.607963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:18.628386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.628934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.630666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.631710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.681366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:12:18.682078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:12:18.683751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:12:18.687120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:12:18.695274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:12:18.729627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.730092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.730918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.731401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.770834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Getting quotas for project afa70c1fb55148909a98d8628111983e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:12:18.777479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Getting quotas for user 8f4da0578588431db5da2d58455e8364 and project afa70c1fb55148909a98d8628111983e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:12:18.792701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:12:18.795123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:12:18.871168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3dc7bcd-1a36-43ba-ae14-25d462a47aaa tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.505728 Jul 30 21:12:18.875439 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1463/3033] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:12:18.888160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:18.889397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:18.899256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.899985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:18.901174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:18.901835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.243422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.258320 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89c5e8ad-2d3e-4687-a249-33a026f42f5c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 200 len: 1519 microversion: 2.1 time: 0.658493 Jul 30 21:12:19.259156 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1571/3034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:18 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 1519 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:19.269908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:19.273017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:19.414272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.422231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.429222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.438836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63090b2e-c599-4dcf-bce6-a37481e6ea5a tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1280 microversion: 2.47 time: 0.177104 Jul 30 21:12:19.463700 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1572/3035] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:19 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:19.488506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:19.489537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:19.497516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.498694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.500764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.501460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.658222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.672461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4c24edc-e033-4f48-9cd3-587bd7317de4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1471 microversion: 2.1 time: 0.793205 Jul 30 21:12:19.684341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1464/3036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:18 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1471 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:19.698578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:19.700202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:19.707396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.708251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.709288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.709957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.820107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:19.835838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:19.842280 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c5e720b-e1f1-43c6-99bb-e083c1280864 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1273 microversion: 2.1 time: 0.155841 Jul 30 21:12:19.843392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1465/3037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:19 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:19.853304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.208"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:19.855987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:19.873359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:19.885053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.890919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.892226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:19.892911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:19.940685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Acquired lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:12:20.386141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:20.397511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac304b70-bfdb-4f30-b81d-a078d7381142 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.930193 Jul 30 21:12:20.411440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1573/3038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:19 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:20.415175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:20.417968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:20.431725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.432595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:20.433463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.433923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:20.673795 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-32dcb4bf-0d82-4aaa-923b-80e4291a38b3 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "POST /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b/action" status: 202 len: 0 microversion: 2.1 time: 0.265132 Jul 30 21:12:20.674639 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1574/3039] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:20 2022] POST /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:20.687991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:20.689002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:20.697040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.697682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:20.699256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.699894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:20.928536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:20.941693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:20.944375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:20.946672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c838e70d-d8f6-4668-9db3-be8b313bceaf tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1350 microversion: 2.47 time: 0.263620 Jul 30 21:12:20.947935 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1575/3040] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:20 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1350 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:20.980415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:20.981379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:20.989135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.989852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:20.990805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:20.991698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:21.036779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:21.403312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:21.412553 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d4b2207-f53a-4cb3-b117-f81f81d35692 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.463382 Jul 30 21:12:21.433095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1576/3041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:20 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:21.449293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:21.450024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:21.456800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:21.457570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:21.458565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:21.459232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:21.525442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:21.731208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:21.740425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86ce4b13-8e40-4ff8-94bd-73df73aab020 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.305616 Jul 30 21:12:21.741675 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1577/3042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:21 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:21.757607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-plugged", "status": "completed", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:21.768337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:21.769616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:21.783248 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] Creating event network-vif-plugged:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch2-master-1 Jul 30 21:12:21.789847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] Instance be732443-5139-4e34-8f54-6072d2b0072b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:12:21.802965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-778dce35-993a-48be-962a-660b2ac89db3 req-f69d4fe2-46f5-43d3-bfef-df7ae3e90a5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059306 Jul 30 21:12:21.804381 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1578/3043] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:21.812546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:21.813508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:21.823993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:21.824669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:21.825820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:21.826483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.137616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:22.146162 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49eb6641-6a65-4349-aa70-1a47cf2656d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.340080 Jul 30 21:12:22.161091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1579/3044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:21 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:22.166194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fa7cc48e-5736-4541-8a76-609d744b2be7 req-4ffec987-df40-466e-a817-706e269e236f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:22.180346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fa7cc48e-5736-4541-8a76-609d744b2be7 req-4ffec987-df40-466e-a817-706e269e236f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.181323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fa7cc48e-5736-4541-8a76-609d744b2be7 req-4ffec987-df40-466e-a817-706e269e236f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.197644 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fa7cc48e-5736-4541-8a76-609d744b2be7 req-4ffec987-df40-466e-a817-706e269e236f service nova] Creating event network-changed:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:12:22.205338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fa7cc48e-5736-4541-8a76-609d744b2be7 req-4ffec987-df40-466e-a817-706e269e236f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042652 Jul 30 21:12:22.206057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1580/3045] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:22.212829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:22.213870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:22.222042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.223042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.224110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.224813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.285706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Updating instance_info_cache with network_info: [{"id": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3", "address": "fa:16:3e:60:6b:43", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74e8b573-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:22.317972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Releasing lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:12:22.319356 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cf00764-b263-4d8c-aef8-69e540e6619a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action" status: 202 len: 0 microversion: 2.1 time: 2.473921 Jul 30 21:12:22.320461 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1466/3046] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:19 2022] POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action => generated 0 bytes in 2477 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:12:22.334135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.208"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:22.337986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:22.352248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.352730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.353541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.353998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.424512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Acquired lock "refresh_cache-d0630346-b783-4226-8f47-b3bc085e30e3" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:12:22.479851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:22.504352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:22.507230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:22.509332 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7ebb805-b4c1-4d0f-beec-5890c2c79115 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1338 microversion: 2.47 time: 0.301660 Jul 30 21:12:22.511011 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1581/3047] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:22 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:22.517818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:22.519922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:22.532507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.533475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.535092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.537385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.803250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:22.816111 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-01b61fa9-f10c-47ff-8d4c-35b5579ff017 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.303654 Jul 30 21:12:22.816711 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1582/3048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:22 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:22.822785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:22.823939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:22.832163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.833429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:22.838981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:22.840352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.183849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:23.194347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e05a3062-2556-4498-8c8f-b420373ee5a4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.376236 Jul 30 21:12:23.203951 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1583/3049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:22 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:23.223710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:23.224646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:23.233114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.238125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.239321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.239986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.603749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:23.614261 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6737ca58-5198-40eb-bef1-0ed58eed04e5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.396337 Jul 30 21:12:23.627722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1584/3050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:23 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:23.637633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-55a74597-e884-472f-8b0d-e1774737d121 req-7993693e-e7b3-4e56-977d-9ab0e70bea56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed8a44b-ef0e-4b0c-b57f-79e3dd896678", "tag": "d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:23.652940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-55a74597-e884-472f-8b0d-e1774737d121 req-7993693e-e7b3-4e56-977d-9ab0e70bea56 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.653637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-55a74597-e884-472f-8b0d-e1774737d121 req-7993693e-e7b3-4e56-977d-9ab0e70bea56 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.668744 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-55a74597-e884-472f-8b0d-e1774737d121 req-7993693e-e7b3-4e56-977d-9ab0e70bea56 service nova] Creating event network-changed:d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c for instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 on nch2-master-1 Jul 30 21:12:23.674024 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-55a74597-e884-472f-8b0d-e1774737d121 req-7993693e-e7b3-4e56-977d-9ab0e70bea56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054255 Jul 30 21:12:23.675385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1585/3051] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:23.680899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:23.681222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:23.687971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.688794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.689340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.690170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.825007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:23.838447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:23.839851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:23.841219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac444ece-e9ea-489e-8c4e-0fd76b347590 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1359 microversion: 2.47 time: 0.164715 Jul 30 21:12:23.841738 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1586/3052] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:23 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:23.846390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:23.847017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:23.853733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.854528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:23.855542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:23.856157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.132064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:24.139960 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b7ea9eb-f048-4987-8a37-ee4285761668 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.297065 Jul 30 21:12:24.140676 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1587/3053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:23 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:24.145559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-157351688"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:24.148211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:24.155017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.155750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.156699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.157253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.356472 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70f58b9e-936e-4e59-b23a-c784994572fc tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "POST /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818/action" status: 202 len: 52 microversion: 2.47 time: 0.214482 Jul 30 21:12:24.357274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1588/3054] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:12:24 2022] POST /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818/action => generated 52 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:12:24.362766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:24.363773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:24.370559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.371034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.371910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.372370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.609529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:24.617559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-490c6269-7223-45ac-964d-9507e271268e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.258981 Jul 30 21:12:24.631500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1589/3055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:24 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:24.631500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:24.631500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:24.633948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.634536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.635389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.635837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.671898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:24.762832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-777b1150-0ddf-4731-bd19-cd49a885d5f1 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 204 len: 0 microversion: 2.47 time: 0.143432 Jul 30 21:12:24.763755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1590/3056] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:12:24 2022] DELETE /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:12:24.770020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:24.770839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:24.777714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.778409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:24.779480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:24.780135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:25.395729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:25.408583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:25.417825 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c2233ec-9444-4c7c-903a-4a4c09546d33 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.652719 Jul 30 21:12:25.421291 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1591/3057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:24 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:25.432267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:25.433479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:25.486298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:25.487198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:25.489057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:25.489742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:25.643577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:25.652653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:25.654229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:25.655450 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fbe06272-b065-4de4-8010-a73c06de0a0d tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1365 microversion: 2.47 time: 0.231778 Jul 30 21:12:25.667703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1592/3058] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:25 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:25.678068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:25.678800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:25.685794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:25.686188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:25.687021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:25.687534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:25.918823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.neutron [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] re-assign floating IP 172.35.6.208 from instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d Jul 30 21:12:25.995908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:26.021253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:26.040376 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bfedd98d-964a-4be0-b7bc-288b528f2d8b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.368426 Jul 30 21:12:26.058254 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1593/3059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:25 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:26.072811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:26.074894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:26.090910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.092346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.096100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.098225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.420778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:26.431345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72b60b89-296c-4680-8d64-025292a2fd97 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.371548 Jul 30 21:12:26.432800 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1594/3060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:26 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:26.442504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2ea11925-e3c9-4140-86c0-2403e0f9fe42 req-589982b8-475a-4184-9b2b-e6681596ab19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:26.457760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2ea11925-e3c9-4140-86c0-2403e0f9fe42 req-589982b8-475a-4184-9b2b-e6681596ab19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.458690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2ea11925-e3c9-4140-86c0-2403e0f9fe42 req-589982b8-475a-4184-9b2b-e6681596ab19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.474670 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2ea11925-e3c9-4140-86c0-2403e0f9fe42 req-589982b8-475a-4184-9b2b-e6681596ab19 service nova] Creating event network-changed:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:12:26.480154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2ea11925-e3c9-4140-86c0-2403e0f9fe42 req-589982b8-475a-4184-9b2b-e6681596ab19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045941 Jul 30 21:12:26.480895 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1595/3061] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:26.490382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:26.491371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:26.505774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.506142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.506951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.507438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.720307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Updating instance_info_cache with network_info: [{"id": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3", "address": "fa:16:3e:60:6b:43", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74e8b573-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:26.748511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:26.881306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:26.889630 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5977b126-9e1a-4d24-bd89-d685f4518ab3 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.406891 Jul 30 21:12:26.892553 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1596/3062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:26 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:26.898646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:26.899565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:26.917307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.917774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:26.918572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:26.919012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.045243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:27.057850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:27.060766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:27.062314 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e181eb5-c53f-43e0-8b79-88f7c42efbe6 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1365 microversion: 2.47 time: 0.167717 Jul 30 21:12:27.075978 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1597/3063] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:26 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:27.090832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:27.091515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:27.120288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.120799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.121679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.122130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.432074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:27.455149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-64bb8839-d691-434a-a31f-f1c8e64811fd tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.375789 Jul 30 21:12:27.457057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1598/3064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:27 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:27.461895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:27.473673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:27.487033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.487862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.496602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.499407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.629849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Updating instance_info_cache with network_info: [{"id": "379a4f27-543f-473d-a43d-1a9c19c77e20", "address": "fa:16:3e:77:ac:da", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap379a4f27-54", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:27.650278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Releasing lock "refresh_cache-d0630346-b783-4226-8f47-b3bc085e30e3" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:12:27.652696 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92988e76-fdac-4a96-abea-1420124d8b45 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3/action" status: 202 len: 0 microversion: 2.1 time: 5.324677 Jul 30 21:12:27.654321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1467/3065] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:22 2022] POST /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:12:27.664244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.208"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:27.771359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:27.781370 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-74ccdd3f-67ab-4be7-8441-a981c9a5f8e8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.323005 Jul 30 21:12:27.782317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1599/3066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:27 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:27.847383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:27.855538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.856231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.858984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.859763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.916737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:27.917348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:27.925616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.926111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:27.927013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:27.927773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:28.140601 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] HTTP exception thrown: Floating IP 172.35.6.208 is not associated with instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d. Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Request method failure captured: Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action HTTP/1.1 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 49 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z6Opdou-FMIz-iH7J8OoWH_OVV7ZD24bBPlNaHcFJCd_Y3N1DcWZL5Dgd7RaEW_BmyWmSxeJeyWR6arE_ESa177_fgHTnkxKeKUOduwDu7D4oqsKFGXF3dn9ja4msH76SFWotbKRwTnViArwfrMcNB2jwhf3QsowzedoVYGQT3lbk0 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6c50d273347476986fe5cff264295c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6c50d273347476986fe5cff264295c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d9d75013f5714db097bb2975b57d5328 Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: {"removeFloatingIp": {"address": "172.35.6.208"}} Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: exception: Floating IP 172.35.6.208 is not associated with instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d. Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d', 'body': {'removeFloatingIp': {'address': '172.35.6.208'}}} Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.208 is not associated with instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d. Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.208 is not associated with instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d. Jul 30 21:12:28.142116 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:28.146076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Returning 409 to user: Floating IP 172.35.6.208 is not associated with instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:28.146076 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07af8476-ae68-43ad-b220-dc5fac5c514d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action" status: 409 len: 146 microversion: 2.1 time: 0.485267 Jul 30 21:12:28.147988 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1468/3067] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:27 2022] POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action => generated 146 bytes in 490 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:12:28.154534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:28.155166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:28.162461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:28.162937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:28.164056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:28.164693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:28.255435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:28.287021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ddc9abd0-b744-4222-b8d6-a96fcf55d385 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.373439 Jul 30 21:12:28.290348 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1600/3068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:27 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:28.298527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.208"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:28.320675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:28.335804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:28.339410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f4da0578588431db5da2d58455e8364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa70c1fb55148909a98d8628111983e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:28.342687 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cbd9102b-3170-4b57-bf05-1ba0771744da tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 200 len: 1365 microversion: 2.47 time: 0.192770 Jul 30 21:12:28.359334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1469/3069] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:28 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:28.479325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:28.480308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:28.491541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:28.492216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:28.493201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:28.495863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:28.752496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:28.786222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:28.989451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:29.002011 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed81a63a-45ee-4a3c-b3ad-76a0280ab76f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.525469 Jul 30 21:12:29.005547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1470/3070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:28 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:29.023969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5f2a4221-854b-42c5-8e17-38404c294d41 req-fe3304f9-80a7-40d5-90fe-a486f9a510d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0630346-b783-4226-8f47-b3bc085e30e3", "tag": "379a4f27-543f-473d-a43d-1a9c19c77e20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:29.052108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f2a4221-854b-42c5-8e17-38404c294d41 req-fe3304f9-80a7-40d5-90fe-a486f9a510d5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.054251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f2a4221-854b-42c5-8e17-38404c294d41 req-fe3304f9-80a7-40d5-90fe-a486f9a510d5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.081010 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5f2a4221-854b-42c5-8e17-38404c294d41 req-fe3304f9-80a7-40d5-90fe-a486f9a510d5 service nova] Creating event network-changed:379a4f27-543f-473d-a43d-1a9c19c77e20 for instance d0630346-b783-4226-8f47-b3bc085e30e3 on nch1-master-1 Jul 30 21:12:29.090571 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5f2a4221-854b-42c5-8e17-38404c294d41 req-fe3304f9-80a7-40d5-90fe-a486f9a510d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082484 Jul 30 21:12:29.092081 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1471/3071] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:29.100988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:29.102506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:29.111934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.114175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.116119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.117179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.148455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:29.156437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.157183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.158180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.158802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.421208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:29.813215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Acquired lock "refresh_cache-d0630346-b783-4226-8f47-b3bc085e30e3" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:12:29.886497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:29.904168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5656f62-c637-4343-8a3a-58547010b493 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.810672 Jul 30 21:12:29.904785 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1472/3072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:29 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:29.919698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:29.920306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:29.926616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.927092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:29.927934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:29.928392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:30.466901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:30.477042 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad6fc7e6-897e-4f83-a643-62edda5666f4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.571217 Jul 30 21:12:30.477628 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1473/3073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:29 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:30.482367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:30.482997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] [instance: 5e952c75-b88c-4b44-bee6-b0fe123ce818] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:30.505344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:30.505817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:30.506626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:30.507079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:30.533140 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] HTTP exception thrown: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Request method failure captured: Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 HTTP/1.1 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z6ybS7Y2LPdVL6omatZjIVXZuBZp6rvq5I9AZ9mDyHwGt_DHBxKUgyxAkLVYcllQvhLWNOB1GOK9DTUtRA2PBg_PNi4HEO9yZaH9aUP_bMKrgo6tPsDhGwCy54Zi5vVcveEF1-5Jm8_CDfL1EoEULKdvaMti9iJLG0Mpy7zZIiEr5Y Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.47 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: afa70c1fb55148909a98d8628111983e Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAaction247Test-48527847 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/afa70c1fb55148909a98d8628111983e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_afa70c1fb55148909a98d8628111983e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa70c1fb55148909a98d8628111983e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/afa70c1fb55148909a98d8628111983e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAaction247Test-48527847 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: afa70c1fb55148909a98d8628111983e Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAaction247Test-48527847 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAaction247Test-48527847-project Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8f4da0578588431db5da2d58455e8364 Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAaction247Test-48527847-project Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '5e952c75-b88c-4b44-bee6-b0fe123ce818'} Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:30.536498 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] Returning 404 to user: Instance 5e952c75-b88c-4b44-bee6-b0fe123ce818 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2065160e-d544-42b5-9e27-7920e84ba092 tempest-ServersAaction247Test-48527847 tempest-ServersAaction247Test-48527847-project] 10.222.0.17 "GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818" status: 404 len: 111 microversion: 2.47 time: 0.057682 Jul 30 21:12:30.540917 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1474/3074] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:30 2022] GET /compute/v2.1/servers/5e952c75-b88c-4b44-bee6-b0fe123ce818 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:12:30.545831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-unplugged", "status": "completed", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:30.557575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:30.558426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:30.574325 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] Creating event network-vif-unplugged:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:12:30.581012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] Instance be732443-5139-4e34-8f54-6072d2b0072b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:12:30.594657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-387b23a6-2ba6-405f-a791-53bc0a1d3164 req-cb06a4d9-8954-4a32-8ed2-45b661984d76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056416 Jul 30 21:12:30.596010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1475/3075] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:30.601576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:30.602618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:30.609816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:30.610754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:30.611941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:30.613141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:31.319770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:31.327955 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-742e87ae-0b00-4ae7-a886-3aa09c98146a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.730436 Jul 30 21:12:31.335110 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1476/3076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:30 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:31.340543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:31.347989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:31.355549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:31.360188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:31.361376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:31.362032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:31.600583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:31.613106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-768d2f58-4be2-49ed-b1ff-81526370e6fa tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.276268 Jul 30 21:12:31.614260 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1477/3077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:31 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:31.630178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4784d70f-aaf8-48cb-990e-2281fd2460d7 req-4ff63e5b-e40d-4c9f-8979-cb4a14369438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed8a44b-ef0e-4b0c-b57f-79e3dd896678", "name": "network-vif-plugged", "status": "completed", "tag": "d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:31.654010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4784d70f-aaf8-48cb-990e-2281fd2460d7 req-4ff63e5b-e40d-4c9f-8979-cb4a14369438 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:31.654492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4784d70f-aaf8-48cb-990e-2281fd2460d7 req-4ff63e5b-e40d-4c9f-8979-cb4a14369438 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:31.667030 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4784d70f-aaf8-48cb-990e-2281fd2460d7 req-4ff63e5b-e40d-4c9f-8979-cb4a14369438 service nova] Creating event network-vif-plugged:d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c for instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 on nch2-master-1 Jul 30 21:12:31.672382 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4784d70f-aaf8-48cb-990e-2281fd2460d7 req-4ff63e5b-e40d-4c9f-8979-cb4a14369438 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052480 Jul 30 21:12:31.673781 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1478/3078] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:31.678167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Building network info cache for instance {{(pid=130984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:31.741049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:31.741845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:31.762415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:31.762889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:31.769663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:31.771122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:32.041134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:32.058230 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-facbe3d4-fc37-4a49-9ba3-d2f0c56b66fe tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.382932 Jul 30 21:12:32.061463 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1479/3079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:31 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:32.358655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:32.359307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:32.368933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:32.372853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:32.374974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:32.376496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:32.851854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:32.862901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4abc341c-2ff4-469c-8ea7-7540decce0dc tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.506087 Jul 30 21:12:32.863583 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1480/3080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:32 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:32.871586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:32.878348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:32.895190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:32.898783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:32.902023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:32.902689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.346248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:33.359159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2def59e1-363f-4b66-bfc8-b1a73d17bfab tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1315 microversion: 2.1 time: 0.489595 Jul 30 21:12:33.371832 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1481/3081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:32 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:33.381523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}, {"name": "network-changed", "server_uuid": "d0630346-b783-4226-8f47-b3bc085e30e3", "tag": "379a4f27-543f-473d-a43d-1a9c19c77e20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:33.392872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Updating instance_info_cache with network_info: [{"id": "379a4f27-543f-473d-a43d-1a9c19c77e20", "address": "fa:16:3e:77:ac:da", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap379a4f27-54", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:33.405447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Releasing lock "refresh_cache-d0630346-b783-4226-8f47-b3bc085e30e3" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:12:33.406376 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fdf84533-41e0-4de9-a110-091c865c77ea tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3/action" status: 202 len: 0 microversion: 2.1 time: 5.114639 Jul 30 21:12:33.407703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.408228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.409216 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1601/3082] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:28 2022] POST /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3/action => generated 0 bytes in 5118 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:12:33.416484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:33.435037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Creating event network-changed:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:12:33.436011 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Creating event network-changed:379a4f27-543f-473d-a43d-1a9c19c77e20 for instance d0630346-b783-4226-8f47-b3bc085e30e3 on nch1-master-1 Jul 30 21:12:33.444953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] Instance be732443-5139-4e34-8f54-6072d2b0072b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:12:33.447770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:33.450431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:33.463254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a7c54935-1955-4dca-929b-a2e369db98b8 req-d6bb6907-f82f-4df5-8766-eebae55df855 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.090218 Jul 30 21:12:33.469208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1482/3083] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:33.476540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:33.477609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:33.482016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.482539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.486064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.486816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.487220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.487731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.488604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.489278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.551498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:33.737888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1fd8eaa3-469b-4b53-a6ed-aa476724434d tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 204 len: 0 microversion: 2.1 time: 0.266312 Jul 30 21:12:33.738992 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1483/3084] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:33 2022] DELETE /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:33.759642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.208"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:33.767581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:33.777007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.777839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.778664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.779141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.820532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Acquired lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:12:33.940857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:33.959840 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-daaa2f8e-e195-47cd-a2a9-b2a34093f43c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.546804 Jul 30 21:12:33.960660 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1602/3085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:33 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:33.974819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:33.977844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:33.994057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:33.997620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:33.999988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:34.000679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:34.435532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:34.461899 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dcd17cfb-56cf-4142-b0b0-00023bea02b8 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.498119 Jul 30 21:12:34.466422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1603/3086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:33 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:34.485201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:34.486774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:34.494295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:34.497499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:34.498583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:34.502211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:34.530479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:34.850781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:34.860956 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11325c8a-15f3-46b4-93b7-322283329728 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1503 microversion: 2.1 time: 0.392337 Jul 30 21:12:34.875713 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1604/3087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:34 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:34.882747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:34.883745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:34.890525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:34.891389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:34.892423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:34.893620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:34.919385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'flavor' on Instance uuid 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:35.162642 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53783c33-e4c5-4825-a1d8-ead0d98f5d4b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678/action" status: 202 len: 0 microversion: 2.1 time: 0.283094 Jul 30 21:12:35.167614 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1605/3088] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:34 2022] POST /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:12:35.192028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:35.193079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:35.203569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.204863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:35.207069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.207935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:35.245019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:35.523585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:35.538543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25edcd3d-de70-4598-9d45-e3831394c47c tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.372497 Jul 30 21:12:35.539263 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1606/3089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:35 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:35.548493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:35.551645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:35.564656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.566290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:35.567575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.568251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:35.805530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:35.817208 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd98661e-db3d-444d-abbb-ebfecc53871f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.276796 Jul 30 21:12:35.832673 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1607/3090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:35 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:35.841619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:35.842257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:35.855983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.856356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:35.857170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:35.857631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:36.089912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:36.117892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:36.129117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e79e730-895d-451f-bc59-982754e700eb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1470 microversion: 2.1 time: 0.295505 Jul 30 21:12:36.148628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1608/3091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:35 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:36.159604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8ba8ab61-94be-48b4-a0ec-ea7bb1f04492 req-d735975d-41de-4b54-8918-2d360829bd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:36.183778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ba8ab61-94be-48b4-a0ec-ea7bb1f04492 req-d735975d-41de-4b54-8918-2d360829bd08 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:36.184316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ba8ab61-94be-48b4-a0ec-ea7bb1f04492 req-d735975d-41de-4b54-8918-2d360829bd08 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:36.211032 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8ba8ab61-94be-48b4-a0ec-ea7bb1f04492 req-d735975d-41de-4b54-8918-2d360829bd08 service nova] Creating event network-changed:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:12:36.247597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8ba8ab61-94be-48b4-a0ec-ea7bb1f04492 req-d735975d-41de-4b54-8918-2d360829bd08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096926 Jul 30 21:12:36.250835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1609/3092] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:36.569464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:36.571177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:36.589933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:36.601287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:36.603581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:36.604053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:37.424071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:37.434280 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6752c0d2-ac7c-4c00-9b07-1fca27c43105 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.869983 Jul 30 21:12:37.448327 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1610/3093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:36 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:37.455759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:37.456638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:37.464153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:37.465067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:37.466108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:37.466795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:37.735313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Updating instance_info_cache with network_info: [{"id": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3", "address": "fa:16:3e:60:6b:43", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74e8b573-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:37.802363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Releasing lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:12:37.804272 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-353546f6-9c30-4ae9-b61f-620214d11770 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action" status: 202 len: 0 microversion: 2.1 time: 4.058580 Jul 30 21:12:37.809959 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1484/3094] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:33 2022] POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action => generated 0 bytes in 4065 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:12:37.841185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:37.843855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:37.896816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:37.897298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:37.898117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:37.898576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:38.228957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:38.257163 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20deda85-a62a-45a8-b75a-9a8766cdc36a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1463 microversion: 2.1 time: 0.442314 Jul 30 21:12:38.257974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1485/3095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:37 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1463 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:38.277638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83bd6951-80d9-4d22-8485-1cb6c68b6040 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '.version_select at 0x7fbb5cfe91f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:38.457726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:38.475411 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad94d2b1-0a57-441a-8313-7f4ba9f3b71c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 1.024244 Jul 30 21:12:38.476440 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1611/3096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:37 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:38.504213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:38.507681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:38.521430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:38.551307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:38.552731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:38.553846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:38.922261 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83bd6951-80d9-4d22-8485-1cb6c68b6040 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/dc0052f9-fea5-4263-a1e9-87d215c439b8" status: 200 len: 185 microversion: 2.1 time: 0.660262 Jul 30 21:12:38.923832 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1486/3097] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:12:38 2022] GET /compute/v2.1/os-floating-ips/dc0052f9-fea5-4263-a1e9-87d215c439b8 => generated 185 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:38.930949 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cdf15962-0739-4ac6-a64f-a02fb2455b11 tempest-MigrationsAdminTest-814394737 tempest-MigrationsAdminTest-814394737-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1614 microversion: 2.1 time: 0.452405 Jul 30 21:12:38.935031 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1612/3098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:38 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1614 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:38.950439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:38.952628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8d3dc6fa-e990-47b1-8f0a-2ba092241674 req-a747fe47-21d6-45ab-9b9e-d22bd972f9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0630346-b783-4226-8f47-b3bc085e30e3", "name": "network-vif-deleted", "tag": "379a4f27-543f-473d-a43d-1a9c19c77e20"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:38.953275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:38.986083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:38.991925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:38.994373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:38.996706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.001335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d3dc6fa-e990-47b1-8f0a-2ba092241674 req-a747fe47-21d6-45ab-9b9e-d22bd972f9d0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.002936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d3dc6fa-e990-47b1-8f0a-2ba092241674 req-a747fe47-21d6-45ab-9b9e-d22bd972f9d0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.055834 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8d3dc6fa-e990-47b1-8f0a-2ba092241674 req-a747fe47-21d6-45ab-9b9e-d22bd972f9d0 service nova] Creating event network-vif-deleted:379a4f27-543f-473d-a43d-1a9c19c77e20 for instance d0630346-b783-4226-8f47-b3bc085e30e3 on nch1-master-1 Jul 30 21:12:39.089207 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8d3dc6fa-e990-47b1-8f0a-2ba092241674 req-a747fe47-21d6-45ab-9b9e-d22bd972f9d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152319 Jul 30 21:12:39.090842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1613/3099] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:39.117492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.208"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:39.512060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:39.524411 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a100e3c4-3fec-42cc-9362-89ba69bc5b63 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.598202 Jul 30 21:12:39.527193 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1487/3100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:38 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:39.546407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:39.547236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:39.560181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.562703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.564204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.566135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.595615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:39.610865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.613344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.614945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.617092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.693803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:39.912122 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c699458-7da6-49ea-a2b0-f6e91d6b8236 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 204 len: 0 microversion: 2.1 time: 0.382965 Jul 30 21:12:39.914144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1488/3101] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:39 2022] DELETE /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:39.925500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:39.926509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:39.939746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.940800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:39.941715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:39.942274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:40.266999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Acquired lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:12:40.279997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:40.292061 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07ca4b83-0785-4072-b9f6-42c510f7143f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.376258 Jul 30 21:12:40.292792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1489/3102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:39 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:40.300455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:40.301410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:40.308946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:40.309685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:40.312665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:40.313522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:40.544741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:40.567161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a57385a8-6bb4-4ce2-a618-15267aff2523 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1469 microversion: 2.1 time: 0.273085 Jul 30 21:12:40.575564 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1490/3103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:40 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:40.581757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:40.582604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:40.590131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:40.590925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:40.596685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:40.597230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.082510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:41.094293 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6cdce90c-69d6-45c7-b70b-67b1491e5b84 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.517166 Jul 30 21:12:41.095244 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1491/3104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:40 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:41.314302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:41.315785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:41.323966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.333838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.334973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.335641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.746806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:41.761310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f8203d9-0ea6-4bf4-a96f-477182531f4c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.451058 Jul 30 21:12:41.771658 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1492/3105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:41 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:41.777245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:41.778114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:41.793270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.796770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.797870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.801122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.866176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6e50530-aea5-421a-bd37-32f81f7054da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments/d22ff22c-052a-42ef-9649-a89754fa834d" status: 200 len: 194 microversion: 2.20 time: 0.092886 Jul 30 21:12:41.867036 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1493/3106] 10.222.0.17 () {60 vars in 1454 bytes} [Sat Jul 30 21:12:41 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments/d22ff22c-052a-42ef-9649-a89754fa834d => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:12:41.871535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:41.872172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:41.915438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.915915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:41.916742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:41.917196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.057911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Building network info cache for instance {{(pid=130984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:12:42.361936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:42.369705 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc9fe173-3400-4f3d-b92e-c0a51631c56c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1469 microversion: 2.1 time: 0.501830 Jul 30 21:12:42.385179 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1494/3107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:41 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:42.392840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:42.394167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:42.402848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.403653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.404661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.405780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.543804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:42.548547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lazy-loading 'services' on Instance uuid 2d593494-4b97-4ea2-94ce-724c5346ffd6 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:42.685689 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments/d22ff22c-052a-42ef-9649-a89754fa834d" status: 202 len: 0 microversion: 2.20 time: 0.298226 Jul 30 21:12:42.687897 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1495/3108] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Jul 30 21:12:42 2022] DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments/d22ff22c-052a-42ef-9649-a89754fa834d => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:42.696080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ef85b6a4-5d66-464b-9fb9-197a0298e1aa req-265fcb4f-3b51-49c2-99b5-09f4e774ca49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-plugged", "status": "completed", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:42.715041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef85b6a4-5d66-464b-9fb9-197a0298e1aa req-265fcb4f-3b51-49c2-99b5-09f4e774ca49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.715901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef85b6a4-5d66-464b-9fb9-197a0298e1aa req-265fcb4f-3b51-49c2-99b5-09f4e774ca49 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.733037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ef85b6a4-5d66-464b-9fb9-197a0298e1aa req-265fcb4f-3b51-49c2-99b5-09f4e774ca49 service nova] Creating event network-vif-plugged:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:12:42.739455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ef85b6a4-5d66-464b-9fb9-197a0298e1aa req-265fcb4f-3b51-49c2-99b5-09f4e774ca49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049912 Jul 30 21:12:42.740886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1496/3109] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:42.747069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-74bb8a61-1134-4ca8-97ee-af0835ff3edb req-84b68096-d4ac-413d-9dd5-03fa40bb36f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:42.764308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-74bb8a61-1134-4ca8-97ee-af0835ff3edb req-84b68096-d4ac-413d-9dd5-03fa40bb36f0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.765001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-74bb8a61-1134-4ca8-97ee-af0835ff3edb req-84b68096-d4ac-413d-9dd5-03fa40bb36f0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.784319 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-74bb8a61-1134-4ca8-97ee-af0835ff3edb req-84b68096-d4ac-413d-9dd5-03fa40bb36f0 service nova] Creating event network-changed:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:12:42.792800 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-74bb8a61-1134-4ca8-97ee-af0835ff3edb req-84b68096-d4ac-413d-9dd5-03fa40bb36f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050236 Jul 30 21:12:42.794073 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1497/3110] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:42.803189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:42.804256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:42.811838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.812642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.813677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.814378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.928403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Updating instance_info_cache with network_info: [{"id": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3", "address": "fa:16:3e:60:6b:43", "network": {"id": "ec23a4a5-aac1-4d5c-a634-33223559f0f5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1862225298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b6c50d273347476986fe5cff264295c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74e8b573-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:12:42.949235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Releasing lock "refresh_cache-f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:12:42.951361 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf3f97f9-5775-4bb8-b87e-d776132f791f tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action" status: 202 len: 0 microversion: 2.1 time: 3.859035 Jul 30 21:12:42.952306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1614/3111] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:39 2022] POST /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d/action => generated 0 bytes in 3861 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:12:42.960966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:42.965116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:42.976318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.977300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:42.979048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:42.979950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.062228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-88b75638-1422-447e-9181-f1d27adc0fec tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108351 Jul 30 21:12:43.067815 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1615/3112] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:12:42 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:12:43.073501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:43.074843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:43.083078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.083571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.084368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.084818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.429192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:43.449462 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-482c7f9e-4edc-4a04-a6e0-6a6cfdd23698 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.378817 Jul 30 21:12:43.452085 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1616/3113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:43 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:43.466738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:43.468744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:43.469323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:43.479256 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e31e2b28-0e4a-40d0-bd79-bdbb4b665c45 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.683666 Jul 30 21:12:43.490367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.491164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.491492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1498/3114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:42 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:43.492562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.493209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.499886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-31f9e7cb-5454-4f25-8827-553abce4c2a5 req-1632fc4e-7cca-4d74-8579-d5a09a414cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be732443-5139-4e34-8f54-6072d2b0072b", "name": "network-vif-deleted", "tag": "ceda53c6-2d10-4bd7-be24-892dcf8fb86f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:43.524825 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] HTTP exception thrown: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Request method failure captured: Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 HTTP/1.1 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z6Opdou-FMIz-iH7J8OoWH_OVV7ZD24bBPlNaHcFJCd_Y3N1DcWZL5Dgd7RaEW_BmyWmSxeJeyWR6arE_ESa177_fgHTnkxKeKUOduwDu7D4oqsKFGXF3dn9ja4msH76SFWotbKRwTnViArwfrMcNB2jwhf3QsowzedoVYGQT3lbk0 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6c50d273347476986fe5cff264295c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6c50d273347476986fe5cff264295c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: d9d75013f5714db097bb2975b57d5328 Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd0630346-b783-4226-8f47-b3bc085e30e3'} Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:43.527589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.533423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.538492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Returning 404 to user: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:43.538803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-31f9e7cb-5454-4f25-8827-553abce4c2a5 req-1632fc4e-7cca-4d74-8579-d5a09a414cb7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.539565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-31f9e7cb-5454-4f25-8827-553abce4c2a5 req-1632fc4e-7cca-4d74-8579-d5a09a414cb7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.540079 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f33f0fef-1ef4-4c6e-afbc-a203023a7c68 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 404 len: 111 microversion: 2.1 time: 0.086384 Jul 30 21:12:43.541204 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1617/3115] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:43 2022] DELETE /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:43.550228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:43.551204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:43.567861 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-31f9e7cb-5454-4f25-8827-553abce4c2a5 req-1632fc4e-7cca-4d74-8579-d5a09a414cb7 service nova] Creating event network-vif-deleted:ceda53c6-2d10-4bd7-be24-892dcf8fb86f for instance be732443-5139-4e34-8f54-6072d2b0072b on nch1-master-1 Jul 30 21:12:43.573712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.574474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.575507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.576191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.598391 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-31f9e7cb-5454-4f25-8827-553abce4c2a5 req-1632fc4e-7cca-4d74-8579-d5a09a414cb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105278 Jul 30 21:12:43.599762 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1499/3116] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:43.606735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:43.610557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: d0630346-b783-4226-8f47-b3bc085e30e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:43.642681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.644048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.644306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.645558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lazy-loading 'fault' on Instance uuid be732443-5139-4e34-8f54-6072d2b0072b {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:43.646219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.647139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:43.659960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:43.686138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] HTTP exception thrown: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Request method failure captured: Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 HTTP/1.1 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z6Opdou-FMIz-iH7J8OoWH_OVV7ZD24bBPlNaHcFJCd_Y3N1DcWZL5Dgd7RaEW_BmyWmSxeJeyWR6arE_ESa177_fgHTnkxKeKUOduwDu7D4oqsKFGXF3dn9ja4msH76SFWotbKRwTnViArwfrMcNB2jwhf3QsowzedoVYGQT3lbk0 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6c50d273347476986fe5cff264295c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6c50d273347476986fe5cff264295c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d9d75013f5714db097bb2975b57d5328 Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd0630346-b783-4226-8f47-b3bc085e30e3'} Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.688248 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:43.692914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Returning 404 to user: Instance d0630346-b783-4226-8f47-b3bc085e30e3 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:43.696148 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-97fb7e0c-639a-44a4-8cd6-09ac4bad3f02 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3" status: 404 len: 111 microversion: 2.1 time: 0.094055 Jul 30 21:12:43.697044 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1500/3117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:43 2022] GET /compute/v2.1/servers/d0630346-b783-4226-8f47-b3bc085e30e3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:43.708823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e264ad30-0e8f-44fe-86c9-17f6b9fc099c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '.version_select at 0x7fbb5d7e3310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:43.727771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:43.735725 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-43effe69-2fb6-45b2-8313-b04b7ce068ce tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 200 len: 1303 microversion: 2.1 time: 0.193227 Jul 30 21:12:43.736310 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1618/3118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:43 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:44.075577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:44.077927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:44.090453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.090929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.092404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.092894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.134780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-315fba19-c47f-4378-a1ee-e0c86facb72d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063389 Jul 30 21:12:44.137164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1619/3119] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:12:44 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:44.212430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:44.213149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:44.220074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.220911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.223148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.223942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.264616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:44.392197 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1d406ce-133f-4b3c-bbc9-b8db3adb4661 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 204 len: 0 microversion: 2.20 time: 0.182277 Jul 30 21:12:44.394215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1620/3120] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:12:44 2022] DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 30 21:12:44.403128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:44.404571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:44.412691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.413436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.414776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.415717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.687922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:44.703933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:44.706561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:44.710119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-122847db-7a7b-449d-972f-6162a7cffc99 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.311672 Jul 30 21:12:44.713367 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1621/3121] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:44 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:12:44.721220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:44.728479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:44.740625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.743034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.745342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:44.745937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:44.783990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:45.083429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:45.096546 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c78a9ff8-e7e0-405c-b802-f0b38c78c7de tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.376225 Jul 30 21:12:45.097368 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1622/3122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:44 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:45.108154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:45.109375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:45.128346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.129032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.129950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.130465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.372842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:45.383231 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-326126d9-ac4e-4958-aa87-8a0b6c3399e1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.284639 Jul 30 21:12:45.384334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1623/3123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:45 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:45.390434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:45.391280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: be732443-5139-4e34-8f54-6072d2b0072b] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:45.399046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.399865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.400853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.401520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.421584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] HTTP exception thrown: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Request method failure captured: Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b HTTP/1.1 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2FpxijZdbr6RR50z-q933G4xvZ1fiePAD1Pfzu6CSi1t-TuSY5CoinTAuKGj7s1Dpt5qpKvKZ_SUIXSVOw1rS4S8DrTWw2AlieurrJb_Ma6I6PvcHNTUj0ljodPWPClpuHr4gfXMGAA4DlanUipP_mkXWLt2LpPMR0EENCHn2PzmA Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61ed7d57264748e1907d9c2f3743667a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 25cff561a2d14c45b71920346aee5d57 Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'be732443-5139-4e34-8f54-6072d2b0072b'} Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:45.423463 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. Jul 30 21:12:45.428235 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:12:45.429485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Returning 404 to user: Instance be732443-5139-4e34-8f54-6072d2b0072b could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:45.433098 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7bf7c7d8-0cef-449d-ac7b-ac57ed5f9cdb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b" status: 404 len: 111 microversion: 2.1 time: 0.043992 Jul 30 21:12:45.434141 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1624/3124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:45 2022] GET /compute/v2.1/servers/be732443-5139-4e34-8f54-6072d2b0072b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:45.442155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:45.442748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:45.449317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.449965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.450830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.451374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.492841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:45.603087 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2293f9a5-5692-4f36-b4ef-b709e8aeb3ad tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 204 len: 0 microversion: 2.1 time: 0.163934 Jul 30 21:12:45.604320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1625/3125] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:45 2022] DELETE /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:12:45.614986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:45.615989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:45.623006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.623606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.624513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.625018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.848106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:45.866641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a60db287-7dcb-44db-9a3f-07d540d3e686 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1534 microversion: 2.1 time: 0.257736 Jul 30 21:12:45.867329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1626/3126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:45 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1534 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:45.881810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:45.882437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:45.897687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.898406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:45.899372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:45.899850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.047252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:46.056835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:46.058315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:46.059573 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb8210a1-0f16-4a70-93ba-f496d3af8f7c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.182509 Jul 30 21:12:46.060486 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1627/3127] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:45 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:46.127270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:46.127921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:46.136494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.137548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.138526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.139130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.301282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:46.309585 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4d88b5e-bdb1-4674-b958-53248297d6b6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.191443 Jul 30 21:12:46.310171 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1628/3128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:46 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:46.409491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:46.410387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:46.421781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.422253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.423431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.424148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.614423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e264ad30-0e8f-44fe-86c9-17f6b9fc099c tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/dc0052f9-fea5-4263-a1e9-87d215c439b8" status: 202 len: 0 microversion: 2.1 time: 2.909818 Jul 30 21:12:46.616453 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1501/3129] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:12:43 2022] DELETE /compute/v2.1/os-floating-ips/dc0052f9-fea5-4263-a1e9-87d215c439b8 => generated 0 bytes in 2913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:46.624698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:46.625426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:46.633203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.634016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.634992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.635650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.646294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:46.654876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70aefcfc-9750-43f5-8b96-8162e697c05b tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.250608 Jul 30 21:12:46.655489 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1629/3130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:46 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:46.670004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:46.807598 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8a80a87-e3f5-4518-9927-37ff6049d3fe tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 204 len: 0 microversion: 2.1 time: 0.185757 Jul 30 21:12:46.808990 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1502/3131] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:46 2022] DELETE /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:46.817655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:46.818286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:46.828999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.829468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.830323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.830780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.891336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:46.892170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:46.903238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.904450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:46.905304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:46.905758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.307402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:47.324729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d497ea39-203b-4eb6-bec3-d12889e5a5f3 tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1527 microversion: 2.1 time: 0.510338 Jul 30 21:12:47.327374 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1630/3132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:46 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1527 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:47.332562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:47.334729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:47.349707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.350317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.351134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.351679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.402303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:47.415113 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-65d7c38e-6c63-468d-9647-4790b42e5d6b tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1534 microversion: 2.1 time: 0.528292 Jul 30 21:12:47.415758 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1503/3133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:46 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1534 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:47.429541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:47.430622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:47.448983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.449674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.450670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.452545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.677548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:47.687607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:47.689562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:47.691029 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea40c981-5b1d-498d-9da9-535b43e67b45 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.362311 Jul 30 21:12:47.692059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1631/3134] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:47 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:47.696863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:47.697648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:47.706392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.706971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:47.707886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:47.708674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.003539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:48.014102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b072f81-dd95-4364-98c7-dfdb72c21a5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.596329 Jul 30 21:12:48.017352 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1504/3135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:47 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:48.134496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7ab0aded-138d-4387-981d-0b72c67e4ed0 req-3d0de294-7e6c-4e81-8bc5-afcf1153791c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fa1642-fd0a-433e-886b-9ea8fbad6f07", "name": "network-vif-deleted", "tag": "e4db9ca7-0e53-49cf-bd26-093255b4bdc2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:48.171783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7ab0aded-138d-4387-981d-0b72c67e4ed0 req-3d0de294-7e6c-4e81-8bc5-afcf1153791c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.172567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7ab0aded-138d-4387-981d-0b72c67e4ed0 req-3d0de294-7e6c-4e81-8bc5-afcf1153791c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.191406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:48.206639 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ce05126-d4ed-4b59-8ef5-d9db2d8cb452 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.513190 Jul 30 21:12:48.207414 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1632/3136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:47 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:48.209110 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7ab0aded-138d-4387-981d-0b72c67e4ed0 req-3d0de294-7e6c-4e81-8bc5-afcf1153791c service nova] Creating event network-vif-deleted:e4db9ca7-0e53-49cf-bd26-093255b4bdc2 for instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 on nch1-master-1 Jul 30 21:12:48.215792 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7ab0aded-138d-4387-981d-0b72c67e4ed0 req-3d0de294-7e6c-4e81-8bc5-afcf1153791c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084902 Jul 30 21:12:48.216682 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1505/3137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:48.337156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de790c2-b9e6-4af2-8872-5feb1eaf86f8"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:48.340319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:48.345307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:48.346092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:48.356230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.356230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.356230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.356540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.359909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.367978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.368837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.369306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.836832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:48.850319 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-876a7d91-2e8d-4638-9340-0fde53aa15ee tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1527 microversion: 2.1 time: 0.508772 Jul 30 21:12:48.853022 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1506/3138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:48 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1527 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:48.891545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:48.895024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:48.913108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.913823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.921249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9841283-bd65-4c4a-a8f2-cca30158433a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590907 Jul 30 21:12:48.921894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1633/3139] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:12:48 2022] POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:48.924767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.925272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.938766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:48.939637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:48.970654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.979549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:48.981058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:48.981058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:49.091037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:49.092443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:49.093970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lazy-loading 'fault' on Instance uuid 01fa1642-fd0a-433e-886b-9ea8fbad6f07 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:49.219624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:49.230934 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ef8fab8-9a50-4dca-987f-155310ba0206 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 200 len: 1368 microversion: 2.1 time: 0.358898 Jul 30 21:12:49.234825 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1507/3140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:48 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:49.262567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:49.263365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:49.277466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:49.318958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:49.319888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:49.328520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:49.331546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:49.649500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:49.658805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:49.664154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:49.670116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47fef823-bf9b-4521-8efc-ddeac59823e6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1722 microversion: 2.20 time: 0.746486 Jul 30 21:12:49.671155 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1634/3141] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:48 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1722 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:49.677928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:49.680852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:49.699263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:49.701662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:49.702832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:49.704840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:50.109573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:50.121949 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9735b98b-6781-4954-813e-85d4d29f44ab tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1486 microversion: 2.1 time: 0.447918 Jul 30 21:12:50.124964 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1635/3142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:49 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1486 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:50.416724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-10319458", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "5b5c337d-e3f3-46ad-8dc2-848a2cadbd1b"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:50.513157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] validate_networks() for [('5b5c337d-e3f3-46ad-8dc2-848a2cadbd1b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:12:51.065289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:51.077485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b52b8941-3604-41cd-af30-8105710d560a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 1.830474 Jul 30 21:12:51.096683 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1508/3143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:49 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:51.103351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:51.104542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:51.114263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.115025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.116100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.116782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.157567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.159158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.159965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lazy-loading 'fault' on Instance uuid f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:51.213615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d75013f5714db097bb2975b57d5328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c50d273347476986fe5cff264295c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:51.224634 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b0196ef-2290-412c-ab85-c0ca8b5aa87b tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 200 len: 1314 microversion: 2.1 time: 0.126456 Jul 30 21:12:51.226104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1509/3144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:51 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 1314 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:51.231675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:51.232735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:51.250526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.251368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.253609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.256427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.339400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:12:51.340393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:12:51.341184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:12:51.341832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:12:51.351005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:12:51.374812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.375276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.376111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.376556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.412433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d957b6cc-1e4f-4123-b709-5572d125cfc0 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "POST /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce/action" status: 202 len: 0 microversion: 2.1 time: 0.184520 Jul 30 21:12:51.415325 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1510/3145] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:51 2022] POST /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:51.425455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:51.427115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Getting quotas for project af6c6b5ced854c3ca03b65cb69903ef5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:12:51.427662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 01fa1642-fd0a-433e-886b-9ea8fbad6f07] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:51.448437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Getting quotas for user f89692ad732b4d9f8429659ee6a03a0b and project af6c6b5ced854c3ca03b65cb69903ef5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:12:51.451488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.452936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.454320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.455027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.468717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:12:51.472958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:12:51.532534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] HTTP exception thrown: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Request method failure captured: Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 HTTP/1.1 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z2FpxijZdbr6RR50z-q933G4xvZ1fiePAD1Pfzu6CSi1t-TuSY5CoinTAuKGj7s1Dpt5qpKvKZ_SUIXSVOw1rS4S8DrTWw2AlieurrJb_Ma6I6PvcHNTUj0ljodPWPClpuHr4gfXMGAA4DlanUipP_mkXWLt2LpPMR0EENCHn2PzmA Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61ed7d57264748e1907d9c2f3743667a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 25cff561a2d14c45b71920346aee5d57 Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '01fa1642-fd0a-433e-886b-9ea8fbad6f07'} Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:51.543129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Returning 404 to user: Instance 01fa1642-fd0a-433e-886b-9ea8fbad6f07 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-59a0f4aa-18e5-4984-b1e6-f0a5aa7da98c tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07" status: 404 len: 111 microversion: 2.1 time: 0.131249 Jul 30 21:12:51.550759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1511/3146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:51 2022] GET /compute/v2.1/servers/01fa1642-fd0a-433e-886b-9ea8fbad6f07 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:51.560703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-58da91c7-8f03-4416-9bb6-372c519577b5 req-3f8816e4-4dbf-4468-a625-6e76f47228a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d", "name": "network-vif-deleted", "tag": "74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:51.587209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58da91c7-8f03-4416-9bb6-372c519577b5 req-3f8816e4-4dbf-4468-a625-6e76f47228a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.591075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58da91c7-8f03-4416-9bb6-372c519577b5 req-3f8816e4-4dbf-4468-a625-6e76f47228a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.594493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9dd66894-8233-480d-a1e4-35c7318f7706 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464036 Jul 30 21:12:51.595434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1636/3147] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:12:51.609627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:51.610628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:51.622826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.623323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.632399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.633077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.659717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-58da91c7-8f03-4416-9bb6-372c519577b5 req-3f8816e4-4dbf-4468-a625-6e76f47228a6 service nova] Creating event network-vif-deleted:74e8b573-3dcd-47f5-8bbe-77a9f2dbadf3 for instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d on nch2-master-1 Jul 30 21:12:51.687001 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-58da91c7-8f03-4416-9bb6-372c519577b5 req-3f8816e4-4dbf-4468-a625-6e76f47228a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136026 Jul 30 21:12:51.688356 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1512/3148] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:51.698662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:51.709745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5bb435b5-6623-4503-b7ef-7c8c3ffa85d8 req-5411c5eb-e783-4468-802a-d0447849e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d593494-4b97-4ea2-94ce-724c5346ffd6", "name": "network-vif-deleted", "tag": "84130dc6-ae49-448e-a01c-a4e0d47921ed"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:51.724055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5bb435b5-6623-4503-b7ef-7c8c3ffa85d8 req-5411c5eb-e783-4468-802a-d0447849e5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.724446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5bb435b5-6623-4503-b7ef-7c8c3ffa85d8 req-5411c5eb-e783-4468-802a-d0447849e5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.746644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5bb435b5-6623-4503-b7ef-7c8c3ffa85d8 req-5411c5eb-e783-4468-802a-d0447849e5e1 service nova] Creating event network-vif-deleted:84130dc6-ae49-448e-a01c-a4e0d47921ed for instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 on nch1-master-1 Jul 30 21:12:51.764794 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5bb435b5-6623-4503-b7ef-7c8c3ffa85d8 req-5411c5eb-e783-4468-802a-d0447849e5e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074986 Jul 30 21:12:51.765744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1513/3149] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:51.776360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:51.777094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:51.790496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.796234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.797421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.800570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.817987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:51.818522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:51.819107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lazy-loading 'fault' on Instance uuid 2d593494-4b97-4ea2-94ce-724c5346ffd6 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:51.988229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.027253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.029041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.030256 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3caf0d8e-461e-47e3-aec6-812982390925 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 200 len: 1370 microversion: 2.20 time: 0.425865 Jul 30 21:12:52.041307 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1637/3150] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:51 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 1370 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:12:52.054189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e80f13f4-482c-42fb-b4ac-3891ddf40b46 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '.version_select at 0x7fbb62883160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:52.122280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.128715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:52.128956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:52.138669 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d4b18638-c6fc-4dbb-b9be-bd2a16de4519 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1494 microversion: 2.1 time: 0.371458 Jul 30 21:12:52.153927 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1514/3151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:51 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1494 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:52.154132 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e80f13f4-482c-42fb-b4ac-3891ddf40b46 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302841326" status: 202 len: 0 microversion: 2.1 time: 0.110722 Jul 30 21:12:52.155352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1638/3152] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302841326 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:12:52.180437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:52.181445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:52.181879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a18b71e8-fd29-4e52-bd02-e434a70866b2 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:52.182806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a18b71e8-fd29-4e52-bd02-e434a70866b2 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:52.214917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:52.217265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:52.218381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:52.218846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:52.431114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a18b71e8-fd29-4e52-bd02-e434a70866b2 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.451097 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a18b71e8-fd29-4e52-bd02-e434a70866b2 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1223 microversion: 2.1 time: 0.290049 Jul 30 21:12:52.454734 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1515/3153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:52 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1223 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:52.471321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:52.472980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] [instance: f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:52.496584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:52.499847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:52.504966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:52.519249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:52.589595 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] HTTP exception thrown: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Request method failure captured: Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d HTTP/1.1 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z6Opdou-FMIz-iH7J8OoWH_OVV7ZD24bBPlNaHcFJCd_Y3N1DcWZL5Dgd7RaEW_BmyWmSxeJeyWR6arE_ESa177_fgHTnkxKeKUOduwDu7D4oqsKFGXF3dn9ja4msH76SFWotbKRwTnViArwfrMcNB2jwhf3QsowzedoVYGQT3lbk0 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6c50d273347476986fe5cff264295c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6c50d273347476986fe5cff264295c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6c50d273347476986fe5cff264295c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b6c50d273347476986fe5cff264295c0 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1121280530 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: d9d75013f5714db097bb2975b57d5328 Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1121280530-project Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d'} Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:52.594126 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. Jul 30 21:12:52.599133 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:52.615363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] Returning 404 to user: Instance f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:52.616796 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-af64b0e7-c9df-4289-b302-79e67ff0963a tempest-FloatingIPsAssociationTestJSON-1121280530 tempest-FloatingIPsAssociationTestJSON-1121280530-project] 10.222.0.17 "GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d" status: 404 len: 111 microversion: 2.1 time: 0.160138 Jul 30 21:12:52.623490 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1516/3154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:52 2022] GET /compute/v2.1/servers/f0d62eb0-6f6c-4fa4-9cbf-ef571dcca57d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:12:52.872072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:52.890732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b0497c3-d23b-4c98-b8f9-1fa9f6c91913 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.733793 Jul 30 21:12:52.891548 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1639/3155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:52 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:53.067502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:53.068970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:53.084834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.092666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.093667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.103386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.136430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 HTTP/1.1 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2d593494-4b97-4ea2-94ce-724c5346ffd6'} Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:53.138013 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:12:53.143434 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-292389da-8f84-4372-8905-5459dc2e4f91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 404 len: 111 microversion: 2.20 time: 0.077160 Jul 30 21:12:53.149110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6635f082-72e5-4a2a-9b25-59cca3e0d218 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '.version_select at 0x7fbb5c66be50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:53.157829 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1517/3156] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:12:53 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:12:53.173553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:53.175995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:53.184800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6635f082-72e5-4a2a-9b25-59cca3e0d218 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931599014" status: 204 len: 0 microversion: 2.20 time: 0.039416 Jul 30 21:12:53.185794 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1640/3157] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Jul 30 21:12:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931599014 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:12:53.191720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.192372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.193362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.193958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.479133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:53.479920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:53.488246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.508678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.522656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.523216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.826845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:53.841684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e62d76f-9334-49aa-ad7a-5679fa52bf5b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1275 microversion: 2.1 time: 0.366767 Jul 30 21:12:53.847674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1641/3158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:53 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:53.895979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:53.914533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:53.915766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:53.919674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2c3237d-cb25-40b8-b51e-40aa7e8ab5ca tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1494 microversion: 2.1 time: 0.753394 Jul 30 21:12:53.925799 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1518/3159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:53 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:53.955355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.956059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:53.957010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:53.957477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.021939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:54.030913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:54.058522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.064430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.065651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.066184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.144512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'flavor' on Instance uuid 4cd003b4-169a-47b3-b40c-d50ef73a312a {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:12:54.441411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:54.451025 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-71b6a7e4-267f-4bb1-8db6-ef9358a32153 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/action" status: 200 len: 32 microversion: 2.1 time: 0.436043 Jul 30 21:12:54.458671 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1519/3160] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:12:54 2022] POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:12:54.465475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0770e602-3ad0-4001-bce8-10d855931319 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.541800 Jul 30 21:12:54.466158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1642/3161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:53 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:54.469663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:54.473810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:54.488886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.489532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.493689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.494198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.869353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:54.870585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:54.887869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.888727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:54.890450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:54.891442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.045629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:55.060878 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1347e20-e463-4366-876e-8c1928cca86f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.601547 Jul 30 21:12:55.063253 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1520/3162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:54 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:55.088767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:55.093640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:55.108052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.108818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.110575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.112290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.320698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:55.335040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-458f1e9f-5dbb-48b2-871c-65d24f920128 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1281 microversion: 2.1 time: 0.471301 Jul 30 21:12:55.336591 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1643/3163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:54 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:55.405603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:55.406122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:55.420876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.421078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.421861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.422316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.462362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:55.474336 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4dc781d6-eb87-4092-add3-b512f00586bf tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1494 microversion: 2.1 time: 0.396342 Jul 30 21:12:55.474953 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1521/3164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:55 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1494 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:55.490140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:55.490577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:55.492599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:55.508099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.508827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.511930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.512646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.647603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-01c92e56-a260-4a6e-b01d-39f545430d93 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 204 len: 0 microversion: 2.1 time: 0.245408 Jul 30 21:12:55.651352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1644/3165] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:55 2022] DELETE /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:12:55.659426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:55.660719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:55.668972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.669542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.670998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:55.672040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:55.862287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:55.878876 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-582fc275-ede2-4fc5-8d4b-64c7110a3118 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.389782 Jul 30 21:12:55.880233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1522/3166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:55 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:56.060671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:56.068974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cebed071-efec-4e35-b405-ebfdb1d8aa27 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1467 microversion: 2.1 time: 0.415459 Jul 30 21:12:56.079585 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1645/3167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:55 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1467 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:56.088897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:56.089883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:56.098052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.098805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.099666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.100128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.362050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:56.365685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:56.377536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.380538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.381503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.390123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.684549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:56.700877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-beb94440-ff24-4a29-85c5-fa63bb2f269c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.615784 Jul 30 21:12:56.701486 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1523/3168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:56 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:56.710970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0ced3c8-f961-451a-b492-b91b17b19cb0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: .version_select at 0x7fbb5dc480d0>, body: {"keypair": {"name": "tempest-keypair-2075932922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq6xSXeGPRhwFzviDgy54oFefIu0YL1s31YV88i+RcoWCkQTTZTBT3cSZt5GDcBno4/4XkklmnifVpK//7fE58MFk9Wxlf62HcsCu+XecRgry3x6oHK5jaAQgDVOoXOhQ=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:56.754745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b0ced3c8-f961-451a-b492-b91b17b19cb0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for project 2b4c650076ad4077874a72f6e64461f3. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:12:56.763015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:56.765126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b0ced3c8-f961-451a-b492-b91b17b19cb0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for user f00d46cd63d94b49abfa65d6106c7d88 and project 2b4c650076ad4077874a72f6e64461f3. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:12:56.775205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d915b82-d135-4858-b705-c357f4d7ba75 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.417614 Jul 30 21:12:56.795615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1646/3169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:56 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:56.809925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:56.812802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:56.832744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.835127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.835980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.838271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.857233 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0ced3c8-f961-451a-b492-b91b17b19cb0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.153622 Jul 30 21:12:56.859716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1524/3170] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:12:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:12:56.900712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:56.901612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:56.917202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.920283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:56.924502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:56.925156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.265530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:57.277840 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1870ce43-1fdb-47a7-a8ec-1a35fbadfde5 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1500 microversion: 2.1 time: 0.480747 Jul 30 21:12:57.279701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1647/3171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:56 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1500 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:57.313300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:57.317031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:57.325539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.326283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.327238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.327865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.700181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:57.710372 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-603af6ea-d6e5-4252-910b-3cd4b8d4a569 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1467 microversion: 2.1 time: 0.416996 Jul 30 21:12:57.712092 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1648/3172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:57 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1467 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:57.720613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:57.721459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:57.729562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.730408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.731279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.731846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.755564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:57.775332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:12:57.784051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-111149d6-3c3e-4a3c-b885-438b32e400bf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.883541 Jul 30 21:12:57.785474 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1525/3173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:56 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:57.791517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:57.794746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:57.804754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.807335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.808651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.809727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.916549 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1924eb6e-63b5-4181-8fe4-edee07c49065 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 204 len: 0 microversion: 2.1 time: 0.202676 Jul 30 21:12:57.921812 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1649/3174] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:12:57 2022] DELETE /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:12:57.932688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:57.933658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:57.942869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.943401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:57.944621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:57.945247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.243185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:58.251641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7879e83e-48bf-417a-aa81-971094307e23 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.328073 Jul 30 21:12:58.260159 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1650/3175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:57 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:58.265796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:58.272331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:58.274493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:58.279337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49944d59-fadd-4698-99c6-b4e6b92df42e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.491786 Jul 30 21:12:58.281261 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1526/3176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:57 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:58.286135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.286949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.288729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.289355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.345595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2f3b7093-8b22-4841-8a1b-7d541462ed09 req-14e37e63-03a4-445c-abd3-9a689f8e2140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545981a3-0424-40b7-8988-54421b666879", "name": "network-vif-deleted", "tag": "b982f876-9475-4b33-878b-75788d99699d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:58.364842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2f3b7093-8b22-4841-8a1b-7d541462ed09 req-14e37e63-03a4-445c-abd3-9a689f8e2140 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.365633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2f3b7093-8b22-4841-8a1b-7d541462ed09 req-14e37e63-03a4-445c-abd3-9a689f8e2140 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.379106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2f3b7093-8b22-4841-8a1b-7d541462ed09 req-14e37e63-03a4-445c-abd3-9a689f8e2140 service nova] Creating event network-vif-deleted:b982f876-9475-4b33-878b-75788d99699d for instance 545981a3-0424-40b7-8988-54421b666879 on nch2-master-1 Jul 30 21:12:58.384645 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2f3b7093-8b22-4841-8a1b-7d541462ed09 req-14e37e63-03a4-445c-abd3-9a689f8e2140 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043288 Jul 30 21:12:58.385839 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1527/3177] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:12:58.629851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:58.638447 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee9692bf-f3a1-4bd3-b8f7-decdca913c70 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.376789 Jul 30 21:12:58.649179 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1651/3178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:58 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:58.737945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:58.738674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:58.749676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.754677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.755576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.756046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.808253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:58.808900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:58.822888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.823667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.824482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:58.824943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:58.860180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:58.969757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:58.983218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-852de366-1147-4233-b2c1-bff64bdef2de tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1425 microversion: 2.1 time: 0.250703 Jul 30 21:12:58.984238 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1528/3179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:58 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1425 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:59.047938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5c68f2ca-bd29-4dd7-a18c-63f82137b45b req-e4ed5e12-9ed4-4f46-af53-c23b4d028ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba4857f-e048-4984-8f05-ae8eb327b1b8", "tag": "fec4ebc8-5f21-411f-be32-6048d4c583f8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:12:59.065206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5c68f2ca-bd29-4dd7-a18c-63f82137b45b req-e4ed5e12-9ed4-4f46-af53-c23b4d028ab4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.066609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5c68f2ca-bd29-4dd7-a18c-63f82137b45b req-e4ed5e12-9ed4-4f46-af53-c23b4d028ab4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.093452 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5c68f2ca-bd29-4dd7-a18c-63f82137b45b req-e4ed5e12-9ed4-4f46-af53-c23b4d028ab4 service nova] Creating event network-changed:fec4ebc8-5f21-411f-be32-6048d4c583f8 for instance aba4857f-e048-4984-8f05-ae8eb327b1b8 on nch1-master-1 Jul 30 21:12:59.102417 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5c68f2ca-bd29-4dd7-a18c-63f82137b45b req-e4ed5e12-9ed4-4f46-af53-c23b4d028ab4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059581 Jul 30 21:12:59.104192 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1529/3180] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:12:59.217254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:59.230008 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-24602e2c-96f5-4df5-b531-43698d26313f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.425207 Jul 30 21:12:59.247322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1652/3181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:58 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:12:59.285648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:59.286377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:59.295862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.296601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.297586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.298168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.306405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:59.307070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:59.318274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.319502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.321811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.322780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.519686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:59.533888 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18f7626b-60c3-4fa5-9b24-59acb3a8a017 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.231232 Jul 30 21:12:59.534603 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1653/3182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:59 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:12:59.661974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:12:59.663060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:12:59.677767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.678740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.679743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:12:59.680454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:12:59.962869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:12:59.974751 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad9fa99f-6b73-4936-803c-bb65be190a19 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.696566 Jul 30 21:12:59.988573 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1530/3183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:59 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:00.003525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:00.014441 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8bacbec1-6df5-474a-ab9f-1c06910e61cd tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.352825 Jul 30 21:13:00.016459 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1654/3184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:12:59 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:00.018085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:00.018748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:00.031080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.035745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.036627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.037123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.164064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:00.178062 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9dc7950-b8f1-452d-8427-3e89263e75bb tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1425 microversion: 2.1 time: 0.172082 Jul 30 21:13:00.179306 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1531/3185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:00 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1425 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:00.260361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:00.261003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:00.274561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.275512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.281951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.284399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.558242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:00.559251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:00.573738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.574605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.575666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:00.576551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:00.678355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:00.696120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f93a413d-e72a-4006-8ef5-bb1b015fcce9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.439752 Jul 30 21:13:00.717968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1655/3186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:00 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:01.005312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:01.006047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:01.022841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.023437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.026323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.026972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.181984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:01.201143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee802ab5-99b9-4983-8ceb-0562cab8dbc2 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.647150 Jul 30 21:13:01.211822 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1532/3187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:00 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:01.226642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:01.227705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:01.248991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.249803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.250773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.251398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.339173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:01.354054 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f22eb79c-0d17-4072-8632-023205a8e796 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.355028 Jul 30 21:13:01.354977 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1656/3188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:00 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:01.363809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:01.368607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:01.381878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.386954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.388028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.388758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.404142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:01.479819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:01.529025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.529703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.530352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lazy-loading 'fault' on Instance uuid 545981a3-0424-40b7-8988-54421b666879 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:13:01.655154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:01.663951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b9f94557-eebf-423c-99a8-4c254ccd9a1f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 200 len: 1303 microversion: 2.1 time: 0.304127 Jul 30 21:13:01.670610 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1657/3189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:01 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:01.740515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:01.741484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:01.761771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.762257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.774853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:01.780271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:01.780271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:01.790270 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b23844a3-db8b-4e70-a2e5-02636d2ced30 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1506 microversion: 2.1 time: 0.576071 Jul 30 21:13:01.792101 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1533/3190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:01 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:02.230944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:02.231549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:02.247909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.248697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.249793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.250794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.261404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:02.303552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:02.314482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d25ef800-6bcc-41b3-a1b1-dfe8feac9ff3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.579689 Jul 30 21:13:02.316884 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1658/3191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:01 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:02.375329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:02.376263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:02.390272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.391120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.392172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.392912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.754578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:02.775358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed8579ac-cb52-4956-8a4a-63224bbd992e tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.403079 Jul 30 21:13:02.776655 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1659/3192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:02 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:02.782654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a29d04ee-45f3-4d62-8f65-9209826b1fb3 req-4509ba26-e49c-4eb6-bd41-129d4267e1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c340ed-f101-4df1-ae45-7124b8c144ce", "name": "network-vif-deleted", "tag": "2001fb80-09c8-4828-909d-db7cd072c7ac"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:02.797669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a29d04ee-45f3-4d62-8f65-9209826b1fb3 req-4509ba26-e49c-4eb6-bd41-129d4267e1e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.798469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a29d04ee-45f3-4d62-8f65-9209826b1fb3 req-4509ba26-e49c-4eb6-bd41-129d4267e1e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.815782 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a29d04ee-45f3-4d62-8f65-9209826b1fb3 req-4509ba26-e49c-4eb6-bd41-129d4267e1e3 service nova] Creating event network-vif-deleted:2001fb80-09c8-4828-909d-db7cd072c7ac for instance a0c340ed-f101-4df1-ae45-7124b8c144ce on nch2-master-1 Jul 30 21:13:02.825776 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a29d04ee-45f3-4d62-8f65-9209826b1fb3 req-4509ba26-e49c-4eb6-bd41-129d4267e1e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046715 Jul 30 21:13:02.831834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1660/3193] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:02.839769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:02.840668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: 545981a3-0424-40b7-8988-54421b666879] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:02.851109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.851605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.852452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.852909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.879329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] HTTP exception thrown: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Request method failure captured: Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 HTTP/1.1 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2FpxijZdbr6RR50z-q933G4xvZ1fiePAD1Pfzu6CSi1t-TuSY5CoinTAuKGj7s1Dpt5qpKvKZ_SUIXSVOw1rS4S8DrTWw2AlieurrJb_Ma6I6PvcHNTUj0ljodPWPClpuHr4gfXMGAA4DlanUipP_mkXWLt2LpPMR0EENCHn2PzmA Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61ed7d57264748e1907d9c2f3743667a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 25cff561a2d14c45b71920346aee5d57 Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '545981a3-0424-40b7-8988-54421b666879'} Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:02.881072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Returning 404 to user: Instance 545981a3-0424-40b7-8988-54421b666879 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:02.885658 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf70be41-0bcd-496b-8b32-16a5cc63c4f4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879" status: 404 len: 111 microversion: 2.1 time: 0.049335 Jul 30 21:13:02.899805 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1661/3194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:02 2022] GET /compute/v2.1/servers/545981a3-0424-40b7-8988-54421b666879 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:02.908580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:02.909227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:02.929275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.932134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:02.933056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:02.933656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.020783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.021248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.021717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lazy-loading 'fault' on Instance uuid a0c340ed-f101-4df1-ae45-7124b8c144ce {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:13:03.089518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:03.106335 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dee937cb-aa9f-4949-a32d-84eb2fadbd67 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 200 len: 1304 microversion: 2.1 time: 0.205017 Jul 30 21:13:03.107269 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1662/3195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:02 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:03.113486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:03.114267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:03.121107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.121903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.123481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.124308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.181560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:13:03.382387 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86818562-87eb-4836-8a23-11646af03784 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 204 len: 0 microversion: 2.1 time: 0.273411 Jul 30 21:13:03.383662 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1663/3196] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:13:03 2022] DELETE /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:13:03.401624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:03.402288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:03.419883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.420709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.424380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.425083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.692493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:03.708153 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-208b1cd7-5796-4dfa-acd3-d8e92b13f506 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 1.484841 Jul 30 21:13:03.713143 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1534/3197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:02 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:03.727098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:03.734743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:03.765039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.769996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.775856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.776076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.813805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:03.828926 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e72cf0b0-6b56-45b4-9191-2102b851ddd1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.442165 Jul 30 21:13:03.831046 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1664/3198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:03 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:03.848053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:03.873608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:03.886392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.894234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:03.895711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:03.897403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.260584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:04.262718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:04.272527 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-340f354d-4fce-4673-aaa8-73524b1d1980 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.434042 Jul 30 21:13:04.284828 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1665/3199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:03 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:04.287611 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8dbaed70-0ae2-4535-bf44-fafea62f7b8f tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1468 microversion: 2.1 time: 0.568020 Jul 30 21:13:04.291328 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1535/3200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:03 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1468 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:04.295440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:04.296335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: a0c340ed-f101-4df1-ae45-7124b8c144ce] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:04.305469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.308169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.310008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.311735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.334333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] HTTP exception thrown: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Request method failure captured: Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce HTTP/1.1 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5PwROgeWDHn1X5NR30sxR4ZPgQNHP8PLfsS9dSdvU90TIAXrymrqvIS6MO9FBylyB1EcGNhN9nk_Thx3rJQgCNTGMBAFKpT-LmHRuBYHaLb1bEQagxf6nsa_tpkOnmiBtJq8FPwxiiud66F-6zloTe2ktX0BR3rZSX0-hJ0QY6AVQ Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7e9653a81a694ec29d1fcfe2da97eaa3 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e9653a81a694ec29d1fcfe2da97eaa3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7e9653a81a694ec29d1fcfe2da97eaa3 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueTestJSON-792403752-project Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 36fe4dfa0f564eedb8deb3491a5068a5 Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueTestJSON-792403752-project Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'a0c340ed-f101-4df1-ae45-7124b8c144ce'} Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:04.336594 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Returning 404 to user: Instance a0c340ed-f101-4df1-ae45-7124b8c144ce could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3142541-11d9-406f-88fc-112761c2d5dc tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce" status: 404 len: 111 microversion: 2.1 time: 0.052531 Jul 30 21:13:04.341104 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1666/3201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:04 2022] GET /compute/v2.1/servers/a0c340ed-f101-4df1-ae45-7124b8c144ce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:04.349347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:04.349943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:04.358259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.358801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.360018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.360540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.413502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:13:04.471848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:04.567190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-837b01d3-9ff7-44b6-af8f-13313045c8d1 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "DELETE /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 204 len: 0 microversion: 2.1 time: 0.223236 Jul 30 21:13:04.571271 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1667/3202] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:13:04 2022] DELETE /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:13:04.582364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:04.583095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:04.610192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.610667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.611576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:04.612038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:04.629382 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fabdea6b-fb18-447a-8e91-9cbbdaefc38b tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.336708 Jul 30 21:13:04.634933 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1536/3203] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Jul 30 21:13:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 21:13:04.644056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82bdebf7-9576-4e8a-b2e5-24deb6793675 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Calling method '.version_select at 0x7fbb5cef44c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:04.708608 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-82bdebf7-9576-4e8a-b2e5-24deb6793675 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] HTTP exception thrown: Image not found. Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82bdebf7-9576-4e8a-b2e5-24deb6793675 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Request method failure captured: Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7gmz5hT2SF8A1DnX3iTb9VSUepc5-Lks5nSaojNcJWboSCgqZGt3AnoTAPjxgWa59xFcHWhPvFt8CrNoBsxadie8PjKUWGE9nmz8DmA8tRfzInz3JztbSYjxZLTQ_As3-Ek3sL-gH0FETWhNddGw8xTOeLx1wBMxvNpuC4iEbXF7k Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_006af94f365f4f6a90a0ff8b1d36e9f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a81f365477344b77a90b286c6b80d169 Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '-1'} Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.722471 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:04.727598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:04.731651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82bdebf7-9576-4e8a-b2e5-24deb6793675 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:04.733339 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82bdebf7-9576-4e8a-b2e5-24deb6793675 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.097296 Jul 30 21:13:04.734208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1537/3204] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:13:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:04.745965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1958937438", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4a92aec-0588-4592-82ad-0035b1652de3"}], "security_groups": [{"name": "tempest-securitygroup--954215066"}], "key_name": "tempest-keypair-2075932922", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:04.921756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] validate_networks() for [('b4a92aec-0588-4592-82ad-0035b1652de3', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:13:05.354367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:05.367885 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfeeaf07-b467-4a5b-a2dd-ca5ae5c1b3a4 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1493 microversion: 2.1 time: 0.791766 Jul 30 21:13:05.377592 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1668/3205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:04 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1493 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:05.387694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:05.396291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:05.404036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.404929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.405829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.406614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.453428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:05.453936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:05.454434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:05.454893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:05.455348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:05.464674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.465142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.465966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.466423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.486751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for project 2b4c650076ad4077874a72f6e64461f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:05.492432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Getting quotas for user f00d46cd63d94b49abfa65d6106c7d88 and project 2b4c650076ad4077874a72f6e64461f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:05.506260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:13:05.509060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:13:05.563270 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7fb480d-9e7e-4fa8-8cce-5a12ef728312 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.827534 Jul 30 21:13:05.565839 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1538/3206] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:13:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:13:05.575879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56f85291-6181-4cab-8d8b-3af18f3db3c9 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Calling method '.version_select at 0x7fbb62ac8dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:05.612368 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-56f85291-6181-4cab-8d8b-3af18f3db3c9 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] HTTP exception thrown: Image not found. Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56f85291-6181-4cab-8d8b-3af18f3db3c9 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Request method failure captured: Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/19418601-737f-4b20-873b-394a93377d0j HTTP/1.1 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7gmz5hT2SF8A1DnX3iTb9VSUepc5-Lks5nSaojNcJWboSCgqZGt3AnoTAPjxgWa59xFcHWhPvFt8CrNoBsxadie8PjKUWGE9nmz8DmA8tRfzInz3JztbSYjxZLTQ_As3-Ek3sL-gH0FETWhNddGw8xTOeLx1wBMxvNpuC4iEbXF7k Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_006af94f365f4f6a90a0ff8b1d36e9f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a81f365477344b77a90b286c6b80d169 Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '19418601-737f-4b20-873b-394a93377d0j'} Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 19418601-737f-4b20-873b-394a93377d0j to delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19418601-737f-4b20-873b-394a93377d0j could not be found. Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:05.616130 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56f85291-6181-4cab-8d8b-3af18f3db3c9 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56f85291-6181-4cab-8d8b-3af18f3db3c9 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/19418601-737f-4b20-873b-394a93377d0j" status: 404 len: 62 microversion: 2.1 time: 0.051947 Jul 30 21:13:05.624780 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1539/3207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:05 2022] DELETE /compute/v2.1/images/19418601-737f-4b20-873b-394a93377d0j => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:05.641549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:05.642706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:05.666643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.671902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.673112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.673870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.768922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:05.785142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc408f6a-1b44-4674-ab2c-99d4eea34177 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.406121 Jul 30 21:13:05.786158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1669/3208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:05 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:05.790628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:05.791278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:05.806950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.807466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.808273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.808731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.855200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:05.864758 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f7dcbec-2b1f-4b76-ba39-3abca7e6a6d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1509 microversion: 2.1 time: 0.242796 Jul 30 21:13:05.866003 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1540/3209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:05 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:05.871572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:05.872542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:05.880982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.881925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:05.882889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:05.883454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.063147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cff561a2d14c45b71920346aee5d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ed7d57264748e1907d9c2f3743667a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.072795 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27d440b5-6e7b-4b0c-a68a-49419d31a8e4 tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 200 len: 1468 microversion: 2.1 time: 0.205212 Jul 30 21:13:06.086834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1541/3210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:05 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:06.086834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.086834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:06.141726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.150238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.151936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.153069 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c28757de-9299-4563-826e-a8037d5d5c53 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1282 microversion: 2.20 time: 0.078062 Jul 30 21:13:06.153893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1542/3211] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:06 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:06.158232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48c6419d-b3c3-4276-8638-7f1fb5dba5fc tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Calling method '.version_select at 0x7fbb629e2700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.176521 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-48c6419d-b3c3-4276-8638-7f1fb5dba5fc tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] HTTP exception thrown: Image not found. Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48c6419d-b3c3-4276-8638-7f1fb5dba5fc tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Request method failure captured: Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/e08b19fb-3d37-4adc-ac71-cffdba540fb31 HTTP/1.1 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7gmz5hT2SF8A1DnX3iTb9VSUepc5-Lks5nSaojNcJWboSCgqZGt3AnoTAPjxgWa59xFcHWhPvFt8CrNoBsxadie8PjKUWGE9nmz8DmA8tRfzInz3JztbSYjxZLTQ_As3-Ek3sL-gH0FETWhNddGw8xTOeLx1wBMxvNpuC4iEbXF7k Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_006af94f365f4f6a90a0ff8b1d36e9f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a81f365477344b77a90b286c6b80d169 Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e08b19fb-3d37-4adc-ac71-cffdba540fb31'} Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e08b19fb-3d37-4adc-ac71-cffdba540fb31 to delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e08b19fb-3d37-4adc-ac71-cffdba540fb31 could not be found. Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.178491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:06.183028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.187662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48c6419d-b3c3-4276-8638-7f1fb5dba5fc tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:06.188869 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48c6419d-b3c3-4276-8638-7f1fb5dba5fc tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/e08b19fb-3d37-4adc-ac71-cffdba540fb31" status: 404 len: 62 microversion: 2.1 time: 0.034256 Jul 30 21:13:06.190455 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1543/3212] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:13:06 2022] DELETE /compute/v2.1/images/e08b19fb-3d37-4adc-ac71-cffdba540fb31 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:06.197433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2220b826-9266-40c0-829d-f3eb51fc04a4 req-e4739137-93f3-4648-a250-d5d2a5defc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba4857f-e048-4984-8f05-ae8eb327b1b8", "name": "network-vif-plugged", "status": "completed", "tag": "fec4ebc8-5f21-411f-be32-6048d4c583f8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:06.211692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2220b826-9266-40c0-829d-f3eb51fc04a4 req-e4739137-93f3-4648-a250-d5d2a5defc1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.212297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2220b826-9266-40c0-829d-f3eb51fc04a4 req-e4739137-93f3-4648-a250-d5d2a5defc1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.223898 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2220b826-9266-40c0-829d-f3eb51fc04a4 req-e4739137-93f3-4648-a250-d5d2a5defc1e service nova] Creating event network-vif-plugged:fec4ebc8-5f21-411f-be32-6048d4c583f8 for instance aba4857f-e048-4984-8f05-ae8eb327b1b8 on nch1-master-1 Jul 30 21:13:06.229803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2220b826-9266-40c0-829d-f3eb51fc04a4 req-e4739137-93f3-4648-a250-d5d2a5defc1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038045 Jul 30 21:13:06.230886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1544/3213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:06.234227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.240681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-333b44c5-b268-409f-b66d-b86510e97274 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Calling method '.version_select at 0x7fbb629e2310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.247108 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6da8912c-b8e6-4df5-b6f5-29cc25f09c6c tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.459533 Jul 30 21:13:06.249300 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1670/3214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:05 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:06.273667 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-333b44c5-b268-409f-b66d-b86510e97274 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] HTTP exception thrown: Image not found. Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-333b44c5-b268-409f-b66d-b86510e97274 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Request method failure captured: Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/images/tempest-invalid-1451053534 HTTP/1.1 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7gmz5hT2SF8A1DnX3iTb9VSUepc5-Lks5nSaojNcJWboSCgqZGt3AnoTAPjxgWa59xFcHWhPvFt8CrNoBsxadie8PjKUWGE9nmz8DmA8tRfzInz3JztbSYjxZLTQ_As3-Ek3sL-gH0FETWhNddGw8xTOeLx1wBMxvNpuC4iEbXF7k Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_006af94f365f4f6a90a0ff8b1d36e9f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a81f365477344b77a90b286c6b80d169 Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: exception: Image not found. Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'tempest-invalid-1451053534'} Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1451053534 to delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1451053534 could not be found. Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.277553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-333b44c5-b268-409f-b66d-b86510e97274 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Returning 404 to user: Image not found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-333b44c5-b268-409f-b66d-b86510e97274 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/tempest-invalid-1451053534" status: 404 len: 62 microversion: 2.1 time: 0.048091 Jul 30 21:13:06.283115 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1545/3215] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 30 21:13:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1451053534 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:06.291795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-337f6500-eb84-46c8-acba-23ac9507be94 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Calling method '.version_select at 0x7fbb5c655790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.327057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-337f6500-eb84-46c8-acba-23ac9507be94 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] HTTP exception thrown: Image not found. Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-337f6500-eb84-46c8-acba-23ac9507be94 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Request method failure captured: Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/images/88f3c6c3-7da5-44d1-b6c8-95caf32137cc HTTP/1.1 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z7gmz5hT2SF8A1DnX3iTb9VSUepc5-Lks5nSaojNcJWboSCgqZGt3AnoTAPjxgWa59xFcHWhPvFt8CrNoBsxadie8PjKUWGE9nmz8DmA8tRfzInz3JztbSYjxZLTQ_As3-Ek3sL-gH0FETWhNddGw8xTOeLx1wBMxvNpuC4iEbXF7k Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_006af94f365f4f6a90a0ff8b1d36e9f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/006af94f365f4f6a90a0ff8b1d36e9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 006af94f365f4f6a90a0ff8b1d36e9f8 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-988943196 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a81f365477344b77a90b286c6b80d169 Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-988943196-project Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '88f3c6c3-7da5-44d1-b6c8-95caf32137cc'} Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 88f3c6c3-7da5-44d1-b6c8-95caf32137cc to delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88f3c6c3-7da5-44d1-b6c8-95caf32137cc could not be found. Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.328782 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-337f6500-eb84-46c8-acba-23ac9507be94 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:06.334114 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-337f6500-eb84-46c8-acba-23ac9507be94 tempest-ImagesDeleteNegativeTestJSON-988943196 tempest-ImagesDeleteNegativeTestJSON-988943196-project] 10.222.0.17 "DELETE /compute/v2.1/images/88f3c6c3-7da5-44d1-b6c8-95caf32137cc" status: 404 len: 62 microversion: 2.1 time: 0.043169 Jul 30 21:13:06.362045 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1671/3216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:06 2022] DELETE /compute/v2.1/images/88f3c6c3-7da5-44d1-b6c8-95caf32137cc => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:13:06.393852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.395616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:06.405312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.405790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.407035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.407591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.454676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cebbcfb8-101f-4074-af4d-4891ab73a050 req-740a4142-d576-406c-b4d2-410cc38d6ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1c36cc-0f45-4770-b7b8-536e4f8607b9", "name": "network-vif-deleted", "tag": "8b90216a-616a-4b30-ac5c-f54cd0f8c252"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:06.481088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cebbcfb8-101f-4074-af4d-4891ab73a050 req-740a4142-d576-406c-b4d2-410cc38d6ea7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.481088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cebbcfb8-101f-4074-af4d-4891ab73a050 req-740a4142-d576-406c-b4d2-410cc38d6ea7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.489680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cebbcfb8-101f-4074-af4d-4891ab73a050 req-740a4142-d576-406c-b4d2-410cc38d6ea7 service nova] Creating event network-vif-deleted:8b90216a-616a-4b30-ac5c-f54cd0f8c252 for instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 on nch2-master-1 Jul 30 21:13:06.494685 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cebbcfb8-101f-4074-af4d-4891ab73a050 req-740a4142-d576-406c-b4d2-410cc38d6ea7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045109 Jul 30 21:13:06.498260 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1672/3217] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:06.504492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c3b4b05-6150-4f86-b8ac-634faf150ad2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Action: 'create', calling method: .version_select at 0x7fbb5c655790>, body: {"keypair": {"name": "tempest-keypair-1595914193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjmdpSLoQLyyGH9T1JjLD0N0MWtVWUoVZcRXvqLwxfEYYw7Vg4BcfrIaBasaf7VFpA1+PypwGy4BdTqrQnsO216mJufYhFpHU/6ClVY9isP4OePGrKeZ2GCZQWK7hKBbg=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:06.515656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:06.522649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7c3b4b05-6150-4f86-b8ac-634faf150ad2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Getting quotas for project a2471207e4614f369934b1723545d1f3. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:06.529370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7c3b4b05-6150-4f86-b8ac-634faf150ad2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Getting quotas for user c4fc3f756d034b339878ee04f0469df0 and project a2471207e4614f369934b1723545d1f3. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:06.565513 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c3b4b05-6150-4f86-b8ac-634faf150ad2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.064714 Jul 30 21:13:06.567502 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1673/3218] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:13:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:13:06.741535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:06.754472 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ea746cf-9f7d-40dd-bb9a-18019273b538 tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1493 microversion: 2.1 time: 0.361547 Jul 30 21:13:06.755712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1546/3219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:06 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1493 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:06.808372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.809958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:06.829088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.832921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.839526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.840122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.888779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:06.889425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:06.902079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:06.910794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.912914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:06.914036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:06.914960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.367246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.381358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-987e2a61-a312-4747-99b3-3fe169200df1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.577333 Jul 30 21:13:07.387638 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1674/3220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:06 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:07.394886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:07.401194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] [instance: fc1c36cc-0f45-4770-b7b8-536e4f8607b9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:07.414015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.415161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.416168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.417842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.445414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] HTTP exception thrown: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Request method failure captured: Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 HTTP/1.1 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z2FpxijZdbr6RR50z-q933G4xvZ1fiePAD1Pfzu6CSi1t-TuSY5CoinTAuKGj7s1Dpt5qpKvKZ_SUIXSVOw1rS4S8DrTWw2AlieurrJb_Ma6I6PvcHNTUj0ljodPWPClpuHr4gfXMGAA4DlanUipP_mkXWLt2LpPMR0EENCHn2PzmA Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61ed7d57264748e1907d9c2f3743667a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61ed7d57264748e1907d9c2f3743667a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 61ed7d57264748e1907d9c2f3743667a Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-MigrationsAdminTest-1919956461 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 25cff561a2d14c45b71920346aee5d57 Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-MigrationsAdminTest-1919956461-project Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'fc1c36cc-0f45-4770-b7b8-536e4f8607b9'} Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:07.453427 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. Jul 30 21:13:07.458757 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:07.460034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] Returning 404 to user: Instance fc1c36cc-0f45-4770-b7b8-536e4f8607b9 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:07.461073 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-59daabbb-a666-47bc-8ba9-18ecaf45550a tempest-MigrationsAdminTest-1919956461 tempest-MigrationsAdminTest-1919956461-project] 10.222.0.17 "GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9" status: 404 len: 111 microversion: 2.1 time: 0.072183 Jul 30 21:13:07.464302 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1675/3221] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:07 2022] GET /compute/v2.1/servers/fc1c36cc-0f45-4770-b7b8-536e4f8607b9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:07.471239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:07.476053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:07.493714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.494321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.495485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.497130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.577554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.589816 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c82fb050-090b-4bf2-a82c-101edd84ed9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1530 microversion: 2.1 time: 0.707540 Jul 30 21:13:07.590674 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1547/3222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:06 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1530 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:07.601496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:07.605517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:07.620821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.621564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.622486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.625138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.625911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.638820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.644146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.645347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a23a7f6-928b-4874-97f3-85fae1340483 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1340 microversion: 2.20 time: 0.179857 Jul 30 21:13:07.659674 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1676/3223] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:07 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:07.775853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:07.776507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:07.788376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.788865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.789736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:07.791728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:07.865149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:07.875938 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce62b63d-6608-4875-91b0-d152744c9098 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1323 microversion: 2.1 time: 0.281741 Jul 30 21:13:07.893738 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1548/3224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:07 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:08.016501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe4dfa0f564eedb8deb3491a5068a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9653a81a694ec29d1fcfe2da97eaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:08.027173 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-83bcbaf2-d7f1-497e-9517-88d8c5039e5e tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 200 len: 1451 microversion: 2.1 time: 0.255436 Jul 30 21:13:08.028421 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1677/3225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:07 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 1451 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:08.408370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:08.409496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:08.425062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:08.427436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:08.428427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:08.429091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:08.522640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-169a7db7-451c-4d3c-aa0c-6eb32d16034c req-bc826184-109f-49d4-909a-ba568aac2c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21acb434-81bc-4b5a-9933-73289bc11bbc", "name": "network-vif-deleted", "tag": "3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:08.542115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-169a7db7-451c-4d3c-aa0c-6eb32d16034c req-bc826184-109f-49d4-909a-ba568aac2c4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:08.542884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-169a7db7-451c-4d3c-aa0c-6eb32d16034c req-bc826184-109f-49d4-909a-ba568aac2c4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:08.563628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-169a7db7-451c-4d3c-aa0c-6eb32d16034c req-bc826184-109f-49d4-909a-ba568aac2c4d service nova] Creating event network-vif-deleted:3b4590e3-9eaa-4b30-9f20-bbabd8aa4a5f for instance 21acb434-81bc-4b5a-9933-73289bc11bbc on nch1-master-1 Jul 30 21:13:08.568912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-169a7db7-451c-4d3c-aa0c-6eb32d16034c req-bc826184-109f-49d4-909a-ba568aac2c4d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050767 Jul 30 21:13:08.569949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1678/3226] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:08.617441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:08.618881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:08.634011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:08.635580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:08.639128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:08.639977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:08.998885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.011074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92149a04-fef6-459d-b39e-8f8d806044cc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.608715 Jul 30 21:13:09.013818 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1549/3227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:08 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:09.031967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.032555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.033115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:09.041927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96de431c-e6f0-431a-8fb5-f957eb0d269e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.430643 Jul 30 21:13:09.043250 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1679/3228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:08 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:09.048674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.049551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:09.055919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.057030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.057989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.058752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.059753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.060483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.061990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.064570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.273370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.285964 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-64327f15-edaf-452f-ad19-d1d3fe9f9d4b tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1518 microversion: 2.1 time: 0.241261 Jul 30 21:13:09.299315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1680/3229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:09.303850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.305175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] [instance: 21acb434-81bc-4b5a-9933-73289bc11bbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:09.315099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.315790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.316791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.317410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.332833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] HTTP exception thrown: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Request method failure captured: Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc HTTP/1.1 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5PwROgeWDHn1X5NR30sxR4ZPgQNHP8PLfsS9dSdvU90TIAXrymrqvIS6MO9FBylyB1EcGNhN9nk_Thx3rJQgCNTGMBAFKpT-LmHRuBYHaLb1bEQagxf6nsa_tpkOnmiBtJq8FPwxiiud66F-6zloTe2ktX0BR3rZSX0-hJ0QY6AVQ Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7e9653a81a694ec29d1fcfe2da97eaa3 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e9653a81a694ec29d1fcfe2da97eaa3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e9653a81a694ec29d1fcfe2da97eaa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7e9653a81a694ec29d1fcfe2da97eaa3 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueTestJSON-792403752 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueTestJSON-792403752-project Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 36fe4dfa0f564eedb8deb3491a5068a5 Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueTestJSON-792403752-project Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '21acb434-81bc-4b5a-9933-73289bc11bbc'} Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:09.334834 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. Jul 30 21:13:09.339477 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.340856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] Returning 404 to user: Instance 21acb434-81bc-4b5a-9933-73289bc11bbc could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:09.342312 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-59bfa2ea-a27d-4b7e-9f67-a07d19422fda tempest-ServerRescueTestJSON-792403752 tempest-ServerRescueTestJSON-792403752-project] 10.222.0.17 "GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc" status: 404 len: 111 microversion: 2.1 time: 0.053123 Jul 30 21:13:09.343078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1681/3230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/servers/21acb434-81bc-4b5a-9933-73289bc11bbc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:09.386889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.410634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.413837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:09.416624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49948de2-feed-4dbc-be6c-8db891d15d46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1340 microversion: 2.20 time: 0.398367 Jul 30 21:13:09.417219 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1550/3231] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:09.457102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.459909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:09.482059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.483069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.486862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.487625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.598428 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] HTTP exception thrown: Instance is not a member of specified network Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Request method failure captured: Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8/ips/invalid HTTP/1.1 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7RHFDqszMLqUZwFUXQ26FVzQM5hspkX5c4qvm72Jht9zSmqAO1T0PByxbWCVSl9MV7BL_RmM4L6QyErjIDCkPRM_VdO2Sw5MFxiLZWshy3Ld0Z-tlG8wAR0iFqYq-RIYSl8JH9o1puCWoxcoLXShQSwuR1dWd-zjzYqaWFRekSAdo Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af6c6b5ced854c3ca03b65cb69903ef5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f89692ad732b4d9f8429659ee6a03a0b Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance is not a member of specified network Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': 'aba4857f-e048-4984-8f05-ae8eb327b1b8', 'id': 'invalid'} Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 30 21:13:09.613893 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.618556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:09.619667 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b13988c7-e6d5-4548-be1f-edbbf7d1af4d tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.184586 Jul 30 21:13:09.620885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1551/3232] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8/ips/invalid => generated 91 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:09.638200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7ea75ed6-15fc-4dd7-afd6-6738ef9da1ff req-059e6770-b155-439f-8ebf-bf68b3b0da01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed8a44b-ef0e-4b0c-b57f-79e3dd896678", "name": "network-vif-plugged", "status": "completed", "tag": "d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:09.680320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7ea75ed6-15fc-4dd7-afd6-6738ef9da1ff req-059e6770-b155-439f-8ebf-bf68b3b0da01 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.681145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7ea75ed6-15fc-4dd7-afd6-6738ef9da1ff req-059e6770-b155-439f-8ebf-bf68b3b0da01 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.738812 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7ea75ed6-15fc-4dd7-afd6-6738ef9da1ff req-059e6770-b155-439f-8ebf-bf68b3b0da01 service nova] Creating event network-vif-plugged:d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c for instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 on nch2-master-1 Jul 30 21:13:09.754717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7ea75ed6-15fc-4dd7-afd6-6738ef9da1ff req-059e6770-b155-439f-8ebf-bf68b3b0da01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126228 Jul 30 21:13:09.756112 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1552/3233] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:09.768801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.778284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Failed to fetch instance by id 999 {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:13:09.781923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] HTTP exception thrown: Instance 999 could not be found. Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Request method failure captured: Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7RHFDqszMLqUZwFUXQ26FVzQM5hspkX5c4qvm72Jht9zSmqAO1T0PByxbWCVSl9MV7BL_RmM4L6QyErjIDCkPRM_VdO2Sw5MFxiLZWshy3Ld0Z-tlG8wAR0iFqYq-RIYSl8JH9o1puCWoxcoLXShQSwuR1dWd-zjzYqaWFRekSAdo Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af6c6b5ced854c3ca03b65cb69903ef5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f89692ad732b4d9f8429659ee6a03a0b Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 999 could not be found. Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': '999'} Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 30 21:13:09.789980 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:09.794686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:09.794686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02d826b5-3142-461c-b5b9-fc55c4aca255 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.033971 Jul 30 21:13:09.801094 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1553/3234] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:09.818375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:09.819018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:09.844207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.851610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.854375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:09.856264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:09.966037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:13:09.983730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2912e61a-bbb5-4cec-a5de-f153ce878b06 tempest-ListImageFiltersNegativeTestJSON-534150891 tempest-ListImageFiltersNegativeTestJSON-534150891-project] Calling method '.version_select at 0x7fbb4fedc160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:10.042850 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2912e61a-bbb5-4cec-a5de-f153ce878b06 tempest-ListImageFiltersNegativeTestJSON-534150891 tempest-ListImageFiltersNegativeTestJSON-534150891-project] HTTP exception thrown: Image not found. Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2912e61a-bbb5-4cec-a5de-f153ce878b06 tempest-ListImageFiltersNegativeTestJSON-534150891 tempest-ListImageFiltersNegativeTestJSON-534150891-project] Request method failure captured: Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/images/799fee66-e9e1-478e-a8ab-c681b8033741 HTTP/1.1 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z7kgOTTv1M7p-0H_IVu32b0p2-X4W31QVOBY3gCYrF8fihGygddfdB73qw4cY0ScLLt47H9zzj9LnHvxKEbUpvIfoF16S3LtgTMCkxz1rnwBEbgOC8bz4NOK-LJUmSSxE9txivIPiGR1sPJnFS5F5AikQ5WrxnMwuLQFhj8heblWv0 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e9d604456790434ca636b569e916f53a Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-534150891 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e9d604456790434ca636b569e916f53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e9d604456790434ca636b569e916f53a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9d604456790434ca636b569e916f53a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9d604456790434ca636b569e916f53a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-534150891 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e9d604456790434ca636b569e916f53a Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-534150891 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ListImageFiltersNegativeTestJSON-534150891-project Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5f030fb471ff43f196e204901a4dce82 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-534150891-project Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: exception: Image not found. Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '799fee66-e9e1-478e-a8ab-c681b8033741'} Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 799fee66-e9e1-478e-a8ab-c681b8033741 Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 30 21:13:10.044914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 799fee66-e9e1-478e-a8ab-c681b8033741 could not be found. Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2912e61a-bbb5-4cec-a5de-f153ce878b06 tempest-ListImageFiltersNegativeTestJSON-534150891 tempest-ListImageFiltersNegativeTestJSON-534150891-project] Returning 404 to user: Image not found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2912e61a-bbb5-4cec-a5de-f153ce878b06 tempest-ListImageFiltersNegativeTestJSON-534150891 tempest-ListImageFiltersNegativeTestJSON-534150891-project] 10.222.0.17 "GET /compute/v2.1/images/799fee66-e9e1-478e-a8ab-c681b8033741" status: 404 len: 62 microversion: 2.1 time: 0.698009 Jul 30 21:13:10.049404 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1682/3235] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Jul 30 21:13:09 2022] GET /compute/v2.1/images/799fee66-e9e1-478e-a8ab-c681b8033741 => generated 62 bytes in 699 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:10.072339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:10.078126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:10.103814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.113386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.114883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.117715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.154629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3255c028-595f-43c4-bc66-2445ef0e6725 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 204 len: 0 microversion: 2.1 time: 0.351024 Jul 30 21:13:10.158997 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1554/3236] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:13:09 2022] DELETE /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:13:10.163316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:10.164139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:10.173184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.173768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.175379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.176000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.602915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:10.612022 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60ea8af3-50c3-4dbd-a3c3-29a051a3aef1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.564509 Jul 30 21:13:10.613480 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1683/3237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:10 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:10.619626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:10.620414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:10.629313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.630067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.631077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.631771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.936782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:10.950768 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e86a4ddb-f085-409f-a199-84c90b5302d7 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1524 microversion: 2.1 time: 0.335850 Jul 30 21:13:10.959413 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1684/3238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:10 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1524 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:10.970308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:10.971127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:10.988312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.988780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:10.990620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:10.991281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:11.217557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:11.232071 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd7df68c-d48f-4395-9eab-5cd67e2f5891 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 1.074252 Jul 30 21:13:11.232751 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1555/3239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:10 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:11.391807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:11.401193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:11.409487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:11.410753 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06ed2822-d245-4640-964d-ad104951eaca tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 0.450177 Jul 30 21:13:11.411462 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1685/3240] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:10 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:11.627957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-07aef307-7bb6-4a95-b83f-9543ab087c7b req-b4c32371-0651-42df-8e2f-3224392a2579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:11.633525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:11.634448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:11.646924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:11.652417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:11.653475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:11.657069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:11.702244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-07aef307-7bb6-4a95-b83f-9543ab087c7b req-b4c32371-0651-42df-8e2f-3224392a2579 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:11.710154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-07aef307-7bb6-4a95-b83f-9543ab087c7b req-b4c32371-0651-42df-8e2f-3224392a2579 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:11.730629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-07aef307-7bb6-4a95-b83f-9543ab087c7b req-b4c32371-0651-42df-8e2f-3224392a2579 service nova] Creating event network-changed:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch2-master-1 Jul 30 21:13:11.739532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-07aef307-7bb6-4a95-b83f-9543ab087c7b req-b4c32371-0651-42df-8e2f-3224392a2579 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131866 Jul 30 21:13:11.742026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1556/3241] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:11.980219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:11.981869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:12.000067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:12.000834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:12.003107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:12.004562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:12.348465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:12.360103 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5a425e8a-d383-4c60-a1db-dfe5e89580a4 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1524 microversion: 2.1 time: 0.387620 Jul 30 21:13:12.375884 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1557/3242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:11 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:12.387487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1558178164", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9771a639-f224-468e-9b5b-b457abbda94e"}, {"port": "ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd", "tag": "port-1"}, {"port": "4a0f8ce0-4b07-404b-afab-9e61aceb22e2", "tag": "port-2"}, {"uuid": "eb9cffb1-add1-495d-8c8f-49dd6386ec58", "tag": "net-1"}, {"uuid": "eb9cffb1-add1-495d-8c8f-49dd6386ec58"}, {"uuid": "a097cabb-f4d5-479b-824f-77b91fbfddec", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a097cabb-f4d5-479b-824f-77b91fbfddec", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "274b1600-813c-4727-aba9-36bcc9319a0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5bc23213-e140-4a12-b440-bd8f58b9cd96", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "60fb4518-f854-4b61-a759-7d8ecb213f83", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1926283217"}], "key_name": "tempest-keypair-1595914193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:12.615362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] validate_networks() for [('9771a639-f224-468e-9b5b-b457abbda94e', None, None, None, None, None), (None, None, 'ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd', None, None, None), (None, None, '4a0f8ce0-4b07-404b-afab-9e61aceb22e2', None, None, None), ('eb9cffb1-add1-495d-8c8f-49dd6386ec58', None, None, None, None, None), ('eb9cffb1-add1-495d-8c8f-49dd6386ec58', None, None, None, None, None), ('a097cabb-f4d5-479b-824f-77b91fbfddec', '10.2.2.100', None, None, None, None), ('a097cabb-f4d5-479b-824f-77b91fbfddec', '10.2.2.200', None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:13:13.069268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:13.078019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-64b145a7-3f32-46e0-911a-b1a5f8a2d118 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 1.448339 Jul 30 21:13:13.080292 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1686/3243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:11 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:13.086876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:13.087971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:13.098441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.099447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.100499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.101591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.486847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:13.499153 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71a6cd90-cf71-4642-a990-6b3f6f5b74d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.416975 Jul 30 21:13:13.505409 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1687/3244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:13 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:13.510455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:13.514625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:13.528707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.535387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.536704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.537331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.770654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:13.779866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:13.785577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:13.790598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7f37025-e5c2-4169-8ba5-063b5c8f0346 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 0.283822 Jul 30 21:13:13.791709 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1688/3245] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:13 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:13.800096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:13.806343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:13.824294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.825023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.825994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:13.826616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:13.850025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:14.025625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89692ad732b4d9f8429659ee6a03a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6c6b5ced854c3ca03b65cb69903ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:14.040391 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2fe7554-405c-47e6-83b5-94ad9ae7e07a tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 200 len: 1482 microversion: 2.1 time: 0.246649 Jul 30 21:13:14.042531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1689/3246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:13 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 1482 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:14.052908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-361cabbb-7f29-42ec-8c0d-9b535ff28391 req-44f50764-cba2-4c3e-a8c1-ff9052d55e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba4857f-e048-4984-8f05-ae8eb327b1b8", "name": "network-vif-deleted", "tag": "fec4ebc8-5f21-411f-be32-6048d4c583f8"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:14.066796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-361cabbb-7f29-42ec-8c0d-9b535ff28391 req-44f50764-cba2-4c3e-a8c1-ff9052d55e83 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.068222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-361cabbb-7f29-42ec-8c0d-9b535ff28391 req-44f50764-cba2-4c3e-a8c1-ff9052d55e83 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.085851 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-361cabbb-7f29-42ec-8c0d-9b535ff28391 req-44f50764-cba2-4c3e-a8c1-ff9052d55e83 service nova] Creating event network-vif-deleted:fec4ebc8-5f21-411f-be32-6048d4c583f8 for instance aba4857f-e048-4984-8f05-ae8eb327b1b8 on nch1-master-1 Jul 30 21:13:14.091917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-361cabbb-7f29-42ec-8c0d-9b535ff28391 req-44f50764-cba2-4c3e-a8c1-ff9052d55e83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043787 Jul 30 21:13:14.098639 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1690/3247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:14.105175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:14.106433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:14.114723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.115559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.116588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.117410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.389191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:14.402147 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-439c6f44-ed09-4b72-ab9a-136377397170 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.301882 Jul 30 21:13:14.403517 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1691/3248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:14 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:14.592763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:14.595483 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:13:14.595483 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:13:14.596894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.597369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.603827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.604582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.665935 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c9a7a1e-1ead-4bf4-a228-af459c4ba29e tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.261431 Jul 30 21:13:14.672939 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1692/3249] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:14 2022] GET /compute/v2.1/os-services => generated 947 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:14.679133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:14.682095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:14.699161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.699904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:14.700896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:14.701526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.189764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:15.216034 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4623ee9e-402f-4998-b594-40e3cf947bde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.540919 Jul 30 21:13:15.223075 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1693/3250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:14 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:15.238345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:15.242734 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:13:15.242734 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:13:15.247319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.248332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.249452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.251193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.296465 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77e2c1be-92dc-4d9d-bb5e-65684a6d9a46 tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.070288 Jul 30 21:13:15.302298 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1694/3251] 10.222.0.17 () {58 vars in 1174 bytes} [Sat Jul 30 21:13:15 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:15.314964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:15.315632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:15.326482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.326945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.327848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.328226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.476428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:15.823667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:15.837176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:15.840760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:15.841932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4284ffc9-8f6d-4738-b1ab-9b2b47b3d3d9 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 0.538570 Jul 30 21:13:15.846353 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1695/3252] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:15 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:15.851962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:15.852779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] [instance: aba4857f-e048-4984-8f05-ae8eb327b1b8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:15.871039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.871536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.888043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.888760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.921157 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] HTTP exception thrown: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Request method failure captured: Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 HTTP/1.1 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z7RHFDqszMLqUZwFUXQ26FVzQM5hspkX5c4qvm72Jht9zSmqAO1T0PByxbWCVSl9MV7BL_RmM4L6QyErjIDCkPRM_VdO2Sw5MFxiLZWshy3Ld0Z-tlG8wAR0iFqYq-RIYSl8JH9o1puCWoxcoLXShQSwuR1dWd-zjzYqaWFRekSAdo Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af6c6b5ced854c3ca03b65cb69903ef5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af6c6b5ced854c3ca03b65cb69903ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: af6c6b5ced854c3ca03b65cb69903ef5 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2057974973 Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f89692ad732b4d9f8429659ee6a03a0b Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2057974973-project Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'aba4857f-e048-4984-8f05-ae8eb327b1b8'} Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:15.922887 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] Returning 404 to user: Instance aba4857f-e048-4984-8f05-ae8eb327b1b8 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:15.933661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46c82fe1-49cf-4ca9-bd2e-db43c24294f0 tempest-ServerAddressesNegativeTestJSON-2057974973 tempest-ServerAddressesNegativeTestJSON-2057974973-project] 10.222.0.17 "GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8" status: 404 len: 111 microversion: 2.1 time: 0.077335 Jul 30 21:13:15.939374 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1696/3253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:15 2022] GET /compute/v2.1/servers/aba4857f-e048-4984-8f05-ae8eb327b1b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:15.944267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:15.946940 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:13:15.946940 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:13:15.948277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.948750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:15.949580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:15.950031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.032881 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1dbe67b-cb91-48ee-b057-d3ecdd675ade tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092205 Jul 30 21:13:16.039668 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1697/3254] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:13:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:16.045799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:16.048744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:16.070871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.071385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.072190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.072637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.147103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:16.538425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:16.602085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:16.621019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-377e59a5-99e0-4080-906f-0426a172eead tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.576848 Jul 30 21:13:16.624632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1698/3255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:16 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:16.642921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:16.648629 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:13:16.648629 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:13:16.651275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.651964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.652969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.658748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.753966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f81a8b6-bb01-4a31-8997-a297561d127a tempest-ServicesAdminTestJSON-1836471659 tempest-ServicesAdminTestJSON-1836471659-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.127957 Jul 30 21:13:16.760070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1699/3256] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:16 2022] GET /compute/v2.1/os-services => generated 947 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:16.772460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:16.773355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:16.789154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.789853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:16.790944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:16.791850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:17.446204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:17.463729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-038a3199-9e25-4b9b-bb02-780fe779f220 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.702274 Jul 30 21:13:17.486269 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1700/3257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:16 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:17.493420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:17.506159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:17.519588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:17.520144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:17.521178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:17.521826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:18.610456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:18.624469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:18.637890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:18.647393 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b430338-b8ed-46fd-bacb-7aeee420ceb6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 1.159517 Jul 30 21:13:18.654490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1701/3258] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:17 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:18.667537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:18.672953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:18.682135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:18.684396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:18.685578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:18.686199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:19.239026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:19.255616 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-219c09f7-92e3-479e-9dbf-bd3ba1f93fe7 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1735 microversion: 2.1 time: 0.599777 Jul 30 21:13:19.256853 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1702/3259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:18 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1735 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:19.274604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:19.280448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:19.301239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:19.301739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:19.302554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:19.305002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:20.067157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:20.067692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:20.068541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:20.068975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:20.069411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:20.103829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:20.104326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:20.110105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:20.112105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:20.217206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Getting quotas for project a2471207e4614f369934b1723545d1f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:20.224718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Getting quotas for user c4fc3f756d034b339878ee04f0469df0 and project a2471207e4614f369934b1723545d1f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:20.538550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:13:20.542006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='274b1600-813c-4727-aba9-36bcc9319a0c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5bc23213-e140-4a12-b440-bd8f58b9cd96',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60fb4518-f854-4b61-a759-7d8ecb213f83',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:13:20.626208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:20.643227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ab45f9cd-db3b-4c4f-91bb-99be5d63f32e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 1.381171 Jul 30 21:13:20.657114 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1703/3260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:19 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:20.672242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:20.674437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:20.696278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:20.697288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:20.698376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:20.699058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:21.258970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fc0408e-64b3-4782-abd5-b73948430f65 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.879318 Jul 30 21:13:21.259595 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1558/3261] 10.222.0.17 () {62 vars in 1189 bytes} [Sat Jul 30 21:13:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 8883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:13:21.277666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-735722dc-10f7-407c-b8fe-a3c4d51bb9eb req-e5517fd2-076d-4c8f-94f6-b6410bb16e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "name": "network-vif-plugged", "status": "completed", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:21.295217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-735722dc-10f7-407c-b8fe-a3c4d51bb9eb req-e5517fd2-076d-4c8f-94f6-b6410bb16e29 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:21.320020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-735722dc-10f7-407c-b8fe-a3c4d51bb9eb req-e5517fd2-076d-4c8f-94f6-b6410bb16e29 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:21.320361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.336094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.338234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.341767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7403a66-0f3b-4589-98b0-571acdac0b82 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 0.678240 Jul 30 21:13:21.349525 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-735722dc-10f7-407c-b8fe-a3c4d51bb9eb req-e5517fd2-076d-4c8f-94f6-b6410bb16e29 service nova] Creating event network-vif-plugged:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch2-master-1 Jul 30 21:13:21.355915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-735722dc-10f7-407c-b8fe-a3c4d51bb9eb req-e5517fd2-076d-4c8f-94f6-b6410bb16e29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092803 Jul 30 21:13:21.357082 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1559/3262] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:21.357624 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1704/3263] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:20 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:21.364102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:21.365419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:21.369921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:21.373626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:21.374303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:21.374843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:21.375512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:21.376165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:21.461959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:21.691882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.708433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.713449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:21.714675 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af9dbcb3-cfb4-4954-a2ef-687f29aa3540 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1286 microversion: 2.32 time: 0.350731 Jul 30 21:13:21.715257 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1705/3264] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:21 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1286 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:21.729048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:21.729290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:21.762020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:21.768150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:21.774030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:21.775251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:22.359368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:22.378582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37f7b77a-091d-45fc-ad25-d0a7592d159b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.661192 Jul 30 21:13:22.397002 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1706/3265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:21 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:22.402191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:22.415036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:22.418449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:22.421375 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30071660-6e54-47cd-a362-204fdefff5e8 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1715 microversion: 2.1 time: 1.059661 Jul 30 21:13:22.422292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1560/3266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:21 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1715 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:22.436738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:22.438134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:22.440887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:22.464715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:22.741920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:22.743261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:22.912792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:22.927668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:22.930190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:22.934800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00246522-8a79-473d-aefe-3a3926dec155 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1407 microversion: 2.20 time: 0.532939 Jul 30 21:13:22.936957 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1707/3267] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:22 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:22.969255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:22.972632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:22.984523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:22.985089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:22.986169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:22.986845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.115649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:23.132170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:23.134001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:23.145812 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-42fdea3e-5338-4f7e-b218-b2caaf2ba5ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1286 microversion: 2.32 time: 0.397695 Jul 30 21:13:23.159159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1561/3268] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:22 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1286 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:23.178583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Cannot 'detach_volume' instance 4cd003b4-169a-47b3-b40c-d50ef73a312a while it is in vm_state rescued Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments/1de790c2-b9e6-4af2-8872-5feb1eaf86f8 HTTP/1.1 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'detach_volume' instance 4cd003b4-169a-47b3-b40c-d50ef73a312a while it is in vm_state rescued Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': '4cd003b4-169a-47b3-b40c-d50ef73a312a', 'id': '1de790c2-b9e6-4af2-8872-5feb1eaf86f8'} Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4cd003b4-169a-47b3-b40c-d50ef73a312a while it is in vm_state rescued Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:23.182488 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4cd003b4-169a-47b3-b40c-d50ef73a312a while it is in vm_state rescued Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 409 to user: Cannot 'detach_volume' instance 4cd003b4-169a-47b3-b40c-d50ef73a312a while it is in vm_state rescued {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:23.190582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea49e030-bee4-41db-9423-d86a5a7ef1fc tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments/1de790c2-b9e6-4af2-8872-5feb1eaf86f8" status: 409 len: 152 microversion: 2.1 time: 0.236750 Jul 30 21:13:23.192538 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1708/3269] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:13:22 2022] DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments/1de790c2-b9e6-4af2-8872-5feb1eaf86f8 => generated 152 bytes in 256 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:23.201466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:23.202266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:23.230815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.231316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.232157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.232621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.409181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:23.409914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:23.428555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.429049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.434246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.435763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.601776 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-52aa4078-aa51-4734-bebc-66bb48a00306 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/action" status: 202 len: 0 microversion: 2.1 time: 0.403918 Jul 30 21:13:23.603473 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1562/3270] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:13:23 2022] POST /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:13:23.613715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:23.626996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:23.654874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.655769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:23.656851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:23.657510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:24.186185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:24.201672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3d2255e-b054-429b-a64c-2b158b2295ef tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.800000 Jul 30 21:13:24.205588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1709/3271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:23 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:24.502488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:24.521294 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-629d2148-1463-4e56-94f5-f431bf05550c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1723 microversion: 2.1 time: 0.913311 Jul 30 21:13:24.522692 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1563/3272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:23 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1723 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:24.537777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:24.538694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:24.549668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:24.550401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:24.552293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:24.552922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:24.856567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a48394c8-23bd-4d27-ab80-a18c5ac2975b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:24.874422 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a48394c8-23bd-4d27-ab80-a18c5ac2975b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.667493 Jul 30 21:13:24.880572 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1710/3273] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:24.904161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:24.904954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:24.930230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:24.930701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:24.931530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:24.931981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:25.348459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.375712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.380373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.382171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.385774 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09a46e97-818a-4c2a-bcbe-143b5e158b3c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1599 microversion: 2.20 time: 0.860857 Jul 30 21:13:25.387479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1564/3274] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:24 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1599 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:25.412111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.413797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:25.415008 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a430e32-f049-4a75-a9bc-8e43a0b61d35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1594 microversion: 2.32 time: 0.531098 Jul 30 21:13:25.417805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-439c8e27-41fe-43a0-9f50-617384979238 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:25.428395 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1711/3275] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:24 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1594 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:25.443054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:25.445556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:25.460830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:25.465161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:25.466315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:25.467051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:25.478983 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-439c8e27-41fe-43a0-9f50-617384979238 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.090062 Jul 30 21:13:25.481542 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1565/3276] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:13:25 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:25.488136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:25.498865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:25.517051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:25.525132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:25.527976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:25.532931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:25.533866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:25.939238 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e0636447-8533-43cd-b3a8-323b5197b622 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.454003 Jul 30 21:13:25.940013 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1566/3277] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:13:25 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-interface => generated 285 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:13:25.952629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39133da7-d3f3-4e78-9a37-e9a22877b629 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:25.982262 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39133da7-d3f3-4e78-9a37-e9a22877b629 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031903 Jul 30 21:13:25.983255 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1567/3278] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:26.011484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:26.012371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:26.032113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.033706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.039982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.041042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.169105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:26.184302 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3096fa1a-7007-4688-9a83-b58c1562ffa4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.754671 Jul 30 21:13:26.214755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1712/3279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:25 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:26.538885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1398997120", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:26.591418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:26.600657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-abb8a089-196c-4eca-a5ec-97cdb6900b08 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1723 microversion: 2.1 time: 0.608644 Jul 30 21:13:26.606315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1568/3280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:25 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:26.619208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-203d55ad-d35e-483b-a5e7-bb2c34817f9c tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:26.659718 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-203d55ad-d35e-483b-a5e7-bb2c34817f9c tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051768 Jul 30 21:13:26.663048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:26.665994 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1569/3281] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:26.667995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:26.669214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:26.674305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:26.674814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:26.681018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:26.682426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:26.693048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.693818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.694799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.695448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.711943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:26.734057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.740326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.742950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:26.745278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:26.770405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:26.826860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Getting quotas for project 93838542feaa41ff9c8cac14d04fc99a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:26.848241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Getting quotas for user 6e84c9c580a24203a9b37732bda4e135 and project 93838542feaa41ff9c8cac14d04fc99a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:26.901111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:13:26.905003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:13:26.931623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:26.948470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:26.964366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:26.966406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-262bdafd-dbe8-4029-8524-b42a152ada91 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1594 microversion: 2.32 time: 0.298259 Jul 30 21:13:26.973921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1570/3282] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:26 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1594 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:27.004631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-113fe0f2-d2b1-4410-9626-a69201872cc2 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:27.104104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96c26f20-152c-4d98-ae81-48dfbc144622 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.887726 Jul 30 21:13:27.113245 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1713/3283] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:13:27.153530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:27.159842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:27.187380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-113fe0f2-d2b1-4410-9626-a69201872cc2 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.206995 Jul 30 21:13:27.207946 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1571/3284] 10.222.0.17 () {58 vars in 1165 bytes} [Sat Jul 30 21:13:26 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:27.212280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:27.212925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:27.258887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:27.264300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:27.265291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:27.265767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:27.610491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:27.640480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:27.659819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:27.668133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c7b276f-2eaf-4312-87d6-d6dd8bb911f4 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1278 microversion: 2.57 time: 0.551608 Jul 30 21:13:27.669236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1714/3285] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:27 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1278 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:27.691130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23d40be2-da25-49d2-b372-7db20dc74163 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:27.744398 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23d40be2-da25-49d2-b372-7db20dc74163 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.072322 Jul 30 21:13:27.749006 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1715/3286] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:27.769290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:27.770921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:27.794186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:27.804428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:27.805315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:27.818942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.191797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:28.204806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e672634-c29b-4903-b954-2004a597b735 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 1.002701 Jul 30 21:13:28.210159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1572/3287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:27 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:28.222202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ba471c8-efd6-44b8-a222-1e2846f8521a tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.314935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ba471c8-efd6-44b8-a222-1e2846f8521a tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.103182 Jul 30 21:13:28.322143 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1573/3288] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:28.337672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.338702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:28.347354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.349493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.351711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.352415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.465549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:28.478148 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6f107aa-8b17-4d5b-845d-9497cc17d5c6 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1729 microversion: 2.1 time: 0.725383 Jul 30 21:13:28.487215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1716/3289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:27 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1729 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:28.493300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3fc16e02-930a-4a59-a32e-2607930654a8 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.515227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3fc16e02-930a-4a59-a32e-2607930654a8 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.026374 Jul 30 21:13:28.521034 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1717/3290] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:28.538267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.538890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:28.561996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.562866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.563969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.564645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.793271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1aa29cbf-f26a-42a3-a817-cb2202449e2f tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270569 Jul 30 21:13:28.794595 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1718/3291] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:28.800335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0e50c455-c19b-4b24-bea9-f8e4f3f21a18 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.824674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0e50c455-c19b-4b24-bea9-f8e4f3f21a18 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028037 Jul 30 21:13:28.826323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:28.828432 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1719/3292] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:28.841900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:28.842905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:28.853762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:28.858759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:28.860606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.861189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.862856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:28.863000 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd78360a-1619-41d5-8c2c-f6f6ed090a47 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1594 microversion: 2.32 time: 0.534145 Jul 30 21:13:28.864054 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1574/3293] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1594 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:28.864773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:28.875971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8a3c458-b908-479e-9ea5-76206a0c1e8c tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.042174 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8a3c458-b908-479e-9ea5-76206a0c1e8c tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.165265 Jul 30 21:13:29.045338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1575/3294] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:29.083746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b6dae185-4227-432f-a952-f5277b3b138b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.121069 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b6dae185-4227-432f-a952-f5277b3b138b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065197 Jul 30 21:13:29.123582 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1576/3295] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:29.151699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6137877f-45a0-46d6-9194-da4be1da141b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.226357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6137877f-45a0-46d6-9194-da4be1da141b tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.094230 Jul 30 21:13:29.236754 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1577/3296] 10.222.0.17 () {58 vars in 1144 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:29.247081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.256189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:29.275679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:29.288887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:29.290236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:29.291467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:29.370750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:29.383655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:29.385223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:29.386416 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-97b4c58f-3d84-46e2-ae4b-e1417380478a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1330 microversion: 2.57 time: 0.553505 Jul 30 21:13:29.421096 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1720/3297] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:28 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1330 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:29.428878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a43272f-96c5-45fe-aeb4-0b0e05f345b9 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.470322 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a43272f-96c5-45fe-aeb4-0b0e05f345b9 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046987 Jul 30 21:13:29.470921 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1721/3298] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:29.514186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-019e812f-7f27-400e-babe-389899cbbcc4 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.660414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-019e812f-7f27-400e-babe-389899cbbcc4 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.169046 Jul 30 21:13:29.663879 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1722/3299] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:29.685344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9f7ffdf-9644-431d-9194-bfcf00adb15a tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.735490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9f7ffdf-9644-431d-9194-bfcf00adb15a tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.057945 Jul 30 21:13:29.739221 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1723/3300] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:29.748707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e11ff577-f154-42a3-bc04-027dc8f4f054 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.769495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e11ff577-f154-42a3-bc04-027dc8f4f054 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024942 Jul 30 21:13:29.780606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1724/3301] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:29.786065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dd2ad3af-20c1-4655-839b-b9c4739a7886 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.959170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dd2ad3af-20c1-4655-839b-b9c4739a7886 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.177306 Jul 30 21:13:29.965370 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1725/3302] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:29.981523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:29.982315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:30.004277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:30.004748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:30.019948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:30.020665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:30.157143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:30.300854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:30.309714 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb90603d-8073-4454-a9dd-6909e8499399 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 1.071807 Jul 30 21:13:30.324075 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1578/3303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:30.331141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b308d60f-a472-42ff-819f-b02929b072e9 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:30.365079 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b308d60f-a472-42ff-819f-b02929b072e9 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038552 Jul 30 21:13:30.365695 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1579/3304] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:30.395638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d4d8ee45-516b-48ab-954b-94154f1f34c3 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:30.415620 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d4d8ee45-516b-48ab-954b-94154f1f34c3 tempest-FlavorsV2TestJSON-580785754 tempest-FlavorsV2TestJSON-580785754-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023365 Jul 30 21:13:30.419003 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1580/3305] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:13:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:30.438483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:30.441442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:30.462580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:30.464774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:30.472868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:30.473651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:30.668459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:30.681305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:30.691431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:30.692874 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a52c9858-deda-427b-b0f5-b09a383d502f tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1336 microversion: 2.57 time: 0.272408 Jul 30 21:13:30.693614 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1581/3306] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:30 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1336 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:31.178689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:31.200908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:31.205355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:31.216039 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1b2d0421-77cf-4f94-83e3-28532dd2e2d4 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1594 microversion: 2.32 time: 1.249256 Jul 30 21:13:31.218401 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1726/3307] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:29 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1594 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:31.345358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:31.346004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:31.360925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:31.361391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:31.362186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:31.362635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:31.711904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Calling method '.version_select at 0x7fbb629e2e50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:31.791590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:13:31.792680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Neutron security group df3f4119-01f8-472d-9363-ee0a8748841f not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:13:31.793544 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] HTTP exception thrown: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.793544 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Request method failure captured: Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/df3f4119-01f8-472d-9363-ee0a8748841f HTTP/1.1 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z76cP1Ip8L5MihVC4O3W-MKcW_AjAJedcFjqudxpCFfKFVZu9OimVE4x-MaCF_B7bfAC8heNhtK0kIHJ8K5KOtMHrrn1VcOU38C-u5CSIpiAvLB3t1DnNcePZpjjaRGP67QTl2KUQK8NZFCrg45-9oDIRN-LZwfBIIB5yGUeVp1StY Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8062527ac2b2406bbb3856d37f7af540", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7c6e44ff30dc435b8fd6d9d76e02287f Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'df3f4119-01f8-472d-9363-ee0a8748841f'} Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:13:31.796461 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] Jul 30 21:13:31.801765 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:31.808420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Returning 404 to user: Security group df3f4119-01f8-472d-9363-ee0a8748841f does not exist Jul 30 21:13:31.808420 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-5b7fb85d-79fb-419f-8e89-d0b93fd46c71'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:31.809822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fe74e6d-504d-47eb-bfb9-8e83d7377026 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/df3f4119-01f8-472d-9363-ee0a8748841f" status: 404 len: 194 microversion: 2.1 time: 0.723277 Jul 30 21:13:31.811149 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1582/3308] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:13:31 2022] DELETE /compute/v2.1/os-security-groups/df3f4119-01f8-472d-9363-ee0a8748841f => generated 194 bytes in 725 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:13:31.821506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:31.822817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:31.841883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:31.845134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:31.846205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:31.848072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:32.073775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:32.091316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:32.094366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:32.097686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7657fc2b-f7f1-45ba-b1c9-daf0b6f2559c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1336 microversion: 2.57 time: 0.285131 Jul 30 21:13:32.115010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1583/3309] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:31 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1336 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:32.115010 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3de2a353-6802-4cf4-a136-52c35ff78e9e tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011384 Jul 30 21:13:32.115010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1584/3310] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 30 21:13:32 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 21:13:32.127987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70c66682-ce99-4623-8288-1b8ff2e5d349 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Calling method '.version_select at 0x7fbb629e21f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:32.418039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:32.442170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91b33a97-72b2-4ffd-a0d7-8d0a508220d7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 1.101261 Jul 30 21:13:32.442783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1727/3311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:31 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:32.464018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:32.464667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:32.501381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:32.501919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:32.503329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:32.504793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:32.791685 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70c66682-ce99-4623-8288-1b8ff2e5d349 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.670799 Jul 30 21:13:32.792948 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1585/3312] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:13:32 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:32.817210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Calling method '.version_select at 0x7fbb628813a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:33.124244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:33.468670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:33.488833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:33.498721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:33.504297 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b59e4e51-4f3d-42e0-833f-57bd18a02f9b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1709 microversion: 2.32 time: 1.053902 Jul 30 21:13:33.510110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1728/3313] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:32 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1709 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:33.525002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:33.531546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:33.556585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:33.562321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:33.564831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:33.570001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:33.644235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:13:33.645017 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 30 21:13:33.645017 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Request method failure captured: Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-security-groups/06e8b815-30c3-4f21-99c7-351343cb5e1e HTTP/1.1 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z76cP1Ip8L5MihVC4O3W-MKcW_AjAJedcFjqudxpCFfKFVZu9OimVE4x-MaCF_B7bfAC8heNhtK0kIHJ8K5KOtMHrrn1VcOU38C-u5CSIpiAvLB3t1DnNcePZpjjaRGP67QTl2KUQK8NZFCrg45-9oDIRN-LZwfBIIB5yGUeVp1StY Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8062527ac2b2406bbb3856d37f7af540", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7c6e44ff30dc435b8fd6d9d76e02287f Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: exception: Insufficient rights for removing default security group. Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '06e8b815-30c3-4f21-99c7-351343cb5e1e'} Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:13:33.646816 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-8eb02060-a5ff-47fb-995c-37ff650db5fa'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa74796c-828a-41c8-91fb-9643be08639b tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/06e8b815-30c3-4f21-99c7-351343cb5e1e" status: 400 len: 182 microversion: 2.1 time: 0.839204 Jul 30 21:13:33.650478 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1586/3314] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:13:32 2022] DELETE /compute/v2.1/os-security-groups/06e8b815-30c3-4f21-99c7-351343cb5e1e => generated 182 bytes in 840 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:13:33.653456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8746a4fe-d8ca-4a9b-906d-013b8565f8aa req-5d317312-5898-48c4-bfc8-fe00dfdefb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:33.687545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8746a4fe-d8ca-4a9b-906d-013b8565f8aa req-5d317312-5898-48c4-bfc8-fe00dfdefb67 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:33.687977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8746a4fe-d8ca-4a9b-906d-013b8565f8aa req-5d317312-5898-48c4-bfc8-fe00dfdefb67 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:33.729174 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8746a4fe-d8ca-4a9b-906d-013b8565f8aa req-5d317312-5898-48c4-bfc8-fe00dfdefb67 service nova] Creating event network-changed:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch2-master-1 Jul 30 21:13:33.749182 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8746a4fe-d8ca-4a9b-906d-013b8565f8aa req-5d317312-5898-48c4-bfc8-fe00dfdefb67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099035 Jul 30 21:13:33.749979 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1587/3315] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:33.780650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:33.781375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:33.798291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:33.798846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:33.819192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:33.824672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.092126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:34.107600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:34.109532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:34.112429 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bec1cf36-6521-4f5a-ac65-716e12f41830 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1357 microversion: 2.57 time: 0.600136 Jul 30 21:13:34.121049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1729/3316] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:33 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1357 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:34.139122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Calling method '.version_select at 0x7fbb4fec8670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:34.224775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:13:34.225402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Neutron security group 29460a0c-562a-45aa-8db3-0206e394aa01 not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:13:34.225962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] HTTP exception thrown: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.225962 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Request method failure captured: Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-security-groups/29460a0c-562a-45aa-8db3-0206e394aa01 HTTP/1.1 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z76cP1Ip8L5MihVC4O3W-MKcW_AjAJedcFjqudxpCFfKFVZu9OimVE4x-MaCF_B7bfAC8heNhtK0kIHJ8K5KOtMHrrn1VcOU38C-u5CSIpiAvLB3t1DnNcePZpjjaRGP67QTl2KUQK8NZFCrg45-9oDIRN-LZwfBIIB5yGUeVp1StY Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8062527ac2b2406bbb3856d37f7af540", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 7c6e44ff30dc435b8fd6d9d76e02287f Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '29460a0c-562a-45aa-8db3-0206e394aa01'} Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:13:34.227879 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Returning 404 to user: Security group 29460a0c-562a-45aa-8db3-0206e394aa01 does not exist Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-3762ab18-949d-4033-9602-78836d980daf'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:34.232563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d355332d-5992-4302-9213-a7b5313edea6 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/29460a0c-562a-45aa-8db3-0206e394aa01" status: 404 len: 194 microversion: 2.1 time: 0.107013 Jul 30 21:13:34.237561 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1730/3317] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:13:34 2022] GET /compute/v2.1/os-security-groups/29460a0c-562a-45aa-8db3-0206e394aa01 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:34.245938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:34.270735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:34.316084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.316562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.317392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.317854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.482212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:34.502510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e234417-8555-4c82-a095-97ce1d527be7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1525 microversion: 2.1 time: 0.741084 Jul 30 21:13:34.525285 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1588/3318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:33 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1525 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:34.549770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Action: 'update', calling method: .version_select at 0x7fbb62a261f0>, body: {"security_group": {"name": "tempest-sg-573156517", "description": "tempest-description-635929519"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:34.618096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:34.619159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:34.621100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:34.624315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:34.624963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:34.763485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:13:34.764105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Neutron security group c935f428-9e65-430f-9cc3-4ca31404977d not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:13:34.764646 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] HTTP exception thrown: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.764646 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Request method failure captured: Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/os-security-groups/c935f428-9e65-430f-9cc3-4ca31404977d HTTP/1.1 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 100 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z76cP1Ip8L5MihVC4O3W-MKcW_AjAJedcFjqudxpCFfKFVZu9OimVE4x-MaCF_B7bfAC8heNhtK0kIHJ8K5KOtMHrrn1VcOU38C-u5CSIpiAvLB3t1DnNcePZpjjaRGP67QTl2KUQK8NZFCrg45-9oDIRN-LZwfBIIB5yGUeVp1StY Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8062527ac2b2406bbb3856d37f7af540", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8062527ac2b2406bbb3856d37f7af540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8062527ac2b2406bbb3856d37f7af540 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245404799 Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7c6e44ff30dc435b8fd6d9d76e02287f Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245404799-project Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: {"security_group": {"name": "tempest-sg-573156517", "description": "tempest-description-635929519"}} Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c935f428-9e65-430f-9cc3-4ca31404977d', 'body': {'security_group': {'name': 'tempest-sg-573156517', 'description': 'tempest-description-635929519'}}} Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:13:34.766958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] Returning 404 to user: Security group c935f428-9e65-430f-9cc3-4ca31404977d does not exist Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-7237cfd7-4a27-4dda-ba00-b7a17cd4551a'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4705351a-5339-4f57-8c57-d318f20328e9 tempest-SecurityGroupsNegativeTestJSON-245404799 tempest-SecurityGroupsNegativeTestJSON-245404799-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/c935f428-9e65-430f-9cc3-4ca31404977d" status: 404 len: 194 microversion: 2.1 time: 0.240465 Jul 30 21:13:34.771109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1589/3319] 10.222.0.17 () {60 vars in 1290 bytes} [Sat Jul 30 21:13:34 2022] PUT /compute/v2.1/os-security-groups/c935f428-9e65-430f-9cc3-4ca31404977d => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:34.778122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:34.778711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:34.820178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:34.827114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:34.837086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.837609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.842175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.842646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.849216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.851646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:34.853601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:34.854095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:35.019735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ec97101-f305-4e6a-9688-9d064aa4ba7b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "POST /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872/action" status: 202 len: 1138 microversion: 2.57 time: 0.776118 Jul 30 21:13:35.026507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1731/3320] 10.222.0.17 () {62 vars in 1320 bytes} [Sat Jul 30 21:13:34 2022] POST /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872/action => generated 1138 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 30 21:13:35.043841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:35.044626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:35.055183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:35.055764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:35.057207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:35.058335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:35.294764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:35.317904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:35.327160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:35.328451 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-575cb264-8886-46bc-8fbf-07cf1328f492 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.289303 Jul 30 21:13:35.331218 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1732/3321] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:35 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:35.540477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:35.541222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:35.581140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:35.583388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:35.584418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:35.586742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:36.044006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.060340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c1b628c-a22a-41d2-b066-8c51842805da tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1507 microversion: 2.1 time: 0.531502 Jul 30 21:13:36.065099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1733/3322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:35 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:36.083219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}, {"name": "network-changed", "server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:36.113845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:36.114304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:36.124876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.157142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.167705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.169152 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c742a1d5-f131-42d1-9b52-48d04e66d014 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1744 microversion: 2.32 time: 1.398937 Jul 30 21:13:36.182059 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] Creating event network-changed:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:13:36.183462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1590/3323] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:34 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1744 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:36.183883 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] Creating event network-changed:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:13:36.201958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-df459011-8421-43e9-b1dd-d9ffc190e03b req-5ab1331c-6d7a-440c-bfcf-16a5c2a63d16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.135344 Jul 30 21:13:36.203182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1734/3324] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:36.355571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:36.356346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:36.384356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:36.384920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:36.390659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:36.391258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:36.682803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.713486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.723553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:36.730933 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b9b0394-1fd5-4f71-8437-be97536280c0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.378483 Jul 30 21:13:36.741213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1591/3325] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:36 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:36.855102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:37.025999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a8240a6-7c62-413d-ab7c-2c87838ccbf1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb5d78f040>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSj6r4YRxf4jUIF6AFP0wA6pqg5zBS04XUQoMVabXsQi1GV96rEN3mvWLUA8leCDnLmzvcQmHvqJD+OBuBWwu5ZLwB1voSKIzNE5e+RjdLQLHKkOHRsMP8NaFBwTxGybw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a8240a6-7c62-413d-ab7c-2c87838ccbf1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 257 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSj6r4YRxf4jUIF6AFP0wA6pqg5zBS04XUQoMVabXsQi1GV96rEN3mvWLUA8leCDnLmzvcQmHvqJD+OBuBWwu5ZLwB1voSKIzNE5e+RjdLQLHKkOHRsMP8NaFBwTxGybw=="}} Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSj6r4YRxf4jUIF6AFP0wA6pqg5zBS04XUQoMVabXsQi1GV96rEN3mvWLUA8leCDnLmzvcQmHvqJD+OBuBWwu5ZLwB1voSKIzNE5e+RjdLQLHKkOHRsMP8NaFBwTxGybw=='}}} Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'minLength': 1, Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Jul 30 21:13:37.031027 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 30 21:13:37.042423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.049019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a8240a6-7c62-413d-ab7c-2c87838ccbf1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.049019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5a8240a6-7c62-413d-ab7c-2c87838ccbf1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.193837 Jul 30 21:13:37.049019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1735/3326] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:36 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:13:37.058402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb6289c940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-912631776", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.088136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:37.092573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:37.102175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:37.110768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.111608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.115776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.116436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.116770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for user 846000d9e9734695b08c6a29efb84377 and project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:37.147593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 2166 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-912631776", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:37.186137 ncdv-master-1 devstack@n-api.service[130983]: exception: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-912631776', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.190539 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.194584 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1383cc73-fe9e-431c-b471-856d2b231bc7 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.139559 Jul 30 21:13:37.208121 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1592/3327] 10.222.0.17 () {60 vars in 1160 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:37.215831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:37.216476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:37.242200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.242682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.243543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.246131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.517723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.526867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-915d38e1-2e65-4c0a-8a72-a5118be689fb tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1507 microversion: 2.1 time: 0.443808 Jul 30 21:13:37.528962 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1736/3328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:37 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:37.535583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-577f7471-094a-49b0-a48e-afb819ee4580 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb4fe80a60>, body: {"keypair": {"name": "tempest-keypair-865409522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0P3Mem+yszeYTmu5MSzpJpTsIIV1UEzUh7HLgmDG8MvxN5x9OwejlgteO9fpriBn8sT56xycFbSfCcBFi6AyRJKvC2ANkXq139SHUY1Lavmaiugl0isSGHOX+oQlx3lQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.554214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-577f7471-094a-49b0-a48e-afb819ee4580 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:37.561187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-577f7471-094a-49b0-a48e-afb819ee4580 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for user 846000d9e9734695b08c6a29efb84377 and project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:37.597298 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-577f7471-094a-49b0-a48e-afb819ee4580 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066898 Jul 30 21:13:37.602368 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1737/3329] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:37.611806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb4fe6a0d0>, body: {"keypair": {"name": "tempest-keypair-865409522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdH/XswZAMWL2I5lUw8aM54zApkxLOk3aIsIbGih4+1l/UD4bh6IVaWSNaih5J8MLg7J1M7FeigXT34fnS+5kbwWODKrDL3SwczL2eY/4sWoyHW6XwBaSteUaWK4oHT+A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.629921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:37.636369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for user 846000d9e9734695b08c6a29efb84377 and project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:37.663458 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] HTTP exception thrown: Key pair 'tempest-keypair-865409522' already exists. Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 272 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: {"keypair": {"name": "tempest-keypair-865409522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdH/XswZAMWL2I5lUw8aM54zApkxLOk3aIsIbGih4+1l/UD4bh6IVaWSNaih5J8MLg7J1M7FeigXT34fnS+5kbwWODKrDL3SwczL2eY/4sWoyHW6XwBaSteUaWK4oHT+A=="}} Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: exception: Key pair 'tempest-keypair-865409522' already exists. Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-865409522', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdH/XswZAMWL2I5lUw8aM54zApkxLOk3aIsIbGih4+1l/UD4bh6IVaWSNaih5J8MLg7J1M7FeigXT34fnS+5kbwWODKrDL3SwczL2eY/4sWoyHW6XwBaSteUaWK4oHT+A=='}}} Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '846000d9e9734695b08c6a29efb84377-tempest-keypair-865409522' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 30 21:13:37.677003 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi session.flush() Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result.read() Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 30 21:13:37.680963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '846000d9e9734695b08c6a29efb84377-tempest-keypair-865409522' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 30, 21, 13, 37, 655904), 'updated_at': None, 'name': 'tempest-keypair-865409522', 'user_id': '846000d9e9734695b08c6a29efb84377', 'fingerprint': '61:cb:4e:68:4e:a1:2d:29:5c:ce:85:91:42:f1:32:47', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdH/XswZAMWL2I5lUw8aM54zApkxLOk3aIsIbGih4+1l/UD4bh6IVaWSNaih5J8MLg7J1M7FeigXT34fnS+5kbwWODKrDL3SwczL2eY/4sWoyHW6XwBaSteUaWK4oHT+A==', 'type': 'ssh'}] Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi keypair.create() Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._create() Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-865409522' already exists. Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 30 21:13:37.685863 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-865409522' already exists. Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-865409522' already exists. Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 409 to user: Key pair 'tempest-keypair-865409522' already exists. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2d01313f-8f23-416b-a710-1e093f55ae30 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.074839 Jul 30 21:13:37.693771 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1738/3330] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:13:37.700281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85d4c9b2-1a1c-4ccf-8376-90c823f3935a tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Calling method '.version_select at 0x7fbb4fe6a670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:37.713798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.727102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85d4c9b2-1a1c-4ccf-8376-90c823f3935a tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-865409522" status: 202 len: 0 microversion: 2.1 time: 0.030392 Jul 30 21:13:37.728287 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1739/3331] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:13:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-865409522 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:13:37.737503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.740231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.741779 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68b2c160-5f35-4380-8a0d-60585b8377ce tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1744 microversion: 2.32 time: 0.532481 Jul 30 21:13:37.742996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0f25b10-bbbe-4761-bd41-38199c3b9eb1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb4fee4e50>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CIWcvPYuZ6hv3mwkNUdPA9oMzVh4VoGsdF8f1jypu2S43FiaI1oqkBTPGQcVwlp5B3yARAAM8BVKszjLFrq/gKn/Rxblzcx9/zBqlxuaQ0XKl5oSuWuBJ2vopej4p1A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0f25b10-bbbe-4761-bd41-38199c3b9eb1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 247 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CIWcvPYuZ6hv3mwkNUdPA9oMzVh4VoGsdF8f1jypu2S43FiaI1oqkBTPGQcVwlp5B3yARAAM8BVKszjLFrq/gKn/Rxblzcx9/zBqlxuaQ0XKl5oSuWuBJ2vopej4p1A=="}} Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CIWcvPYuZ6hv3mwkNUdPA9oMzVh4VoGsdF8f1jypu2S43FiaI1oqkBTPGQcVwlp5B3yARAAM8BVKszjLFrq/gKn/Rxblzcx9/zBqlxuaQ0XKl5oSuWuBJ2vopej4p1A=='}}} Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi '' Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:13:37.747557 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:13:37.751531 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.753956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0f25b10-bbbe-4761-bd41-38199c3b9eb1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.757391 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0f25b10-bbbe-4761-bd41-38199c3b9eb1 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017130 Jul 30 21:13:37.758500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1740/3333] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:13:37.764491 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1593/3333] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:37 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1744 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:37.769094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:37.769867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb6289c940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-626702069", "public_key": " "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.770385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:37.781680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.783743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.784809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:37.785505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:37.792354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:37.798588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for user 846000d9e9734695b08c6a29efb84377 and project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:37.837765 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 94 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-626702069", "public_key": " "}} Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: exception: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-626702069', 'public_key': ' '}}} Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.840606 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.845962 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.850234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.851168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6667882a-d6c4-4c67-8f81-89bc199e1fb3 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.085526 Jul 30 21:13:37.858581 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1594/3334] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:13:37.864507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b933d00d-74e8-4cad-a7da-a3518197bfdc tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb62979f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItkS8xAX/5Rq/Kz17V/8M6I4z5X+8cjPAZ7e86mj96vjYHFfA95qR1ruJFvEVBZ5kY9bd6OHdfdsXbsV3Gzexckdza5oucOC37hslygpMCj5SaO/AEO0jxw3MWYGMIuOw=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b933d00d-74e8-4cad-a7da-a3518197bfdc tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 507 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItkS8xAX/5Rq/Kz17V/8M6I4z5X+8cjPAZ7e86mj96vjYHFfA95qR1ruJFvEVBZ5kY9bd6OHdfdsXbsV3Gzexckdza5oucOC37hslygpMCj5SaO/AEO0jxw3MWYGMIuOw=="}} Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItkS8xAX/5Rq/Kz17V/8M6I4z5X+8cjPAZ7e86mj96vjYHFfA95qR1ruJFvEVBZ5kY9bd6OHdfdsXbsV3Gzexckdza5oucOC37hslygpMCj5SaO/AEO0jxw3MWYGMIuOw=='}}} Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 30 21:13:37.870924 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b933d00d-74e8-4cad-a7da-a3518197bfdc tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b933d00d-74e8-4cad-a7da-a3518197bfdc tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012709 Jul 30 21:13:37.876343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1595/3335] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:13:37.886691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Action: 'create', calling method: .version_select at 0x7fbb628813a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1881353409", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:37.895929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.908859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.912309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:37.913710 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c935158-7c31-42b9-bad1-f35493fe021c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.153306 Jul 30 21:13:37.914759 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1741/3336] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:37 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:37.942392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:37.953448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Getting quotas for user 846000d9e9734695b08c6a29efb84377 and project 28a564c725354058930b750a9520e40d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:37.976442 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 118 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1881353409", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: exception: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1881353409', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 30 21:13:37.978847 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 30 21:13:37.984872 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:13:37.991404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:38.001391 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b09575c7-6b62-4db2-974b-1b7b4cd3d102 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112007 Jul 30 21:13:38.002357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1596/3337] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:13:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 30 21:13:38.013963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90ad9f66-6079-4434-b906-374cb3676969 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Calling method '.version_select at 0x7fbb4fe9bf70>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:38.031260 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-90ad9f66-6079-4434-b906-374cb3676969 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90ad9f66-6079-4434-b906-374cb3676969 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Request method failure captured: Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-364942721 HTTP/1.1 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8A9x5n1hgtfXJQzBnGW2U9MrxKEwKR5h8DzafTRd_qJXbN37u-bGJEXcjTQV0eLGioRoX4sRpcbzBGoVj928vIj-cKb9rZmjTEtJjtsx2PLLfuneRfvK5dI6ZxTKafJ3ueGTw7dGwZYVVUFJbfSod48-1jgoJeV72yWtGkUur3H28 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28a564c725354058930b750a9520e40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28a564c725354058930b750a9520e40d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28a564c725354058930b750a9520e40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 28a564c725354058930b750a9520e40d Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1252242770 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1252242770-project Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: exception: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'tempest-keypair-non-existent-364942721'} Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise self.value Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:38.036476 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 Jul 30 21:13:38.041599 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:38.048926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90ad9f66-6079-4434-b906-374cb3676969 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] Returning 404 to user: Keypair tempest-keypair-non-existent-364942721 not found for user 846000d9e9734695b08c6a29efb84377 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:38.050126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90ad9f66-6079-4434-b906-374cb3676969 tempest-KeyPairsNegativeTestJSON-1252242770 tempest-KeyPairsNegativeTestJSON-1252242770-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-364942721" status: 404 len: 144 microversion: 2.1 time: 0.040206 Jul 30 21:13:38.058319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1742/3338] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-364942721 => generated 144 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:38.553547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:38.555217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:38.562363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:38.563838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:38.565231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:38.565941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:38.571478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:38.780632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:38.781489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:38.801157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:38.801877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:38.805629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:38.807349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:39.119812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.133935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.136769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.139433 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7fe761e-691a-46e5-9496-3ff900bacfe6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1791 microversion: 2.32 time: 0.368680 Jul 30 21:13:39.150162 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1743/3339] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:38 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1791 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:39.163972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:39.167473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:39.174898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:39.189445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:39.193058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:39.193776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:39.221798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:39.362491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.381555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.383250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.388394 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b58a4bf4-d7d3-49a7-aeb2-6791926ff1a1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.229146 Jul 30 21:13:39.389933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1744/3340] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:39 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:39.464600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-78c8c95e-ce55-4227-88fe-876599946063 req-2a1f10be-87e2-4937-bb8d-f68eca0348a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed8a44b-ef0e-4b0c-b57f-79e3dd896678", "name": "network-vif-unplugged", "status": "completed", "tag": "d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:39.483677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-78c8c95e-ce55-4227-88fe-876599946063 req-2a1f10be-87e2-4937-bb8d-f68eca0348a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:39.483677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-78c8c95e-ce55-4227-88fe-876599946063 req-2a1f10be-87e2-4937-bb8d-f68eca0348a6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:39.507373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-78c8c95e-ce55-4227-88fe-876599946063 req-2a1f10be-87e2-4937-bb8d-f68eca0348a6 service nova] Creating event network-vif-unplugged:d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c for instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 on nch2-master-1 Jul 30 21:13:39.522251 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-78c8c95e-ce55-4227-88fe-876599946063 req-2a1f10be-87e2-4937-bb8d-f68eca0348a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061080 Jul 30 21:13:39.523422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1745/3341] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:39.540063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:39.549757 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e55f4a19-0e7b-45b9-9e60-831ff7a6902e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1507 microversion: 2.1 time: 1.003360 Jul 30 21:13:39.551514 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1597/3342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:38 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1507 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:40.171831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:40.174201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:40.183613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.184356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.185458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.186067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.421072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:40.422944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:40.437629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.439513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.440591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.441280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.459580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.472944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.479146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.483462 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a19cda1f-7eee-43ea-a9d3-1823ee004f3c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1838 microversion: 2.32 time: 0.319117 Jul 30 21:13:40.486105 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1746/3343] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:40 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1838 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:40.574674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:40.575779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:40.579941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:40.587704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.588605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.589625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:40.591145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:40.717145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.733624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.736349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:40.740474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c65840c-ac83-452e-8e41-6783b0cfc7b1 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.329069 Jul 30 21:13:40.759858 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1598/3344] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:40 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:41.000327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:41.013224 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14b8a63c-83c4-4bcf-8036-55bb41f5991d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 200 len: 1450 microversion: 2.1 time: 0.442934 Jul 30 21:13:41.016604 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1747/3345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:40 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 1450 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:41.042961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:41.043518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:41.055748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:41.056720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:41.057935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:41.058705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:41.097715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:13:41.107595 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Working on deleting snapshot 6079df29-dafc-453f-8e9a-17d53845f0ad from shelved instance... Jul 30 21:13:41.510739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:41.512716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:41.532973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:41.534102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:41.541643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:41.542428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:42.004238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.041439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.043627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.044997 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-acb49b13-6545-427c-8768-d6d7d8fca56c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1838 microversion: 2.32 time: 0.538138 Jul 30 21:13:42.060793 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1748/3346] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:41 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1838 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:42.070083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:42.071845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:42.081273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:42.082118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:42.083116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:42.083738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:42.133143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Doing local delete in cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130983) _delete /opt/stack/nova/nova/compute/api.py:2491}} Jul 30 21:13:42.133985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:42.134452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:42.134899 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 30 21:13:42.142759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] deallocate_for_instance() {{(pid=130983) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 30 21:13:42.180639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.190166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.191764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:42.201308 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-509ffafb-03e2-4382-9ee8-0205aee64aa5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.138802 Jul 30 21:13:42.202554 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1749/3347] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:42 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:43.079742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:43.080390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:43.102463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:43.103070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:43.104075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:43.104631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:43.754624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.772403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.774542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.776147 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee68c3b4-18a0-46a1-8898-f3c4a9cdeb61 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1838 microversion: 2.32 time: 0.705645 Jul 30 21:13:43.777254 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1750/3348] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:43 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1838 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:43.782991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:43.783966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:43.798757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:43.799847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:43.800932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:43.801384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:43.887905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.898203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.907699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:43.909773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77b8d1f0-a335-46df-a9d4-262c193ce537 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.130932 Jul 30 21:13:43.912818 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1751/3349] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:43 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:44.073734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fe4063c2-900c-4a50-8260-c54204c75656 req-919867db-cb79-4be3-a6f5-f5db7c4195e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:44.089372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fe4063c2-900c-4a50-8260-c54204c75656 req-919867db-cb79-4be3-a6f5-f5db7c4195e9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.090125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fe4063c2-900c-4a50-8260-c54204c75656 req-919867db-cb79-4be3-a6f5-f5db7c4195e9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.102781 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fe4063c2-900c-4a50-8260-c54204c75656 req-919867db-cb79-4be3-a6f5-f5db7c4195e9 service nova] Creating event network-changed:ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:44.108586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fe4063c2-900c-4a50-8260-c54204c75656 req-919867db-cb79-4be3-a6f5-f5db7c4195e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038581 Jul 30 21:13:44.110279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1752/3350] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:44.341771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Updating instance_info_cache with network_info: [] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:13:44.650397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13d4100e-2ca7-442d-bbcb-0dc7ad669cf0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 204 len: 0 microversion: 2.1 time: 3.611083 Jul 30 21:13:44.654410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1599/3351] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:13:41 2022] DELETE /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 0 bytes in 3613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:13:44.668884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:44.669914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:44.679460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.680258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.681483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.682378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.707592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 HTTP/1.1 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0ed8a44b-ef0e-4b0c-b57f-79e3dd896678'} Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:13:44.709981 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:13:44.714815 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:13:44.716383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:13:44.717820 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f8f5eab-168f-4094-8391-de56d11a00b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 404 len: 111 microversion: 2.1 time: 0.061724 Jul 30 21:13:44.719215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1753/3352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:44 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:13:44.801214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:44.802078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:44.814880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.817753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.819399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.820026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.935969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:44.936599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:44.955384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.955826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:44.956644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:44.961016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:45.119246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.137960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.142633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.146751 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e517d5ae-c804-4c1f-9cd7-ffe0c3931e98 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.215288 Jul 30 21:13:45.148313 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1754/3353] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:44 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:45.153447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-233265662", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:45.221244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:13:45.430448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.453710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.458295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:45.460118 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c3e00d7c-46f4-4469-a395-6fa695eeaae1 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1838 microversion: 2.32 time: 0.663293 Jul 30 21:13:45.460715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1600/3354] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:44 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1838 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:46.175243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:46.176210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:46.188727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:46.189493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:46.192258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:46.192903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:46.419848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:46.434964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:46.436807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:46.440527 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cad0677e-b041-4a09-99db-e4ae1f192a45 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.270911 Jul 30 21:13:46.443487 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1601/3355] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:46 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:46.452141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e6122cd4-9221-4ed9-98e2-343c98a09fe9 req-f2715a58-cd4d-427a-8f35-0f3bfc10ec2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed8a44b-ef0e-4b0c-b57f-79e3dd896678", "name": "network-vif-deleted", "tag": "d9248a5d-3e6e-4c1d-a845-b0d2b150ca2c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:46.480793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e6122cd4-9221-4ed9-98e2-343c98a09fe9 req-f2715a58-cd4d-427a-8f35-0f3bfc10ec2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:46.481641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e6122cd4-9221-4ed9-98e2-343c98a09fe9 req-f2715a58-cd4d-427a-8f35-0f3bfc10ec2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:46.513579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.server_external_events [req-e6122cd4-9221-4ed9-98e2-343c98a09fe9 req-f2715a58-cd4d-427a-8f35-0f3bfc10ec2f service nova] Unable to find a host for instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678. Dropping event network-vif-deleted {{(pid=130983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 21:13:46.514780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e6122cd4-9221-4ed9-98e2-343c98a09fe9 req-f2715a58-cd4d-427a-8f35-0f3bfc10ec2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069820 Jul 30 21:13:46.519512 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1602/3356] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 30 21:13:46.524995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:46.530903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:46.546627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:46.548036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:46.552651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:46.553394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:47.256202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.272293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.277076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.279885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-159cb2ca-12f5-4fd7-a1fb-83216ef57c03 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1859 microversion: 2.32 time: 0.758959 Jul 30 21:13:47.281080 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1603/3357] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:46 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1859 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:47.471832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:47.477668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:47.503559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:47.506395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:47.510539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:47.511400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:47.645184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=18 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:47.681028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.727943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.730013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:47.731468 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e45b4cac-fb1e-4f4d-aa5a-1533c0ced62b tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.263489 Jul 30 21:13:47.736689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1604/3358] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:47 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:48.034038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:48.035627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:48.036743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:48.037406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:48.040544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:48.054878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.055589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.057759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.058435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.111699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:48.120098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:48.149358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:13:48.155641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:13:48.257090 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8abc46ab-3673-4742-a3bb-353677caa1b9 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.107445 Jul 30 21:13:48.266165 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1755/3359] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:13:48.282066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2a7a3c1-7519-486c-b1fa-e7c7b3c40042 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:48.282781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2a7a3c1-7519-486c-b1fa-e7c7b3c40042 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:48.285985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:48.311992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:48.312700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:48.339024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.340252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.345168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.347174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.455586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2a7a3c1-7519-486c-b1fa-e7c7b3c40042 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:48.472808 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2a7a3c1-7519-486c-b1fa-e7c7b3c40042 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1214 microversion: 2.1 time: 0.189699 Jul 30 21:13:48.486204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1605/3360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:48 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:48.583451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a1177a62-4382-44a3-85a6-aacb447abae8 req-7f514153-6db6-4997-9815-6b9d6fa7d4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:48.630777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a1177a62-4382-44a3-85a6-aacb447abae8 req-7f514153-6db6-4997-9815-6b9d6fa7d4e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.638558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a1177a62-4382-44a3-85a6-aacb447abae8 req-7f514153-6db6-4997-9815-6b9d6fa7d4e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.697639 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a1177a62-4382-44a3-85a6-aacb447abae8 req-7f514153-6db6-4997-9815-6b9d6fa7d4e8 service nova] Creating event network-changed:ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:48.716062 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a1177a62-4382-44a3-85a6-aacb447abae8 req-7f514153-6db6-4997-9815-6b9d6fa7d4e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137133 Jul 30 21:13:48.717381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1606/3361] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:48.762367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:48.763435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:48.778025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.780603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:48.781718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:48.783850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:49.018604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.100567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.113521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.120051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa8975b0-a26b-4418-b0f0-e325792f515c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.362772 Jul 30 21:13:49.127593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1607/3362] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:48 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:49.265608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.289967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.293071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.294290 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17b501f3-f80c-446d-8204-f8d1cbaa3a68 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.986799 Jul 30 21:13:49.295435 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1756/3363] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:48 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:49.495525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:49.496674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:49.514960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:49.527552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:49.532671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:49.533172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:49.802200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:49.812433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-637f2739-1d40-4418-8103-b7c1b3df265f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1210 microversion: 2.1 time: 0.322363 Jul 30 21:13:49.818761 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1608/3364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:49 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1210 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:50.105178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7a42bae-9107-403b-b27b-065ae8cf4bf5 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fec8a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-619660874", "description": "tempest-description-1155562171"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:50.154565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:50.155216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:50.184915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:50.185636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:50.195269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:50.197106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:50.392624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:50.395588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:50.418535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:50.423519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:50.428130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf20ae6e-1ea5-4def-b517-fd3ee7cd4f3c tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.283256 Jul 30 21:13:50.429572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1609/3365] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:50 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:50.440604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:50.441495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:50.454551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:50.455206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:50.456402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:50.457068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:50.593013 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7a42bae-9107-403b-b27b-065ae8cf4bf5 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.805257 Jul 30 21:13:50.593623 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1757/3366] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:50.607431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fc9338f-fee4-4fdd-8547-95d7af682ccd tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe2d3a0>, body: {"security_group_rule": {"parent_group_id": "fb454f5e-1026-43c5-92d3-e2160fb9e353", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:51.035823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7fc9338f-fee4-4fdd-8547-95d7af682ccd tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.432570 Jul 30 21:13:51.045426 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1758/3367] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:13:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:51.045426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "4a0f8ce0-4b07-404b-afab-9e61aceb22e2"}, {"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "746ec4d9-67d7-4e13-9f5b-d70bfab012ca"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:51.051750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.067250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.084446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.087380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-659c229b-c8ca-40ff-ba89-5c1ca43515e8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.654602 Jul 30 21:13:51.090614 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1610/3368] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:50 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:51.100810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:51.101728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:51.112005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:51.113167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:51.130745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:51.131565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:51.132871 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] Creating event network-changed:4a0f8ce0-4b07-404b-afab-9e61aceb22e2 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:51.134311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] Creating event network-changed:746ec4d9-67d7-4e13-9f5b-d70bfab012ca for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:51.137364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:51.138210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:51.146598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7c87e304-6dde-49fd-9514-257ac8be22f0 req-9955fc79-35e1-4821-976c-bea337bd9dee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108158 Jul 30 21:13:51.151898 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1759/3369] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:51.163388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1123ced-5142-4a0a-b22c-f570a882bfa3 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe3c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-780778363", "description": "tempest-description-895365504"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:51.385672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.398487 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7fc81df-1c84-4d6f-b053-bc66c236feaf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1272 microversion: 2.1 time: 0.306025 Jul 30 21:13:51.399519 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1611/3370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:51 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:51.459007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:51.459744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:51.471749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:51.472479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:51.473483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:51.474105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:51.575120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.585594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.587309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:51.592333 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b6f4b06d-2758-42f5-9e7a-8084aedd644a tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.137120 Jul 30 21:13:51.603256 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1612/3371] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:51 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:52.122263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:52.123744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:52.140433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:52.141250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:52.142241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:52.142699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:52.404621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1123ced-5142-4a0a-b22c-f570a882bfa3 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.250463 Jul 30 21:13:52.405982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1760/3372] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:52.418903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-08899c6d-8357-441b-a7a5-b562b6b2123e tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe3a430>, body: {"security_group_rule": {"parent_group_id": "84e26d27-acc3-4efe-a606-01da0c343331", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:52.767887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:52.784857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:52.787050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:52.792921 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-10890127-a9e8-4b7a-9006-bbc50970af35 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.672643 Jul 30 21:13:52.794865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1613/3373] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:52 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:13:52.814264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:52.815281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:52.835827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:52.836684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:52.837633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:52.844727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:53.272509 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-08899c6d-8357-441b-a7a5-b562b6b2123e tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.856923 Jul 30 21:13:53.285405 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1761/3374] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:13:52 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:13:53.295596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:53.296847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:53.325765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:53.331484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:53.332399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:53.332866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:53.368511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:53.378875 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7e7d4a2-b8be-4fca-bca5-fc962e12292d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.581922 Jul 30 21:13:53.380776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1614/3375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:52 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:53.467983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:53.484132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:53.486054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:53.487325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e32b668-9aaf-4990-bebd-2d6d381224de tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.203174 Jul 30 21:13:53.493081 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1762/3376] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:53 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:53.505510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e729fe26-1942-4955-81e1-c429d87baa47 req-9d05f18a-7b08-4f41-93e7-fa9acf973028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "32311821-607a-46ad-9d0a-cdee0d878cac"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:53.518502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e729fe26-1942-4955-81e1-c429d87baa47 req-9d05f18a-7b08-4f41-93e7-fa9acf973028 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:53.519402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e729fe26-1942-4955-81e1-c429d87baa47 req-9d05f18a-7b08-4f41-93e7-fa9acf973028 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:53.560072 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e729fe26-1942-4955-81e1-c429d87baa47 req-9d05f18a-7b08-4f41-93e7-fa9acf973028 service nova] Creating event network-changed:32311821-607a-46ad-9d0a-cdee0d878cac for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:53.572040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e729fe26-1942-4955-81e1-c429d87baa47 req-9d05f18a-7b08-4f41-93e7-fa9acf973028 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074986 Jul 30 21:13:53.572925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1763/3377] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:53.584739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e49d437-c753-414c-9a21-ce1743e25911 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe74310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-102822650", "description": "tempest-description-857962398"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:53.668573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-46526818", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:53.758613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] validate_networks() for [('5546fcae-a0e7-4485-9b5f-5d0385c3af60', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:13:54.249311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e49d437-c753-414c-9a21-ce1743e25911 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.674934 Jul 30 21:13:54.250128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1764/3378] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:53 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:54.262035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:54.262908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:54.271947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:54.274509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:54.277519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:54.278259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:54.908236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:54.929342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:54.938420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:54.941329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-052fae8d-9cb5-430b-bb2c-6a73e0cd9589 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.690048 Jul 30 21:13:54.949928 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1765/3379] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:54 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:54.965104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3f9a9271-a3cb-4728-9930-f2e1a95a2bbb tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe2daf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1277510517", "description": "tempest-description-117995772"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:55.433643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3f9a9271-a3cb-4728-9930-f2e1a95a2bbb tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.482209 Jul 30 21:13:55.434767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1766/3380] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:55.444988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:55.446017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:55.463144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.464786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.467617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.471408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.627996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:13:55.628502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:13:55.628911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:13:55.629558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:13:55.629800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:13:55.649260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.649754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.651669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.652858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.697046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Getting quotas for project e118fcd176734b698c4b7a48dc715d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:13:55.711472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Getting quotas for user 76afad1e6b734e858fdf1306c79d7fbd and project e118fcd176734b698c4b7a48dc715d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:13:55.746028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:13:55.754920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:13:55.835825 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1f519e5-ef52-499e-ac97-1b611f554bcb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.439175 Jul 30 21:13:55.842903 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1615/3381] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:13:55.849188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:55.850218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:55.858056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.858693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.859751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:55.860589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:55.966662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:55.988142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21612f03-0db9-4b12-8c94-3379788c536e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.551079 Jul 30 21:13:56.004968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1767/3382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:55 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:56.015018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53e1025e-08b4-4931-88f4-cb4d24635bb0 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe3aca0>, body: {"security_group_rule": {"parent_group_id": "2bf7699c-21ab-4442-9760-37c539834888", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a1e3d884-9274-4389-ad2d-6752502ef7c6"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:56.144866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.166426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.169358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.171336 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-18e90004-b89a-460e-a7f9-192276ad3cb3 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.326066 Jul 30 21:13:56.172199 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1616/3383] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:55 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:56.178472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "40231132-6acc-42a8-bb4d-8ed3653ce2d5"}, {"name": "network-changed", "server_uuid": "26a6e9cf-25f6-4641-865e-1e9953f3dcc9", "tag": "007e160c-e12e-4682-9aa7-6ffaf550dad4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:56.196273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:56.205513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:56.206340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:56.229624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] Creating event network-changed:40231132-6acc-42a8-bb4d-8ed3653ce2d5 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:56.230655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] Creating event network-changed:007e160c-e12e-4682-9aa7-6ffaf550dad4 for instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 on nch2-master-1 Jul 30 21:13:56.244763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f3f7b42c-f0f5-4b50-b0e1-65069d2f6933 req-25136dc9-67fa-4f9f-8f96-d8bcf52d4571 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070101 Jul 30 21:13:56.247651 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1617/3384] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:56.257467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd4725a8-7519-4e8b-a201-3795ffbaef8b tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:56.258531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd4725a8-7519-4e8b-a201-3795ffbaef8b tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:56.391996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd4725a8-7519-4e8b-a201-3795ffbaef8b tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.406862 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd4725a8-7519-4e8b-a201-3795ffbaef8b tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1222 microversion: 2.1 time: 0.157531 Jul 30 21:13:56.410587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1618/3385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:56 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:56.429428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:56.430670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:56.440005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:56.443953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:56.445701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:56.448438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:56.929306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.939490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.947878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:56.955578 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da8fb590-84f8-4b0a-8425-be5adb167876 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.541220 Jul 30 21:13:56.957900 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1619/3386] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:56 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:57.011727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:57.013295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:57.028034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.028561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.032381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.032864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.286330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:57.296729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1cb681b-33ca-487c-b5dd-520f833028db tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.289834 Jul 30 21:13:57.298015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1620/3387] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:57 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:13:57.303356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:57.304903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:57.313757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.315541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.316383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.317228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.410984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:57.421679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:57.425167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:57.427379 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef15634c-8d37-499e-bcf0-b1277af80c22 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.128254 Jul 30 21:13:57.428117 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1621/3388] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:57 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:57.434844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:57.436602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:57.450998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.451676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.452882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.453990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.468421 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53e1025e-08b4-4931-88f4-cb4d24635bb0 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.459570 Jul 30 21:13:57.470556 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1768/3389] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:13:56 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:57.499058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70682586-e214-4f66-a89d-394b4223c9f4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb5cbf8820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1123330233", "description": "tempest-description-1999413088"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:57.542025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:57.552645 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c705243c-1f56-42fc-87e3-b9655d05563a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1274 microversion: 2.1 time: 0.122679 Jul 30 21:13:57.553743 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1622/3390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:57 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:57.874127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:57.875659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:57.888247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.889100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.890175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:57.891477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:57.994257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'services' on Instance uuid 4cd003b4-169a-47b3-b40c-d50ef73a312a {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:13:58.097031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:58.102287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-96fd74fa-d994-4280-a340-d782cb00940a tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments/1de790c2-b9e6-4af2-8872-5feb1eaf86f8" status: 202 len: 0 microversion: 2.1 time: 0.239029 Jul 30 21:13:58.103867 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1623/3391] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:13:57 2022] DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments/1de790c2-b9e6-4af2-8872-5feb1eaf86f8 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:13:58.111568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:58.112618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:58.119927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.120665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.123889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.124587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.139040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:58.527409 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70682586-e214-4f66-a89d-394b4223c9f4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.041327 Jul 30 21:13:58.539732 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1769/3392] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:58.552646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:58.554984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:58.570600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.571059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.573648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.579622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.616334 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89e892fd-c6e1-483d-8af9-9ea2b23d44a9 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077944 Jul 30 21:13:58.617691 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1770/3393] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:13:58 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:58.623566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-01609b3e-709e-427f-a19c-2e3958af771d req-cf86ac3a-a9d4-4ce7-b889-817446b9736c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "503e2e21-98ad-4fe8-9233-11811cd01426"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:58.636783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-01609b3e-709e-427f-a19c-2e3958af771d req-cf86ac3a-a9d4-4ce7-b889-817446b9736c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.638046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-01609b3e-709e-427f-a19c-2e3958af771d req-cf86ac3a-a9d4-4ce7-b889-817446b9736c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.650822 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-01609b3e-709e-427f-a19c-2e3958af771d req-cf86ac3a-a9d4-4ce7-b889-817446b9736c service nova] Creating event network-changed:503e2e21-98ad-4fe8-9233-11811cd01426 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:13:58.658526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-01609b3e-709e-427f-a19c-2e3958af771d req-cf86ac3a-a9d4-4ce7-b889-817446b9736c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039207 Jul 30 21:13:58.660587 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1771/3394] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:58.667150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.668485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:58.669203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:58.676511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.677190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.678147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.678382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.678933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.679954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.681127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95b2d740-9392-49f8-a519-5c9d1b216f75 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.575783 Jul 30 21:13:58.681690 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1624/3395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:58 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:58.692371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:58.692999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:58.705694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.706178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.707050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:58.707572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:58.889287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.904385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.905953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:58.911848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0502059-582b-4021-a281-1862caf70a39 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.219107 Jul 30 21:13:58.912587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1625/3396] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:58 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:13:58.918120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07406d35-c601-4bdd-9c54-5a0b6453a6ed tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb62a979d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2056623104", "description": "tempest-description-1952576860"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:59.122329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:59.130447 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a24949c-3933-424d-a7fb-1e2ab0b6fb9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.468482 Jul 30 21:13:59.131424 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1772/3397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:58 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:59.151627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:59.152515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:59.165960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.166802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:59.167853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.168547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:59.448604 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07406d35-c601-4bdd-9c54-5a0b6453a6ed tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.534055 Jul 30 21:13:59.449876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1626/3398] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:13:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:13:59.465966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be99178e-d52c-4adb-930d-4f63307bba13 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb6291fc10>, body: {"security_group_rule": {"parent_group_id": "1675d3e3-9068-4da9-9909-67317bfe0cc6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7e34a1d9-5ce1-44bf-83a0-23c680460154"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:13:59.607671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:13:59.614340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:59.616740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8792a13-d266-410f-b3ea-89df93a3e6a0 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.472129 Jul 30 21:13:59.617632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1773/3399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:13:59 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:13:59.637979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:59.643689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:59.653514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.654322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:59.655556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.656990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:59.693285 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b64834e0-9e1c-4c5e-9ad2-4857f03188c1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063349 Jul 30 21:13:59.702027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1774/3400] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:13:59 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:13:59.708748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:13:59.709724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:13:59.719962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.720771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:13:59.721939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:13:59.722734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.120444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.132959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be99178e-d52c-4adb-930d-4f63307bba13 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.671546 Jul 30 21:14:00.133715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1627/3401] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:13:59 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:00.139121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:00.142033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:00.147437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.150043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.157425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96cb6254-8f99-4062-bb04-37bbd5aa3f01 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.451395 Jul 30 21:14:00.160524 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1775/3402] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:13:59 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:00.163228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.163850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.165151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.168721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.174787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:00.176391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:00.188960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.189729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.192400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.193130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.222569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Cannot 'reboot' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action HTTP/1.1 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 28 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: {"reboot": {"type": "HARD"}} Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'reboot' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b34a758e-5ea9-47fa-bee4-115ca0e7d0f9', 'body': {'reboot': {'type': 'HARD'}}} Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:14:00.229507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.233724 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.240377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 409 to user: Cannot 'reboot' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:00.248964 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1902cf1a-872b-4044-a297-9ef0762ab55c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action" status: 409 len: 145 microversion: 2.1 time: 0.113728 Jul 30 21:14:00.255980 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1628/3403] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:14:00 2022] POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action => generated 145 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:14:00.255980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee8eb292-54f7-48e7-8160-2ffaaf38fba4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb5d27c0d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:00.345784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.364541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.366339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.367952 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-93fe93fe-ab04-4f0f-a12d-cbd0c88b4857 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.205809 Jul 30 21:14:00.370515 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1776/3404] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:00 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:00.389411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:00.390272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:00.397997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.398644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.400118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.400778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.784025 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee8eb292-54f7-48e7-8160-2ffaaf38fba4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7e34a1d9-5ce1-44bf-83a0-23c680460154" status: 202 len: 0 microversion: 2.1 time: 0.532826 Jul 30 21:14:00.784726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1629/3405] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:00 2022] DELETE /compute/v2.1/os-security-groups/7e34a1d9-5ce1-44bf-83a0-23c680460154 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:00.793185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:00.801115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:00.804187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:00.809233 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6773e834-cdcf-4b74-8b3a-2f56f5e565af tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.424712 Jul 30 21:14:00.816311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1777/3406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:00 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:00.821215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:00.825525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:00.829475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.834363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.837142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.837736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.838277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.838740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.839749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.840353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.888862 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Cannot 'rebuild' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action HTTP/1.1 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 65 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'rebuild' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b34a758e-5ea9-47fa-bee4-115ca0e7d0f9', 'body': {'rebuild': {'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd'}}} Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:00.891581 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued Jul 30 21:14:00.896583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:00.897615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 409 to user: Cannot 'rebuild' instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 while it is in vm_state rescued {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:00.898165 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39992560-24c4-48f4-9d12-22817010d275 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action" status: 409 len: 146 microversion: 2.1 time: 0.111741 Jul 30 21:14:00.904528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1630/3407] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:14:00 2022] POST /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9/action => generated 146 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:14:00.915847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aaa3948f-4955-43da-b9cd-00ed8af44c56 req-aae6b84d-771a-4499-a977-4cb48cb5a79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95cc0b3-a543-482f-a9b2-a5c857a5e82a", "tag": "d396220f-2e2c-416b-aca0-ae8e7c5c8f71"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:00.928776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aaa3948f-4955-43da-b9cd-00ed8af44c56 req-aae6b84d-771a-4499-a977-4cb48cb5a79f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:00.929246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aaa3948f-4955-43da-b9cd-00ed8af44c56 req-aae6b84d-771a-4499-a977-4cb48cb5a79f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:00.945247 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aaa3948f-4955-43da-b9cd-00ed8af44c56 req-aae6b84d-771a-4499-a977-4cb48cb5a79f service nova] Creating event network-changed:d396220f-2e2c-416b-aca0-ae8e7c5c8f71 for instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a on nch1-master-1 Jul 30 21:14:00.954708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aaa3948f-4955-43da-b9cd-00ed8af44c56 req-aae6b84d-771a-4499-a977-4cb48cb5a79f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043039 Jul 30 21:14:00.955464 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1631/3408] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:00.961898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f858d4c5-58f3-4833-a145-d9fc44d66943 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb628e68b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:01.087082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f858d4c5-58f3-4833-a145-d9fc44d66943 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/1675d3e3-9068-4da9-9909-67317bfe0cc6" status: 200 len: 248 microversion: 2.1 time: 0.130202 Jul 30 21:14:01.088293 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1632/3409] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:14:00 2022] GET /compute/v2.1/os-security-groups/1675d3e3-9068-4da9-9909-67317bfe0cc6 => generated 248 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:01.100809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:01.101570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:01.109000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.110550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.112207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.113260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.142142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:01.155384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:01.338536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11a73490-ba2c-4f35-8c1d-a1a98c912283 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 204 len: 0 microversion: 2.1 time: 0.248734 Jul 30 21:14:01.339234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1633/3410] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:14:01 2022] DELETE /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:01.349833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39ac508b-3e2e-44ab-b6f1-4772080f903f tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb62a91940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1169640804", "description": "tempest-description-1846928605"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:01.441766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:01.453230 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6de07494-e23b-4362-aaa9-9cd40e1a4833 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.635465 Jul 30 21:14:01.456015 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1778/3411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:00 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:01.472010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:01.477453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:01.488625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.489104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.489910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.490372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.882449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:01.898423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:01.900765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:01.902917 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-43bb1113-14f6-4a1e-9426-60fdbb4ddf7b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.441561 Jul 30 21:14:01.903958 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1779/3412] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:01 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:01.912736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:01.913567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:01.920387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.921277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.922984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.923776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.943484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39ac508b-3e2e-44ab-b6f1-4772080f903f tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.602671 Jul 30 21:14:01.945219 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1634/3413] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:01.958205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:01.959485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:01.972312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.973136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:01.975132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:01.975667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.054021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.064581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.072494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.073967 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aeaf6195-02b7-422d-8586-397fb9e31fe6 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.124857 Jul 30 21:14:02.075244 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1635/3414] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:01 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:02.081403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-963b69ba-acae-4e77-b0ef-64cd47ecd00e req-cd564f2e-61b9-43dc-8d37-a2c94102027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a6e9cf-25f6-4641-865e-1e9953f3dcc9", "name": "network-vif-plugged", "status": "completed", "tag": "007e160c-e12e-4682-9aa7-6ffaf550dad4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:02.092403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-963b69ba-acae-4e77-b0ef-64cd47ecd00e req-cd564f2e-61b9-43dc-8d37-a2c94102027b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.092773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-963b69ba-acae-4e77-b0ef-64cd47ecd00e req-cd564f2e-61b9-43dc-8d37-a2c94102027b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.106316 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-963b69ba-acae-4e77-b0ef-64cd47ecd00e req-cd564f2e-61b9-43dc-8d37-a2c94102027b service nova] Creating event network-vif-plugged:007e160c-e12e-4682-9aa7-6ffaf550dad4 for instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 on nch2-master-1 Jul 30 21:14:02.114710 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-963b69ba-acae-4e77-b0ef-64cd47ecd00e req-cd564f2e-61b9-43dc-8d37-a2c94102027b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037850 Jul 30 21:14:02.115436 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1636/3415] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:02.120504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:02.121219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:02.129659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.130313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.131472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.132304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.201780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.210415 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b4c7b165-6f00-4fec-8836-e5ead859c7e3 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1689 microversion: 2.1 time: 0.304939 Jul 30 21:14:02.224594 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1780/3416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:01 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:02.229818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2cb6a58d-166a-4bbb-8900-532b1ec595a4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4feef040>, body: {"security_group_rule": {"parent_group_id": "733ad251-4828-402c-bdb7-9eb588c345db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:02.318192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.328297 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea239a7a-6484-4c35-983c-533d9da1dd57 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.211539 Jul 30 21:14:02.344691 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1637/3417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:02 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:02.478820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:02.497074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:02.508368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.508829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.509631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.510081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.653934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:02.663960 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a6a171ad-eb0a-4547-8508-7f405db37068 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.189059 Jul 30 21:14:02.677231 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1638/3418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:02 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:02.931650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:02.932296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:02.950136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.950761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.951489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.952544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.972333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2cb6a58d-166a-4bbb-8900-532b1ec595a4 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.748741 Jul 30 21:14:02.974174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1781/3419] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:02.979406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:02.980094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:02.989312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.990004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:02.990963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:02.991609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.027620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9021048-4a6e-4cdf-b0a0-674ed718c3d2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/ips" status: 200 len: 151 microversion: 2.20 time: 0.051636 Jul 30 21:14:03.028410 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1782/3420] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Jul 30 21:14:02 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:14:03.032980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18a13c36-ffa5-41a9-b911-e52cfe62480b tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Action: 'create', calling method: .version_select at 0x7fbb4fe74ca0>, body: {"security_group_rule": {"parent_group_id": "733ad251-4828-402c-bdb7-9eb588c345db", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:03.263022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.274447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.276358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.277877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bcce33c8-c500-43e9-b901-d5e1b535776a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.354288 Jul 30 21:14:03.292378 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1639/3421] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:02 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:03.301699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:03.303024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:03.309197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.309791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.310610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.311238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.353576 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18a13c36-ffa5-41a9-b911-e52cfe62480b tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.323971 Jul 30 21:14:03.354458 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1783/3422] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:03 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:03.392471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.402326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.404133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.405591 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c6554dd-26e1-47e4-b429-b2c11493414e tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.111978 Jul 30 21:14:03.406511 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1640/3423] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:03 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:03.417013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:03.417651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:03.425379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.426081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.427102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.427748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.430538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a65e7afe-a673-4258-b0ac-ac139a7ed9af tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Action: 'create', calling method: .version_select at 0x7fbb4fe2d820>, body: {"keypair": {"name": "tempest-keypair-1978460134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr2ma4fFZcqRigaszc9OFypX8V7FHwvFcM2+umH0T0GSPrxU1TjHqAVQpZ4Acrpi7MMCgklP9H3vHmTmcKfdwzLHed5S+90cF6tg3krkWpbFRyV/1nIIfKDRIfTO9c30Q=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:03.451074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a65e7afe-a673-4258-b0ac-ac139a7ed9af tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for project 3a35c62a04494e1f89562e4aca3a3da6. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:03.466722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a65e7afe-a673-4258-b0ac-ac139a7ed9af tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for user 7f6e06e9270a48b7bc6cecf4b2d73509 and project 3a35c62a04494e1f89562e4aca3a3da6. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:03.501376 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a65e7afe-a673-4258-b0ac-ac139a7ed9af tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145701 Jul 30 21:14:03.503578 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1784/3424] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:14:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:03.515668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:03.516500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:03.528000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.528751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.529634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.532168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.756715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.770205 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-66a86664-268b-4b85-9b22-2330d8fb0c28 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1689 microversion: 2.1 time: 0.362325 Jul 30 21:14:03.770813 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1641/3425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:03 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1689 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:03.787041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42c81159-401f-4e1e-8a12-bf2559528b99 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb62a979d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:03.825362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:03.839182 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc8551cb-b59f-4514-8178-54b7835cc93c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1314 microversion: 2.1 time: 0.326712 Jul 30 21:14:03.841880 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1785/3426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:03 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:03.847485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:03.848394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:03.859764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.860284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.861262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:03.862066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:03.873920 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-42c81159-401f-4e1e-8a12-bf2559528b99 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/733ad251-4828-402c-bdb7-9eb588c345db" status: 200 len: 665 microversion: 2.1 time: 0.098321 Jul 30 21:14:03.875723 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1642/3427] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:14:03 2022] GET /compute/v2.1/os-security-groups/733ad251-4828-402c-bdb7-9eb588c345db => generated 665 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:03.889440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ebd40c2-534b-41c4-bd53-bee9588457ba tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb6291f670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.097737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.107328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19a8eeb5-51eb-43d0-b97a-f7671038fa67 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.263921 Jul 30 21:14:04.111739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1786/3428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:03 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:04.194994 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ebd40c2-534b-41c4-bd53-bee9588457ba tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/285e6330-06cd-4cdf-bbfa-c192cfaf0cd2" status: 202 len: 0 microversion: 2.1 time: 0.310342 Jul 30 21:14:04.196434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1643/3429] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Jul 30 21:14:03 2022] DELETE /compute/v2.1/os-security-group-rules/285e6330-06cd-4cdf-bbfa-c192cfaf0cd2 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:14:04.216015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3841218-5599-416e-8f3c-4edd2d84c651 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb4feef040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.308803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.309910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:04.317056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.317685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:04.318978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.319582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:04.527732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.538561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.541118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.542359 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98ceac5c-f2d1-4788-9973-2ed70541fbc2 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.238977 Jul 30 21:14:04.551777 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1644/3430] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:04 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:04.558072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.558845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:04.570620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.571102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:04.572046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.572683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:04.585862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3841218-5599-416e-8f3c-4edd2d84c651 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/733ad251-4828-402c-bdb7-9eb588c345db" status: 202 len: 0 microversion: 2.1 time: 0.382897 Jul 30 21:14:04.588435 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1787/3431] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/733ad251-4828-402c-bdb7-9eb588c345db => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:04.614174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb4fe809d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.652303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.664181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.666158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:04.668198 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c2fbe60-1a03-47c3-a6f9-a83cf99e9d42 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.115144 Jul 30 21:14:04.669559 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1645/3432] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:04 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:04.671065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:14:04.671819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Neutron security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 not found {{(pid=130984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:14:04.672994 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] HTTP exception thrown: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.672994 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Request method failure captured: Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-security-groups/7e34a1d9-5ce1-44bf-83a0-23c680460154 HTTP/1.1 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8NPdva9vgaAZ7Tx5blXZgkPfNbp07DMos6vj33yWBgf7zg5A-K0i4KQ7ScyHq3SR_wDGEnm8-qjym-wTxFD-rOq2xURUlm-fArVfcPXXqL6HHSFRrPzAxIEs9JpkTM72_ErGhdEsXpLkOjNf0LP4wOuf8KRtIrsUjAEb95VvVOqv4 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 86b1c41454614861afe325f6cc859ba9 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1152607837 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86b1c41454614861afe325f6cc859ba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86b1c41454614861afe325f6cc859ba9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86b1c41454614861afe325f6cc859ba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86b1c41454614861afe325f6cc859ba9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1152607837 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 86b1c41454614861afe325f6cc859ba9 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1152607837 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesTestJSON-1152607837-project Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: ea502b7c80394310a36cc826e1795461 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1152607837-project Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7e34a1d9-5ce1-44bf-83a0-23c680460154'} Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:14:04.676114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] Jul 30 21:14:04.680702 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:04.685222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Returning 404 to user: Security group 7e34a1d9-5ce1-44bf-83a0-23c680460154 does not exist Jul 30 21:14:04.685222 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-fafe1110-336d-4f97-8ca5-83573812f2c0'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:04.686344 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d96b8c2c-5808-4945-b4f2-6200c42f31c7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7e34a1d9-5ce1-44bf-83a0-23c680460154" status: 404 len: 194 microversion: 2.1 time: 0.090244 Jul 30 21:14:04.688375 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1788/3433] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/7e34a1d9-5ce1-44bf-83a0-23c680460154 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:04.695818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9f31f5f-95e1-4515-9027-9798ea0abbd1 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb5c4ef1f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.792371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:04.793896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:04.809952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.811431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:04.814414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:04.815657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.053839 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9f31f5f-95e1-4515-9027-9798ea0abbd1 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/1675d3e3-9068-4da9-9909-67317bfe0cc6" status: 202 len: 0 microversion: 2.1 time: 0.361998 Jul 30 21:14:05.055140 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1646/3434] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/1675d3e3-9068-4da9-9909-67317bfe0cc6 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:05.060828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:05.061876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:05.079616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.080408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.081854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.082524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.259076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:05.271400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-280abf72-3e40-4028-9fab-70999884694b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1689 microversion: 2.1 time: 0.483562 Jul 30 21:14:05.272383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1789/3435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:04 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1689 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:05.278326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fba024a4-c431-4189-8463-1c5c3581dd17 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb4fe74ca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:05.323847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:05.353824 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e17ff3a9-f281-4166-a331-d4de1ed98c63 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1501 microversion: 2.1 time: 0.297336 Jul 30 21:14:05.356010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1647/3436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:05 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:05.371151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:05.372790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:05.380935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.381480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.382356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.382915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.554612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:05.562554 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01317e32-494c-45cb-8667-4fa5f7b7cf21 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.204318 Jul 30 21:14:05.563196 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1648/3437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:05 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:05.568187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:05.568918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:05.582165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.582816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.583794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.584532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.613459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lazy-loading 'flavor' on Instance uuid b470f888-1977-485a-82c0-0efd3d32bf06 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:14:05.679576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:05.851790 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88fffef3-291a-4af3-88f2-39f5756bec1b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/action" status: 202 len: 0 microversion: 2.20 time: 0.286821 Jul 30 21:14:05.853502 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1649/3438] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:14:05 2022] POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:05.864018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eb6cdba4-e1d8-4dc2-9a8a-89824a822a98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:05.871120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb6cdba4-e1d8-4dc2-9a8a-89824a822a98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.871730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb6cdba4-e1d8-4dc2-9a8a-89824a822a98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.897252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eb6cdba4-e1d8-4dc2-9a8a-89824a822a98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:14:05.922709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:05.960817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eb6cdba4-e1d8-4dc2-9a8a-89824a822a98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9/action" status: 202 len: 0 microversion: 2.1 time: 0.102603 Jul 30 21:14:05.962685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1650/3439] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:14:05 2022] POST /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:05.970294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:05.971004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:05.979880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.980344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:05.981131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:05.981579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.203487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.217390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.218864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.220599 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73f2d184-6ac1-47e7-a120-a778cdf6e1de tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.255962 Jul 30 21:14:06.220722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1651/3440] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:05 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:06.225278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.226341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:06.233713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.234263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.235044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.235515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.286923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fba024a4-c431-4189-8463-1c5c3581dd17 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a1e3d884-9274-4389-ad2d-6752502ef7c6" status: 202 len: 0 microversion: 2.1 time: 1.013309 Jul 30 21:14:06.290981 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1790/3441] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:05 2022] DELETE /compute/v2.1/os-security-groups/a1e3d884-9274-4389-ad2d-6752502ef7c6 => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:06.297128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.298043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:06.305919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.306297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.310455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.312963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.313834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.320560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.322600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.324245 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6c343bc-e5f6-4e68-b099-a56d82acd2d9 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1366 microversion: 2.57 time: 0.102660 Jul 30 21:14:06.342259 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1652/3442] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:06 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:06.348525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.349442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:06.357547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.358169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.359684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.360295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.396792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:06.494061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.502565 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e80deda-8adf-4966-9d7d-32571329859d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.158701 Jul 30 21:14:06.503155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1653/3443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:06 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:06.507910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-230229de-05e0-4950-9528-352a0824abe7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb62896d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.700815 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-230229de-05e0-4950-9528-352a0824abe7 tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2bf7699c-21ab-4442-9760-37c539834888" status: 202 len: 0 microversion: 2.1 time: 0.196282 Jul 30 21:14:06.701447 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1654/3444] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:06 2022] DELETE /compute/v2.1/os-security-groups/2bf7699c-21ab-4442-9760-37c539834888 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:06.706766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.707654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:06.715433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.715979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.717028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.717686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.771751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.787136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.794179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.797849 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ecfa051b-c3a7-4b04-8c38-9bb590443ba2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.503236 Jul 30 21:14:06.811134 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1791/3445] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:06 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:06.811134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:06.812358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:06.818700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.819162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.819978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:06.820425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:06.963168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:06.973349 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90ec7f27-c9a9-4f64-a911-a1050aa2b13b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1689 microversion: 2.1 time: 0.270525 Jul 30 21:14:06.974670 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1655/3446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:06 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:06.979954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de9733b5-b1e9-481c-bae3-675063a7a34f tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb6291f670>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:07.232811 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de9733b5-b1e9-481c-bae3-675063a7a34f tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/84e26d27-acc3-4efe-a606-01da0c343331" status: 202 len: 0 microversion: 2.1 time: 0.256848 Jul 30 21:14:07.233540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1656/3447] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:06 2022] DELETE /compute/v2.1/os-security-groups/84e26d27-acc3-4efe-a606-01da0c343331 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:07.242738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9119c35-29a1-4030-b013-b0776827228d tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] Calling method '.version_select at 0x7fbb628e6820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:07.257046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:07.266162 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9d0888b8-e5b8-446f-b274-a5872413e75a tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.464407 Jul 30 21:14:07.266659 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1792/3448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:06 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:07.280753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:07.282172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:07.295321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:07.308142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:07.309132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:07.309609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:07.521299 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9119c35-29a1-4030-b013-b0776827228d tempest-SecurityGroupRulesTestJSON-1152607837 tempest-SecurityGroupRulesTestJSON-1152607837-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/fb454f5e-1026-43c5-92d3-e2160fb9e353" status: 202 len: 0 microversion: 2.1 time: 0.282126 Jul 30 21:14:07.522116 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1657/3449] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:07 2022] DELETE /compute/v2.1/os-security-groups/fb454f5e-1026-43c5-92d3-e2160fb9e353 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:07.528433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1231658557", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a96f1fc9-9c66-4561-854b-dd8adf9fcc28"}], "security_groups": [{"name": "tempest-securitygroup--1476417216"}], "key_name": "tempest-keypair-1978460134", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:07.713963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] validate_networks() for [('a96f1fc9-9c66-4561-854b-dd8adf9fcc28', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:14:08.066471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.077379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.079566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.080985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-901bf290-941c-426f-bd33-233dba6b46ea tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.813393 Jul 30 21:14:08.082051 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1793/3450] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:07 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:08.087055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:08.088030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:08.095882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.096871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.097975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.098941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.386772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.405694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.408426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.410214 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df2563e1-146e-41c1-91fe-1d644ea85f69 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1372 microversion: 2.57 time: 0.326898 Jul 30 21:14:08.429236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1794/3451] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:08 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:08.435899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:08.436836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:08.446947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.447715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.449270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.449751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.511886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for project 3a35c62a04494e1f89562e4aca3a3da6. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:08.520864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for user 7f6e06e9270a48b7bc6cecf4b2d73509 and project 3a35c62a04494e1f89562e4aca3a3da6. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:08.545026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:08.547481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:08.548234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:08.549412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:08.550051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:08.587110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.588523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.589664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.590139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.620688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for project 3a35c62a04494e1f89562e4aca3a3da6. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:08.630068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Getting quotas for user 7f6e06e9270a48b7bc6cecf4b2d73509 and project 3a35c62a04494e1f89562e4aca3a3da6. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:08.648444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:14:08.651128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:14:08.749733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.754648 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20d56dd9-39e1-44a9-a05c-f1a5baae275f tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.231167 Jul 30 21:14:08.755657 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1658/3452] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:14:08.760669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:08.766860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:08.785670 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa2e211f-9f31-4f26-8edc-49d8317457be tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.353041 Jul 30 21:14:08.799363 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1795/3453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:08 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:08.799768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.799768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.799768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.799768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.808370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:08.810026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:08.831165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.834488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.836846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.838714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.911039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:08.911542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:08.912018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'fault' on Instance uuid 4cd003b4-169a-47b3-b40c-d50ef73a312a {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:14:08.914917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:08.982390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:08.991453 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-028b4973-4d36-433f-93d1-a7d4212d5818 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 200 len: 1335 microversion: 2.1 time: 0.198297 Jul 30 21:14:08.992487 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1796/3454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:08 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 1335 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:08.997446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:08.998156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:09.005001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:09.007370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.008003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.009042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.009620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.118818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.133756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.139662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.142086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b96f870-c8bc-48ad-950a-fc8cb4e5385a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.385183 Jul 30 21:14:09.143152 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1659/3455] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:08 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:09.148580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ed192049-d133-4856-80c1-2552a17bfdb1 req-c7145f26-e989-4590-86ad-89b8443926a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd003b4-169a-47b3-b40c-d50ef73a312a", "name": "network-vif-deleted", "tag": "2f6652e5-9647-4d08-8ed4-a8dd12715039"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:09.158369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ed192049-d133-4856-80c1-2552a17bfdb1 req-c7145f26-e989-4590-86ad-89b8443926a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.158952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ed192049-d133-4856-80c1-2552a17bfdb1 req-c7145f26-e989-4590-86ad-89b8443926a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.172323 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ed192049-d133-4856-80c1-2552a17bfdb1 req-c7145f26-e989-4590-86ad-89b8443926a2 service nova] Creating event network-vif-deleted:2f6652e5-9647-4d08-8ed4-a8dd12715039 for instance 4cd003b4-169a-47b3-b40c-d50ef73a312a on nch1-master-1 Jul 30 21:14:09.177773 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ed192049-d133-4856-80c1-2552a17bfdb1 req-c7145f26-e989-4590-86ad-89b8443926a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Jul 30 21:14:09.178676 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1660/3456] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:09.184009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ed5c0295-f1bf-4a63-a05f-763285095c08 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:09.184800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ed5c0295-f1bf-4a63-a05f-763285095c08 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:09.195820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:09.199575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.216346 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00a2dcb4-4955-4887-98d0-76d78b61ba71 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.222533 Jul 30 21:14:09.217184 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1797/3457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:08 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:09.233812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:09.234613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:09.241492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.241971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.242779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.243233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.258131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ed5c0295-f1bf-4a63-a05f-763285095c08 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.268317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ed5c0295-f1bf-4a63-a05f-763285095c08 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1270 microversion: 2.1 time: 0.088554 Jul 30 21:14:09.270632 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1661/3458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:09 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:09.441697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:09.442292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:09.479623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.480169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.481051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.481499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.645248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.669030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.670771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.674695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d57f37f-379c-4611-bb3e-fd4a35572ed0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.455001 Jul 30 21:14:09.692334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1798/3459] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:09 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:09.739049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.749200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.755915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:09.757140 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c6d1334-5db7-4ce6-98dc-fb3476354cc0 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1372 microversion: 2.57 time: 0.320401 Jul 30 21:14:09.759549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1662/3460] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:09 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:09.805829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:09.806454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:09.817797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.818935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:09.820952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:09.821427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.022755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.023418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 4cd003b4-169a-47b3-b40c-d50ef73a312a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:10.037293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.041476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.043459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.045331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.088761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a HTTP/1.1 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '4cd003b4-169a-47b3-b40c-d50ef73a312a'} Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:10.092445 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. Jul 30 21:14:10.098527 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:10.105425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 404 to user: Instance 4cd003b4-169a-47b3-b40c-d50ef73a312a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:10.106381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8c068ba-e992-48ac-a196-5138bd10827e tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a" status: 404 len: 111 microversion: 2.1 time: 0.090837 Jul 30 21:14:10.112515 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1663/3461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/4cd003b4-169a-47b3-b40c-d50ef73a312a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:10.117878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b148415-bd19-4fd1-8591-423ec8875920 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '.version_select at 0x7fbb6291f5e0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.122356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.142625 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-486cdf3f-60f3-4791-8d21-7beeb4b27e2d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.339903 Jul 30 21:14:10.144702 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1799/3462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:09 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:10.168290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.169232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:10.172736 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b148415-bd19-4fd1-8591-423ec8875920 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700715327" status: 202 len: 0 microversion: 2.1 time: 0.058553 Jul 30 21:14:10.173341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1664/3463] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700715327 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:10.178540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.179790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.181201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.182051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.236250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.237024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:10.246202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.246870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.247799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.248735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.409539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.430333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.434027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.440389 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a0892a5-8f32-4e4d-935e-724d73ac8b42 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.277958 Jul 30 21:14:10.441420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1800/3464] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:10.448208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.448862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:10.457097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.457767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.458586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.459460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.908546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.919800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98a3d796-c2f9-4fae-b8b9-019ca98b59c3 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1330 microversion: 2.1 time: 0.474636 Jul 30 21:14:10.923825 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1801/3465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1330 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:10.935585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b79fc7ea-7c44-444a-a7fc-7e81f7c134bf req-17706771-038f-467c-a1af-86d86594afa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95cc0b3-a543-482f-a9b2-a5c857a5e82a", "name": "network-vif-plugged", "status": "completed", "tag": "d396220f-2e2c-416b-aca0-ae8e7c5c8f71"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:10.949448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b79fc7ea-7c44-444a-a7fc-7e81f7c134bf req-17706771-038f-467c-a1af-86d86594afa0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:10.950212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b79fc7ea-7c44-444a-a7fc-7e81f7c134bf req-17706771-038f-467c-a1af-86d86594afa0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:10.959348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:10.966136 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b79fc7ea-7c44-444a-a7fc-7e81f7c134bf req-17706771-038f-467c-a1af-86d86594afa0 service nova] Creating event network-vif-plugged:d396220f-2e2c-416b-aca0-ae8e7c5c8f71 for instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a on nch1-master-1 Jul 30 21:14:10.976102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b79fc7ea-7c44-444a-a7fc-7e81f7c134bf req-17706771-038f-467c-a1af-86d86594afa0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050029 Jul 30 21:14:10.977948 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1802/3466] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:10.978076 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c1bd77f-5b45-4262-bf40-b62d339f9f78 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.743390 Jul 30 21:14:10.978917 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1665/3467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:10.992442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:10.992442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.003106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.003550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.004594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.005326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.020202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.021269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.037325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.040083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.044952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.045656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.141293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.163220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.171089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.172605 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a031d119-336d-4958-a417-69dd300557fd tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1357 microversion: 2.57 time: 0.176598 Jul 30 21:14:11.173198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1666/3468] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:11.178252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.179132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.186466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.187887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.189403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.190254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.423524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.433245 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a44cbd4-b02e-4222-874e-8fcefd4e5a67 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.258700 Jul 30 21:14:11.448079 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1667/3469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:11 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:11.458426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.461210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.470993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.471782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.472732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.473342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.508528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:11.519592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.537949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.539513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.540737 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-312b63d5-6d13-43dd-9161-c1e2213aaaed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.560925 Jul 30 21:14:11.552108 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1803/3470] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:10 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:11.568099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.569361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.590126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.590799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.591808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.601067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.678148 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-276782e2-de89-46a5-8871-e6addf664012 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 204 len: 0 microversion: 2.57 time: 0.225420 Jul 30 21:14:11.679560 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1668/3471] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:14:11 2022] DELETE /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:14:11.695447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.698335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.705943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.706632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.707616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.708525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.791234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.804498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.806651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:11.808112 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f0604b20-e868-484c-9ff3-78a4bb8b46cf tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1363 microversion: 2.57 time: 0.121268 Jul 30 21:14:11.809144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1669/3472] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:11 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1363 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:11.939573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:11.940109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:11.947636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.948636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:11.949822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:11.950929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.137848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.150446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.152352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.153882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7213992f-23c4-4622-8a1f-c533776ce315 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.600449 Jul 30 21:14:12.154672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1804/3473] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:11 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:12.160527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:12.162199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:12.169462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.171020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.173943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.174796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.244987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.255173 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81923f3b-eab9-4544-a9ed-d9b6f4810db8 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.320286 Jul 30 21:14:12.255797 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1670/3474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:11 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:12.460835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:12.461581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:12.469942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.470556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.471675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.472287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.621517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.629752 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4adca31-1b1a-4d68-829d-ff3bef2d7712 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.173569 Jul 30 21:14:12.630448 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1671/3475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:12 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:12.635266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:12.636064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:12.643095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.643906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.645528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.646017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.651914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:12.822835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.833745 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ffd5d18b-52c0-4bb7-bbbd-82e89be8a3bb tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1322 microversion: 2.1 time: 0.677731 Jul 30 21:14:12.834634 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1805/3476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:12 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:12.840693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:12.841621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:12.848150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.849965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.850642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.851670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:12.852132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:12.857538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.859147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.860414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fab796bc-e51f-4d0d-9dee-0c68879427d9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.228954 Jul 30 21:14:12.860970 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1672/3477] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:12 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:12.930304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.942325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.944017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e84c9c580a24203a9b37732bda4e135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93838542feaa41ff9c8cac14d04fc99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:12.945315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e22da013-fc4c-4a09-88c1-6006d1b6bcbc tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 200 len: 1363 microversion: 2.57 time: 0.109357 Jul 30 21:14:12.945823 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1806/3478] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:12 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 1363 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:13.179774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:13.181103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:13.190184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.190871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.192360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.193974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.276843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:13.277777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:13.287954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.288497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.289331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.289785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.469242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:13.596167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:13.610244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:13.614319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:13.616743 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f43ceedc-e598-4b05-8326-a756ce11917e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.441414 Jul 30 21:14:13.617491 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1673/3479] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:13 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:13.653658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:13.654606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:13.662406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.663078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.664104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.664706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.677083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:13.689520 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c707ed89-acef-4eb2-9a02-dd16d80ffb6b tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.416649 Jul 30 21:14:13.704271 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1807/3480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:13 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:13.856364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:13.857341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:13.864995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.865877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.867269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:13.868135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:13.977299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:13.994442 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0fd96dc6-1517-4aba-8b3d-4c452591feb2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.342729 Jul 30 21:14:13.994442 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1674/3481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:13 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:13.997657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:14.000655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:14.012302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.012942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.013889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.019345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.193647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:14.204302 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d794bf7a-fc96-449e-b153-782aeac23000 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1519 microversion: 2.1 time: 0.352955 Jul 30 21:14:14.207974 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1808/3482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:13 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1519 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:14.214959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:14.218958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] [instance: 6b5687e6-6d6d-474b-bf1d-309889298872] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:14.249071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.250023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.253141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.255432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.291116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] HTTP exception thrown: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Request method failure captured: Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 HTTP/1.1 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z71sfgafBfZenPa8vawGOD-2iOGWYwxNrdxnGd5VEXKsfXcjqsqcMPP1-ED_eJ83XYkhDXdmhwcIDZ2grVgokIHuEl2kNya123o7-sXf5XY9h32f-WNOXPpzqen01BhpFHngFPvNUXKznoCyAWfdltIgWD-hbwdPxIZl5Eo6Jz6-WY Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.57 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 93838542feaa41ff9c8cac14d04fc99a Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerShowV257Test-75139688 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/93838542feaa41ff9c8cac14d04fc99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_93838542feaa41ff9c8cac14d04fc99a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93838542feaa41ff9c8cac14d04fc99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/93838542feaa41ff9c8cac14d04fc99a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerShowV257Test-75139688 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 93838542feaa41ff9c8cac14d04fc99a Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerShowV257Test-75139688 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerShowV257Test-75139688-project Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6e84c9c580a24203a9b37732bda4e135 Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerShowV257Test-75139688-project Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6b5687e6-6d6d-474b-bf1d-309889298872'} Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.293719 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. Jul 30 21:14:14.298474 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.306882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] Returning 404 to user: Instance 6b5687e6-6d6d-474b-bf1d-309889298872 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:14.307991 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0dfc7da1-ce49-4179-ad38-c7572ab3fdc5 tempest-ServerShowV257Test-75139688 tempest-ServerShowV257Test-75139688-project] 10.222.0.17 "GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872" status: 404 len: 111 microversion: 2.57 time: 0.099021 Jul 30 21:14:14.309026 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1809/3483] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:14 2022] GET /compute/v2.1/servers/6b5687e6-6d6d-474b-bf1d-309889298872 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:14.315068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f2b65f2-6ac5-4d71-af23-e51f8fcbb159 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1544897011", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f2b65f2-6ac5-4d71-af23-e51f8fcbb159 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 243 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1544897011", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1544897011', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5546fcae-a0e7-4485-9b5f-5d0385c3af60'}]}}} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:14.325118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.330442 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.335880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f2b65f2-6ac5-4d71-af23-e51f8fcbb159 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:14.337070 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f2b65f2-6ac5-4d71-af23-e51f8fcbb159 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026922 Jul 30 21:14:14.340140 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1810/3484] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:14 2022] POST /compute/v2.1/servers => generated 175 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:14.354239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:14.356843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: a346255f-2920-4a9e-801e-1dd6a0ba08fe] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:14.376091 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] HTTP exception thrown: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/a346255f-2920-4a9e-801e-1dd6a0ba08fe/metadata HTTP/1.1 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'a346255f-2920-4a9e-801e-1dd6a0ba08fe'} Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.384363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.388635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:14.388635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:14.388635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. Jul 30 21:14:14.388635 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.391609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 404 to user: Instance a346255f-2920-4a9e-801e-1dd6a0ba08fe could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:14.392879 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-07433764-eb35-4178-bb10-7ee3c0c9dc57 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/a346255f-2920-4a9e-801e-1dd6a0ba08fe/metadata" status: 404 len: 111 microversion: 2.1 time: 0.046377 Jul 30 21:14:14.396628 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1811/3485] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:14:14 2022] GET /compute/v2.1/servers/a346255f-2920-4a9e-801e-1dd6a0ba08fe/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:14.439343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:14.462956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:14.464955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:14.466729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56b8bb8b-1c5c-4394-a837-937fecee105f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.472668 Jul 30 21:14:14.468956 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1675/3486] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:13 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:14.488767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3406fe58-e6cd-456c-bdc0-ff46267714cd req-a86ac1fe-c260-4008-b741-efc64243746d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1827d384-d5f8-4f58-ab27-9988b01a6d5d", "tag": "79ce3b06-ef96-4dd2-bd64-4d21163fcd94"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:14.500777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1323565-eb90-4541-8a94-5b7ee74eecc9 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1852351752", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:14.517513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3406fe58-e6cd-456c-bdc0-ff46267714cd req-a86ac1fe-c260-4008-b741-efc64243746d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.518324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3406fe58-e6cd-456c-bdc0-ff46267714cd req-a86ac1fe-c260-4008-b741-efc64243746d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1323565-eb90-4541-8a94-5b7ee74eecc9 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 499 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1852351752", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1852351752', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5546fcae-a0e7-4485-9b5f-5d0385c3af60'}]}}} Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:14:14.520307 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1323565-eb90-4541-8a94-5b7ee74eecc9 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1323565-eb90-4541-8a94-5b7ee74eecc9 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.025985 Jul 30 21:14:14.523942 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1676/3487] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:14 2022] POST /compute/v2.1/servers => generated 687 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:14:14.552265 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3406fe58-e6cd-456c-bdc0-ff46267714cd req-a86ac1fe-c260-4008-b741-efc64243746d service nova] Creating event network-changed:79ce3b06-ef96-4dd2-bd64-4d21163fcd94 for instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d on nch2-master-1 Jul 30 21:14:14.559875 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3406fe58-e6cd-456c-bdc0-ff46267714cd req-a86ac1fe-c260-4008-b741-efc64243746d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074783 Jul 30 21:14:14.561023 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1812/3488] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:14.641225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:14.642435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:14.659969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.660659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.661625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.662413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.711330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:14.712005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:14.731152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.736599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:14.739485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:14.740053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.075868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.090813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.096116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.097405 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9f0e2e9-9a00-41bd-855a-edce6a45e713 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.460673 Jul 30 21:14:15.101960 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1677/3489] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:14 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:15.112186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb8e1777-41cd-433b-b707-a3cf7e04b813 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1862070770", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb8e1777-41cd-433b-b707-a3cf7e04b813 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 500 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1862070770", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1862070770', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5546fcae-a0e7-4485-9b5f-5d0385c3af60'}]}}} Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:14:15.118085 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.121366 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.129928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb8e1777-41cd-433b-b707-a3cf7e04b813 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:15.131574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb8e1777-41cd-433b-b707-a3cf7e04b813 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.027736 Jul 30 21:14:15.131767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.132756 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1678/3490] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:15.146525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.147519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.149979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa5b3b2a-fdc5-48d8-a4a5-5e973cd94c03 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.443447 Jul 30 21:14:15.164097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1813/3491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:14 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:15.165958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.166469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.167563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.168019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.207525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f06c385-3e4d-4c52-8fac-63d7fc8f5409 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-999961018", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f06c385-3e4d-4c52-8fac-63d7fc8f5409 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 753 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-999961018", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-999961018', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5546fcae-a0e7-4485-9b5f-5d0385c3af60'}]}}} Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:14:15.212712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:14:15.215710 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:14:15.218709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.218709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.220558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f06c385-3e4d-4c52-8fac-63d7fc8f5409 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:15.221687 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f06c385-3e4d-4c52-8fac-63d7fc8f5409 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.018246 Jul 30 21:14:15.222492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1814/3492] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:15 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 30 21:14:15.293073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25ff679c-1a05-4a35-a2a7-167c2193d374 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2075019783", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25ff679c-1a05-4a35-a2a7-167c2193d374 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 1266 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2075019783", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5546fcae-a0e7-4485-9b5f-5d0385c3af60"}]}} Jul 30 21:14:15.300227 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2075019783', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5546fcae-a0e7-4485-9b5f-5d0385c3af60'}]}}} Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.302712 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:14:15.304146 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:14:15.306178 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 30 21:14:15.306178 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.307468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25ff679c-1a05-4a35-a2a7-167c2193d374 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:15.308807 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25ff679c-1a05-4a35-a2a7-167c2193d374 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020741 Jul 30 21:14:15.315190 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1815/3493] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 30 21:14:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 30 21:14:15.321967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.322909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: ddb36ed1-f100-470b-b82b-876c06d74ad7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.332818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] HTTP exception thrown: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/ddb36ed1-f100-470b-b82b-876c06d74ad7/metadata/test2 HTTP/1.1 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'ddb36ed1-f100-470b-b82b-876c06d74ad7', 'id': 'test2'} Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:15.334563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:15.340541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:15.340541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:15.340541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. Jul 30 21:14:15.340541 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:15.342146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 404 to user: Instance ddb36ed1-f100-470b-b82b-876c06d74ad7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:15.343831 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1df9565f-fd52-422a-9727-07e576eea606 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/ddb36ed1-f100-470b-b82b-876c06d74ad7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.025836 Jul 30 21:14:15.353539 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1816/3494] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Jul 30 21:14:15 2022] GET /compute/v2.1/servers/ddb36ed1-f100-470b-b82b-876c06d74ad7/metadata/test2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:15.358969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.359797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.366513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.367272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.368338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.369032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.400794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:15.482204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3315903-87ef-4272-9aa1-9617fe381d27 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 204 len: 0 microversion: 2.1 time: 0.126973 Jul 30 21:14:15.482799 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1817/3495] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:14:15 2022] DELETE /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:15.489427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.490274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.491076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.497759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0953734a-9832-4804-810a-8ca946247148 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.362388 Jul 30 21:14:15.498099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.498479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1679/3496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:15 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:15.498608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.499402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.499863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.505007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.505708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.511862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.512622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.513531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.513992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.526399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:15.541863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:15.626643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5185d2c-d80b-4990-b247-2492899e67f4 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 204 len: 0 microversion: 2.1 time: 0.142233 Jul 30 21:14:15.627216 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1818/3497] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:14:15 2022] DELETE /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:15.633981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.634702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.641417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.641898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.642880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.643360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.740969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.750124 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8827de4d-dd99-45b1-831c-a5712345d022 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1508 microversion: 2.1 time: 0.249345 Jul 30 21:14:15.765898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1680/3498] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:15 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:15.771666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:15.772626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:15.782306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.783021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.784130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:15.784811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:15.932447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.944081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.946319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.947260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:15.947818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2651ebcb-fb54-4eba-a200-76006e56028a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.318894 Jul 30 21:14:15.948579 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1819/3499] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:15 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:15.956490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-40aa1431-9f83-4df5-9abb-e753a9d93332 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1525 microversion: 2.1 time: 0.189229 Jul 30 21:14:15.957913 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1681/3500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:15 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:16.128595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:16.129540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:16.137239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.137916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.139669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.140600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.174146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:16.174872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:16.185724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.186200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.187693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.188163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.321076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:16.332839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:16.335434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:16.337487 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b458c065-63e0-4922-aec6-c0eb1ab9635c tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.212941 Jul 30 21:14:16.338604 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1820/3501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:16 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:16.371112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:16.380860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-192d805a-c237-4135-837b-28948b2b418d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.211644 Jul 30 21:14:16.392483 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1682/3502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:16 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:16.521255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:16.522208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:16.529740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.530311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.531721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.532241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.706886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:16.715370 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9dd888f4-733a-4084-8070-196749f143c3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.199212 Jul 30 21:14:16.716574 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1821/3503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:16 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:16.776517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:16.777144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:16.785858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.786770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:16.788095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:16.788700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.046341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:17.061455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-24aa03f8-43d5-4f9a-82ba-506a6b072695 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1508 microversion: 2.1 time: 0.289433 Jul 30 21:14:17.063568 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1683/3504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:16 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:17.081238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:17.083050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:17.095938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.096405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.097195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.097908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.184929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6c971ab9-58b9-43fe-a797-404a5397ebee tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Action: 'create', calling method: .version_select at 0x7fbb4fee4940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1331090731"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:17.410031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:17.425616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:17.427822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:17.429871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5808ac33-171e-4692-8706-d8823ab2549d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.364904 Jul 30 21:14:17.431063 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1684/3505] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:17 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:17.441246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:17.442356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:17.453833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.454313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.455405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.456148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.632971 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6c971ab9-58b9-43fe-a797-404a5397ebee tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.674505 Jul 30 21:14:17.635253 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1822/3506] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 30 21:14:16 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 677 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 30 21:14:17.640796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:17.641451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:17.653452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.654488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.655608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.656699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.798334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76afad1e6b734e858fdf1306c79d7fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fcd176734b698c4b7a48dc715d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:17.806625 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0838f1f-456f-4d41-9d3e-6de0ba6fd668 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 200 len: 1525 microversion: 2.1 time: 0.373412 Jul 30 21:14:17.819074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1685/3507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:17 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 1525 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:17.824640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:17.825273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:17.837615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.847859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:17.848853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:17.849646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.034466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.045686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.050000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.052341 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98f5f4c3-72d4-4b22-b10b-170d1357ab58 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.415709 Jul 30 21:14:18.068179 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1823/3508] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:17 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:18.076784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95cbbb9a-8263-412e-b38c-8a078685713e tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb628958b0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.148171 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95cbbb9a-8263-412e-b38c-8a078685713e tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655" status: 200 len: 339 microversion: 2.1 time: 0.078320 Jul 30 21:14:18.148761 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1824/3509] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 => generated 339 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:18.154019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.154740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:18.161975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.162883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.163794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.164539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.190872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.199144 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-116ad98d-e810-466b-aefc-d59bb2fbef81 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.378487 Jul 30 21:14:18.199776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1686/3510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:17 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:18.218743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a7b5093b-4915-4c6f-88c7-b0c1d89bc92d req-0d05f311-91d6-4879-a70f-858251044025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95cc0b3-a543-482f-a9b2-a5c857a5e82a", "name": "network-vif-deleted", "tag": "d396220f-2e2c-416b-aca0-ae8e7c5c8f71"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:18.229833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a7b5093b-4915-4c6f-88c7-b0c1d89bc92d req-0d05f311-91d6-4879-a70f-858251044025 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.230593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a7b5093b-4915-4c6f-88c7-b0c1d89bc92d req-0d05f311-91d6-4879-a70f-858251044025 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.244898 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a7b5093b-4915-4c6f-88c7-b0c1d89bc92d req-0d05f311-91d6-4879-a70f-858251044025 service nova] Creating event network-vif-deleted:d396220f-2e2c-416b-aca0-ae8e7c5c8f71 for instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a on nch1-master-1 Jul 30 21:14:18.250905 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a7b5093b-4915-4c6f-88c7-b0c1d89bc92d req-0d05f311-91d6-4879-a70f-858251044025 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Jul 30 21:14:18.252273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1687/3511] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:18.259556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.260574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:18.267638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.268454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.269544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.270226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.354874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.366132 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb14e00b-92ea-45aa-9f25-94542e06f683 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.216011 Jul 30 21:14:18.366711 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1825/3512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:18.371847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c7ba266-082b-4761-b40f-2253dc2ba0d6 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Action: 'create', calling method: .version_select at 0x7fbb4fee4d30>, body: {"snapshot": {"volume_id": "cdadebb0-ebcf-41e7-8deb-8aa3b8414655", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1748219809"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:18.498253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:18.508540 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e67a6f9f-21be-4cb8-a7f1-524fb3552121 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1508 microversion: 2.1 time: 0.254393 Jul 30 21:14:18.513278 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1688/3513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:18.518960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.526567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:18.537523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.538210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.539846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.540896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.607092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:18.721156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c7ba266-082b-4761-b40f-2253dc2ba0d6 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.353146 Jul 30 21:14:18.723222 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1826/3514] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Jul 30 21:14:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:18.733758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a4e114e-8124-48d3-a0ff-c9ebd7ac1270 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb4fed0c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.853425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a4e114e-8124-48d3-a0ff-c9ebd7ac1270 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a" status: 200 len: 287 microversion: 2.1 time: 0.123760 Jul 30 21:14:18.854012 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1827/3515] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:14:18.859576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:18.861003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] [instance: d95cc0b3-a543-482f-a9b2-a5c857a5e82a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:18.882378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.882920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.883886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:18.884341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:18.925883 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] HTTP exception thrown: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Request method failure captured: Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a HTTP/1.1 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8Q13k6OLpSbei8JnYLCYvEfeM4FBNyrazF9inTD77fGHePAIY6c-u339ooRWgHxMWi5tI7XUsKI4wcfIfR_WcREM_7zXayqIMRNqaz_Qg50Tfh7p9V8kNFImq4-uKMQQnV199gHVCs0asWQk7bZd_oRIfEPe0yTC27zWKQnIQRu1U Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e118fcd176734b698c4b7a48dc715d4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e118fcd176734b698c4b7a48dc715d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: e118fcd176734b698c4b7a48dc715d4d Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-272754133 Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 76afad1e6b734e858fdf1306c79d7fbd Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-272754133-project Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd95cc0b3-a543-482f-a9b2-a5c857a5e82a'} Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:18.929062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. Jul 30 21:14:18.935563 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:18.940333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] Returning 404 to user: Instance d95cc0b3-a543-482f-a9b2-a5c857a5e82a could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:18.941533 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-08dd4515-3fa5-4f1a-b82c-25bd5c6eb522 tempest-ServerMetadataNegativeTestJSON-272754133 tempest-ServerMetadataNegativeTestJSON-272754133-project] 10.222.0.17 "GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a" status: 404 len: 111 microversion: 2.1 time: 0.086026 Jul 30 21:14:18.942917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1828/3516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/servers/d95cc0b3-a543-482f-a9b2-a5c857a5e82a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:18.958353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-777a44fa-0e16-433e-a0ca-cc34940a5b17 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb62895c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.088274 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-777a44fa-0e16-433e-a0ca-cc34940a5b17 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.140149 Jul 30 21:14:19.089111 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1829/3517] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:19.096090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.100727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:19.112211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.113203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:19.114181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.114870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:19.263476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:19.289257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.301847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.304172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.305894 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bba9e982-36c4-4730-a05c-c4b7173d40a8 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.791246 Jul 30 21:14:19.308868 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1689/3518] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:18 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:19.332158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7747151-f4c0-46aa-80fd-25940708556d tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c40c280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.370675 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7747151-f4c0-46aa-80fd-25940708556d tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a" status: 200 len: 288 microversion: 2.1 time: 0.044952 Jul 30 21:14:19.371273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1690/3519] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:14:19 2022] GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:19.382879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.383560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:19.392145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.392928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:19.394392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.395031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:19.596645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.604992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.619801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:19.621186 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fb9d356-b4a7-4b41-b1af-1b27794f2bbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.530907 Jul 30 21:14:19.622348 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1830/3520] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:19 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:19.627640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3501cc71-de76-4bfd-adc4-33ff18191323 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb4fe3c040>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.707732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3501cc71-de76-4bfd-adc4-33ff18191323 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a" status: 202 len: 0 microversion: 2.1 time: 0.084018 Jul 30 21:14:19.711917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1831/3521] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:14:19 2022] DELETE /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:19.716746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:19.717457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:19.731800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.732382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:19.735527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:19.736215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.121987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:20.143561 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b71d46e-0721-46fe-bdef-ce699be68462 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.425114 Jul 30 21:14:20.145759 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1832/3522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:19 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:20.178071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:20.179215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:20.227061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.228154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.229183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.229904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.385544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:20.394951 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef8f144f-8e92-4c5c-8b14-bf59445f68ae tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 1.022182 Jul 30 21:14:20.405387 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1691/3523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:19 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:20.410718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42c82818-65c9-418b-a02f-27f1e040e317 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c18b040>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:20.449015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-42c82818-65c9-418b-a02f-27f1e040e317 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] HTTP exception thrown: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42c82818-65c9-418b-a02f-27f1e040e317 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Request method failure captured: Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a HTTP/1.1 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8ortRVwc7u31lC_E5JqZFbfwBe8wyi-6knWf0Pt4I6kQgkM_P4zMGtH_PCLtBH330X0iLrmFW6B0rsP3ortLwob8MXyjMaTWxACJbJogSXeplgspqp41Xo5m6UK0aWqidOT03BD8JufQQSIQoc-S1Ab9d88nGKYZUfGkRV6rDpKVY Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bddb6ea5e6b470592072376351e7ac4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 046af69274664f7abac7cd594988a66c Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: exception: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c4f57fc6-14c3-4411-aa90-c8dada34727a'} Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. (HTTP 404) (Request-ID: req-966a6d5e-3834-4fe9-8124-ee220ecaa299) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:14:20.470109 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. Jul 30 21:14:20.475079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:20.479166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:20.481099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42c82818-65c9-418b-a02f-27f1e040e317 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Returning 404 to user: Snapshot c4f57fc6-14c3-4411-aa90-c8dada34727a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:20.482229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-42c82818-65c9-418b-a02f-27f1e040e317 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a" status: 404 len: 111 microversion: 2.1 time: 0.075481 Jul 30 21:14:20.485528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1692/3524] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:14:20 2022] GET /compute/v2.1/os-snapshots/c4f57fc6-14c3-4411-aa90-c8dada34727a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:20.488175 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-880a0524-1ec9-449b-8748-8ce3609c7c67 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 200 len: 1466 microversion: 2.1 time: 0.340876 Jul 30 21:14:20.488870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1833/3525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:20 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 1466 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:20.502287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1de5063d-488a-4b99-988c-0c6c606f5c86 req-6534d559-b595-4113-9f5b-29d4d5b37bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1827d384-d5f8-4f58-ab27-9988b01a6d5d", "name": "network-vif-plugged", "status": "completed", "tag": "79ce3b06-ef96-4dd2-bd64-4d21163fcd94"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:20.516322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1de5063d-488a-4b99-988c-0c6c606f5c86 req-6534d559-b595-4113-9f5b-29d4d5b37bfa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.516789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1de5063d-488a-4b99-988c-0c6c606f5c86 req-6534d559-b595-4113-9f5b-29d4d5b37bfa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.520733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:20.521713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:20.536481 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1de5063d-488a-4b99-988c-0c6c606f5c86 req-6534d559-b595-4113-9f5b-29d4d5b37bfa service nova] Creating event network-vif-plugged:79ce3b06-ef96-4dd2-bd64-4d21163fcd94 for instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d on nch2-master-1 Jul 30 21:14:20.537537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.543985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1de5063d-488a-4b99-988c-0c6c606f5c86 req-6534d559-b595-4113-9f5b-29d4d5b37bfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056517 Jul 30 21:14:20.544607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1693/3526] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:20.545195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.547736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.548371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.565076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10f9ca88-0922-4c9b-9e9d-96280a049f78 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c118310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:20.691971 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-10f9ca88-0922-4c9b-9e9d-96280a049f78 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655" status: 202 len: 0 microversion: 2.1 time: 0.145976 Jul 30 21:14:20.694021 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1694/3527] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:14:20 2022] DELETE /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:20.701012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:20.701804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:20.719168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.719591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.722674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:20.723989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:20.766262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:21.412005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.425471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.432703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.434096 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07cfacad-f333-4940-b690-33dde3fe0173 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.738472 Jul 30 21:14:21.434940 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1695/3528] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:20 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:21.460185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a6c37fa-ec78-4ad6-9f92-6a658e7b202a tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c117d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:21.515274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3a6c37fa-ec78-4ad6-9f92-6a658e7b202a tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] HTTP exception thrown: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a6c37fa-ec78-4ad6-9f92-6a658e7b202a tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Request method failure captured: Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 HTTP/1.1 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8ortRVwc7u31lC_E5JqZFbfwBe8wyi-6knWf0Pt4I6kQgkM_P4zMGtH_PCLtBH330X0iLrmFW6B0rsP3ortLwob8MXyjMaTWxACJbJogSXeplgspqp41Xo5m6UK0aWqidOT03BD8JufQQSIQoc-S1Ab9d88nGKYZUfGkRV6rDpKVY Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bddb6ea5e6b470592072376351e7ac4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 046af69274664f7abac7cd594988a66c Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'cdadebb0-ebcf-41e7-8deb-8aa3b8414655'} Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. (HTTP 404) (Request-ID: req-53f549b5-7cf5-46cb-95cf-9dfd2ee5d67f) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:14:21.519491 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:21.523495 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:21.544239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a6c37fa-ec78-4ad6-9f92-6a658e7b202a tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Returning 404 to user: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:21.549228 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a6c37fa-ec78-4ad6-9f92-6a658e7b202a tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655" status: 404 len: 109 microversion: 2.1 time: 0.112590 Jul 30 21:14:21.560437 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1696/3529] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:14:21 2022] GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:21.568735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0248d36d-29ee-4743-91d1-78320deff35f req-f8a0b48f-736a-44f6-a829-03004bbcca3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34a758e-5ea9-47fa-bee4-115ca0e7d0f9", "name": "network-vif-deleted", "tag": "41c8040e-13f4-4674-a483-0056062f66f2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:21.605016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0248d36d-29ee-4743-91d1-78320deff35f req-f8a0b48f-736a-44f6-a829-03004bbcca3a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:21.606091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0248d36d-29ee-4743-91d1-78320deff35f req-f8a0b48f-736a-44f6-a829-03004bbcca3a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:21.651861 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0248d36d-29ee-4743-91d1-78320deff35f req-f8a0b48f-736a-44f6-a829-03004bbcca3a service nova] Creating event network-vif-deleted:41c8040e-13f4-4674-a483-0056062f66f2 for instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 on nch2-master-1 Jul 30 21:14:21.666497 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0248d36d-29ee-4743-91d1-78320deff35f req-f8a0b48f-736a-44f6-a829-03004bbcca3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102151 Jul 30 21:14:21.668720 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1697/3530] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:21.682142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:21.685239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:21.724866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:21.725381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:21.728021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:21.728499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:21.933512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.950906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.954761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:21.957759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f2c30c3f-80e3-4ba2-a74e-0d1454625969 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 1.452341 Jul 30 21:14:21.978460 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1834/3531] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:20 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:21.978460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:21.978460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:21.996766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:21.997244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.002585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.003673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.050292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:22.059549 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e580cf1-399a-4828-b886-11a6fefb20c4 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.389319 Jul 30 21:14:22.063165 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1698/3532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:21 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:22.067950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.076071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: b34a758e-5ea9-47fa-bee4-115ca0e7d0f9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:22.083442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.084143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.085107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.085727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.101807 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 HTTP/1.1 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b34a758e-5ea9-47fa-bee4-115ca0e7d0f9'} Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.104127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. Jul 30 21:14:22.109761 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.111365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 404 to user: Instance b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:22.112448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6614b5e7-2a4d-4f0c-b593-2336e76f92d1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9" status: 404 len: 111 microversion: 2.1 time: 0.048124 Jul 30 21:14:22.116415 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1699/3533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:22 2022] GET /compute/v2.1/servers/b34a758e-5ea9-47fa-bee4-115ca0e7d0f9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:22.121453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad58ccbc-23e1-4fee-8b15-8ba1d3097344 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c118af0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.154484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ad58ccbc-23e1-4fee-8b15-8ba1d3097344 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] HTTP exception thrown: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad58ccbc-23e1-4fee-8b15-8ba1d3097344 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Request method failure captured: Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 HTTP/1.1 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8ortRVwc7u31lC_E5JqZFbfwBe8wyi-6knWf0Pt4I6kQgkM_P4zMGtH_PCLtBH330X0iLrmFW6B0rsP3ortLwob8MXyjMaTWxACJbJogSXeplgspqp41Xo5m6UK0aWqidOT03BD8JufQQSIQoc-S1Ab9d88nGKYZUfGkRV6rDpKVY Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bddb6ea5e6b470592072376351e7ac4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 046af69274664f7abac7cd594988a66c Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'cdadebb0-ebcf-41e7-8deb-8aa3b8414655'} Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. (HTTP 404) (Request-ID: req-a08f587c-04ed-49e0-8aef-e61aaffebd71) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:14:22.157779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.161772 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.166509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad58ccbc-23e1-4fee-8b15-8ba1d3097344 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Returning 404 to user: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:22.167594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad58ccbc-23e1-4fee-8b15-8ba1d3097344 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655" status: 404 len: 109 microversion: 2.1 time: 0.049875 Jul 30 21:14:22.168648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1700/3534] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:14:22 2022] DELETE /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:22.176291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.177179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:22.185201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.186690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.188238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.188695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.216360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:22.286710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:22.298337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7a0a9b3-de95-4404-94d6-2ef76a387e9d tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1396 microversion: 2.1 time: 0.333398 Jul 30 21:14:22.301186 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1835/3535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:21 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:22.309617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab7be6fb-4df2-405a-8fae-28194ae58877 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Calling method '.version_select at 0x7fbb5c2e6a60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.342092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11acf39f-f7d5-415f-994d-d2ba5ecd7def tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 204 len: 0 microversion: 2.1 time: 0.171528 Jul 30 21:14:22.346393 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1701/3536] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:14:22 2022] DELETE /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:22.353619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.354538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:22.356134 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ab7be6fb-4df2-405a-8fae-28194ae58877 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] HTTP exception thrown: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab7be6fb-4df2-405a-8fae-28194ae58877 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Request method failure captured: Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 HTTP/1.1 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z8ortRVwc7u31lC_E5JqZFbfwBe8wyi-6knWf0Pt4I6kQgkM_P4zMGtH_PCLtBH330X0iLrmFW6B0rsP3ortLwob8MXyjMaTWxACJbJogSXeplgspqp41Xo5m6UK0aWqidOT03BD8JufQQSIQoc-S1Ab9d88nGKYZUfGkRV6rDpKVY Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bddb6ea5e6b470592072376351e7ac4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bddb6ea5e6b470592072376351e7ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 8bddb6ea5e6b470592072376351e7ac4 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-895483676 Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 046af69274664f7abac7cd594988a66c Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesSnapshotsTestJSON-895483676-project Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: exception: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'cdadebb0-ebcf-41e7-8deb-8aa3b8414655'} Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. (HTTP 404) (Request-ID: req-125db248-f420-4afd-9541-ba676a4b5e24) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:14:22.358347 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. Jul 30 21:14:22.362906 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:22.365314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.365314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.365314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.365314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.367855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ab7be6fb-4df2-405a-8fae-28194ae58877 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] Returning 404 to user: Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:22.368978 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ab7be6fb-4df2-405a-8fae-28194ae58877 tempest-VolumesSnapshotsTestJSON-895483676 tempest-VolumesSnapshotsTestJSON-895483676-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655" status: 404 len: 109 microversion: 2.1 time: 0.066564 Jul 30 21:14:22.369790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1836/3537] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:14:22 2022] GET /compute/v2.1/os-volumes/cdadebb0-ebcf-41e7-8deb-8aa3b8414655 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:22.459105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.459832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:22.472763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.473235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.474282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:22.474714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:22.702306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:22.714838 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7216f3bb-a478-45ab-ae5f-789a5d191ae1 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.367102 Jul 30 21:14:22.715851 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1702/3538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:22 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:22.987374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:22.988554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:23.023589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.031909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.032939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.033402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.255643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.275868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.277860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.284088 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-455118b0-a87f-40d5-8989-c96b0ab46c87 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.829726 Jul 30 21:14:23.285242 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1837/3539] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:22 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:23.298541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:23.299835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:23.312449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.320477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.321610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.322289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.414724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.426858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.431130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.434302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79df54b9-4ea9-42cb-b1d3-3fef603d147d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.451931 Jul 30 21:14:23.437283 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1703/3540] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:22 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:23.445298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:23.446139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:23.461700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.462676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.464885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.466098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.718953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.731075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01c25e1c-6766-4e05-9bbd-82a7c306f825 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1577 microversion: 2.1 time: 0.289395 Jul 30 21:14:23.732499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1704/3541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:23 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1577 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:23.748680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:23.749967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:23.760151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.760619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.761416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.761876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.928714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.947337 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6bc1c7f-ae3c-491f-85e8-6553bd9c1b48 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.660604 Jul 30 21:14:23.947991 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1838/3542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:23 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:23.963162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:23.963759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:23.965364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:23.974074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.975261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:23.975859 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e1e80f5-2397-4aee-b09a-c9e154b78761 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.242036 Jul 30 21:14:23.976479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1705/3543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:23 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:23.978409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:23.979350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.194889 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-54fc3f2a-4a6b-4242-a9dd-64c324c86588 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238350 Jul 30 21:14:24.202942 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1839/3544] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:14:23 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:24.315479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:24.316430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:24.335050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.337625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.338738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.340823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.462928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:24.463596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:24.476727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.477202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.478073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.478739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.714550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:24.725962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:24.727546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:24.728771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c52510ff-088f-4b37-9d69-533b219c2afc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1744 microversion: 2.20 time: 0.419658 Jul 30 21:14:24.745822 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1706/3545] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:24 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1744 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:24.974378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:24.975480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:24.986037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.989046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.991374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:24.993205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:24.994986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:25.007347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:25.013200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:25.019707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eef7f714-d945-42ff-954e-c4802eb7b3ad tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.560080 Jul 30 21:14:25.020597 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1840/3546] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:24 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:25.027855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:25.032260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:25.050943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:25.051991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:25.054088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:25.056600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:25.085513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:25.361463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:25.390825 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f240cd3-944a-4782-88dc-e5b3bc5d2fe8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.422199 Jul 30 21:14:25.394017 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1707/3547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:24 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:25.459817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:25.474810 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-da8342be-78c5-4eca-b28b-18ee5653b12c tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.450084 Jul 30 21:14:25.484063 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1841/3548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:25 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:25.755102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:25.756368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:25.770287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:25.774551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:25.778591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:25.779912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.049892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:26.052444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:26.075527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.078007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.080270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.083139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.255648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:26.268868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:26.276999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:26.278874 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b92c0576-b101-488e-8702-2eafcd586077 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1744 microversion: 2.20 time: 0.530167 Jul 30 21:14:26.281991 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1708/3549] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:25 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1744 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:26.362435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:26.363569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:26.375661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.386837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.388612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.389235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.745157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:26.768162 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8dd256a7-aaa7-4d01-a36d-ce7766459877 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1577 microversion: 2.1 time: 0.408336 Jul 30 21:14:26.771086 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1709/3550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:26 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1577 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:26.797134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-584419e4-9e1f-4250-bccb-21dc455bd2c6 req-1e5a0062-062c-405c-843a-241017fb0cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1827d384-d5f8-4f58-ab27-9988b01a6d5d", "tag": "79ce3b06-ef96-4dd2-bd64-4d21163fcd94"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:26.836233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-584419e4-9e1f-4250-bccb-21dc455bd2c6 req-1e5a0062-062c-405c-843a-241017fb0cc8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.836966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-584419e4-9e1f-4250-bccb-21dc455bd2c6 req-1e5a0062-062c-405c-843a-241017fb0cc8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.866458 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-584419e4-9e1f-4250-bccb-21dc455bd2c6 req-1e5a0062-062c-405c-843a-241017fb0cc8 service nova] Creating event network-changed:79ce3b06-ef96-4dd2-bd64-4d21163fcd94 for instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d on nch2-master-1 Jul 30 21:14:26.881298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-584419e4-9e1f-4250-bccb-21dc455bd2c6 req-1e5a0062-062c-405c-843a-241017fb0cc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108572 Jul 30 21:14:26.891460 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1710/3551] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:26.909402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:26.910420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:26.913920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:26.922344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.928228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:26.929425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:26.930093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.237050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:27.253791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:27.257430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:27.262023 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f85d8200-2b05-4931-b05f-388019c12ff6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 1.217062 Jul 30 21:14:27.264220 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1842/3552] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:26 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:27.287754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ce732fbe-364c-471a-836b-00589cda5597 req-60b0561c-5b16-4661-bc73-53aa8f94a238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:27.313107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ce732fbe-364c-471a-836b-00589cda5597 req-60b0561c-5b16-4661-bc73-53aa8f94a238 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:27.316796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ce732fbe-364c-471a-836b-00589cda5597 req-60b0561c-5b16-4661-bc73-53aa8f94a238 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.348369 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ce732fbe-364c-471a-836b-00589cda5597 req-60b0561c-5b16-4661-bc73-53aa8f94a238 service nova] Creating event network-vif-plugged:ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:27.364314 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ce732fbe-364c-471a-836b-00589cda5597 req-60b0561c-5b16-4661-bc73-53aa8f94a238 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093868 Jul 30 21:14:27.365670 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1843/3553] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:27.377945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:27.380342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:27.386624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:27.399573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:27.400505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.402011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:27.403340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.411392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df4b6263-f11e-4358-8a7d-55c7bf2fffac tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.517179 Jul 30 21:14:27.430065 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1711/3554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:26 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:27.437898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:27.438836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:27.446749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:27.447527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.448604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:27.449258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:27.911062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:27.920317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d098df6b-9d42-436f-a3f1-8ccff57a0162 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1521 microversion: 2.1 time: 0.553235 Jul 30 21:14:27.938826 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1844/3555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:27 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:28.290986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:28.291696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:28.333203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:28.344307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:28.352853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:28.358031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:28.674966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:28.685703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:28.690435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:28.693682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72386304-6afa-49f4-a57b-ac9a7c41ab79 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 1.262220 Jul 30 21:14:28.695969 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1712/3556] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:27 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:28.715016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:28.716215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:28.727813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:28.728447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:28.732324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:28.733089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.194796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:29.206702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ede70b49-c375-4a8d-a6a8-e51719027b5e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.507083 Jul 30 21:14:29.212242 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1713/3557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:28 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:29.226109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:29.227493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:29.245655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.246733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.248537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.250243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.330673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:29.364335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.366845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.371030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lazy-loading 'fault' on Instance uuid 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:14:29.572282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b930b074300497fa17ae36dc074c586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef0a07428164b708be97eebe5547697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:29.586989 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bbc6b43a-2c9c-4047-b722-1607e58539f0 tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 200 len: 1311 microversion: 2.1 time: 0.372932 Jul 30 21:14:29.588504 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1714/3558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:29 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:29.595839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5c89bd4a-a9d9-432c-b070-183b3a4c1df0 req-a1c81d48-36ba-429e-a273-074567281e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdffb63-cce7-4f8c-93e6-1e91d1a86b33", "name": "network-vif-deleted", "tag": "9d400d81-f07e-4a3a-9e3f-1e017498e75b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:29.610344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5c89bd4a-a9d9-432c-b070-183b3a4c1df0 req-a1c81d48-36ba-429e-a273-074567281e90 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.611433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5c89bd4a-a9d9-432c-b070-183b3a4c1df0 req-a1c81d48-36ba-429e-a273-074567281e90 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.629950 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5c89bd4a-a9d9-432c-b070-183b3a4c1df0 req-a1c81d48-36ba-429e-a273-074567281e90 service nova] Creating event network-vif-deleted:9d400d81-f07e-4a3a-9e3f-1e017498e75b for instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 on nch1-master-1 Jul 30 21:14:29.637490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5c89bd4a-a9d9-432c-b070-183b3a4c1df0 req-a1c81d48-36ba-429e-a273-074567281e90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046736 Jul 30 21:14:29.638670 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1715/3559] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:29.664442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "503e2e21-98ad-4fe8-9233-11811cd01426"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:29.697392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.698597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.720773 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] Creating event network-vif-plugged:ffec9a68-9575-4c4a-b8ed-fef2ddd7ccfd for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:29.721810 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] Creating event network-vif-plugged:503e2e21-98ad-4fe8-9233-11811cd01426 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:29.729294 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5bb70277-0792-4fbd-9dd6-4979c09e7f14 req-fd193253-e7c0-453c-8d68-1fabf32deffd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073633 Jul 30 21:14:29.730211 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1716/3560] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:29.744507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:29.746748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:29.762699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.766342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:29.770834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:29.771675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:30.074845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.096573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.103673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.106876 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2d10cd0-2e5a-4fd4-b4eb-e283796b8a36 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.375475 Jul 30 21:14:30.111248 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1717/3561] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:29 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:30.122717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.133982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.138356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.144849 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-948461f4-e29e-4227-993b-12293a2bc34a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 1.857796 Jul 30 21:14:30.147461 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1845/3562] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:28 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:30.235535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:30.236570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:30.251531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:30.252732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:30.253777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:30.255268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:30.544488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:30.560262 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2963db4-5a1f-440f-a8b2-0ef01187d9ce tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.329258 Jul 30 21:14:30.561580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1718/3563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:30 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:30.611319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:30.612046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] [instance: 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:30.625534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:30.626547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:30.629346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:30.630360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:30.676445 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] HTTP exception thrown: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Request method failure captured: Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 HTTP/1.1 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4fWDVFypPV17Pz4lktANwRhcbZopqgot-Dw-YZLbQcGUEXtlOt0CMCyfH9JNZE5dq7J_7YJaVe7RQSHvGZewRCExtBLQe_uPUnqdYzvMb4vMbf4j9c4krCk_XUcpxaDM-JRSknB8DZdqO-YqP40yW38WKBf-yCOiclN0-pMo12kh4 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aef0a07428164b708be97eebe5547697"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aef0a07428164b708be97eebe5547697", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aef0a07428164b708be97eebe5547697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: aef0a07428164b708be97eebe5547697 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115835355 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8b930b074300497fa17ae36dc074c586 Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115835355-project Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6cdffb63-cce7-4f8c-93e6-1e91d1a86b33'} Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:30.678331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:30.684606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] Returning 404 to user: Instance 6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:30.686131 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a26921a8-d38b-4ebe-b3a7-b9dc30f4c25b tempest-ServerRescueNegativeTestJSON-115835355 tempest-ServerRescueNegativeTestJSON-115835355-project] 10.222.0.17 "GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33" status: 404 len: 111 microversion: 2.1 time: 0.078423 Jul 30 21:14:30.693218 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1846/3564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:30 2022] GET /compute/v2.1/servers/6cdffb63-cce7-4f8c-93e6-1e91d1a86b33 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:31.143511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:31.144344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:31.161252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:31.162123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:31.163130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:31.163784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:31.431893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a08398c-0344-424f-bc01-dbec58d6aee3 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c11fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1207350059", "description": "tempest-description-123662369"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:31.475350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:31.498015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:31.500669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:31.502735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3637329f-7f57-4072-843e-dfdcbc7247c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.363857 Jul 30 21:14:31.505010 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1847/3565] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:31 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:31.513965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:31.516280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:31.529401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:31.530550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:31.532313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:31.533952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.214759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:32.233095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:32.238371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:32.247529 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7bde7e45-3de0-404b-a231-7105bd0a3bb3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.740140 Jul 30 21:14:32.248389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1848/3566] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:31 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:32.298200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:32.302362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:32.322572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:32.324790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.326641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:32.331151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.763655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a08398c-0344-424f-bc01-dbec58d6aee3 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.113659 Jul 30 21:14:32.765697 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1719/3567] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:32.770494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "32311821-607a-46ad-9d0a-cdee0d878cac"}, {"server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "name": "network-vif-plugged", "status": "completed", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "40231132-6acc-42a8-bb4d-8ed3653ce2d5"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:32.797574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:32.799025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.823469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:32.825771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Creating event network-vif-plugged:32311821-607a-46ad-9d0a-cdee0d878cac for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:32.829156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Creating event network-vif-plugged:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch2-master-1 Jul 30 21:14:32.829969 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] Creating event network-vif-plugged:40231132-6acc-42a8-bb4d-8ed3653ce2d5 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:32.838662 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1fa48a8-f345-47ab-aed5-4457d1d1167a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1511 microversion: 2.1 time: 0.561198 Jul 30 21:14:32.839798 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1849/3568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:32 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:32.855315 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a0b23b47-c8dd-4496-835a-cc4713cfb546 req-ad8f03a7-d198-4123-99f2-c67fb6fec33d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087445 Jul 30 21:14:32.856205 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1720/3569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:32.860172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:32.860902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:32.874501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:32.874978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.875832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:32.876297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:32.879813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e140636-7f2d-477f-96e1-8c0405ca3688 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c4efa60>, body: {"security_group_rule": {"parent_group_id": "1d3df954-7569-41a9-b006-fdc779c7a758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:33.136214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:33.160480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:33.162854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:33.168857 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6704424f-f128-4e21-ba1d-2786615b1d80 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.327212 Jul 30 21:14:33.169853 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1850/3570] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:32 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:33.507523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-486660628", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:33.521407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:33.626903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e140636-7f2d-477f-96e1-8c0405ca3688 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.768962 Jul 30 21:14:33.628377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:33.629024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:33.635018 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1721/3571] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:33.635882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:33.636648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:33.637243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:33.640236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:33.645865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:33.659035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:33.661705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:33.662787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:33.665454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:33.666513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:33.667176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:33.681544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:33.683177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:33.710821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Getting quotas for project ec9cf72add9f4d0d8fa2652095636289. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:33.721828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Getting quotas for user 682921a9a9374c90be43ebe98669fb95 and project ec9cf72add9f4d0d8fa2652095636289. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:33.766413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:14:33.772208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:14:33.946093 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2afe0c8-41e1-462f-8884-e22bca9428ba tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.763976 Jul 30 21:14:33.949092 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1851/3572] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:14:33.964989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-246c4549-2f1a-4455-bd1a-f21a66d11053 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb4fe3ae50>, body: {"security_group_rule": {"parent_group_id": "1d3df954-7569-41a9-b006-fdc779c7a758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:34.139877 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-246c4549-2f1a-4455-bd1a-f21a66d11053 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-246c4549-2f1a-4455-bd1a-f21a66d11053 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 138 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: {"security_group_rule": {"parent_group_id": "1d3df954-7569-41a9-b006-fdc779c7a758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: exception: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1d3df954-7569-41a9-b006-fdc779c7a758', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:34.141629 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:34.146472 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:34.146472 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:34.146472 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 Jul 30 21:14:34.146472 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:34.147805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-246c4549-2f1a-4455-bd1a-f21a66d11053 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: This rule already exists in group 1d3df954-7569-41a9-b006-fdc779c7a758 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:34.148864 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-246c4549-2f1a-4455-bd1a-f21a66d11053 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.198414 Jul 30 21:14:34.153358 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1852/3573] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:33 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:34.160937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:34.160937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:34.172276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:34.172841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:34.173794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:34.174313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:34.261172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.273277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.278605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.280015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-06a6e683-641b-4151-b80b-defabe5a518e tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.643848 Jul 30 21:14:34.280910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1722/3574] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:33 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:34.296951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:34.298595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:34.495157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.505262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.512222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.514554 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d802b90c-65c4-42b2-aff7-f9a549dbfe45 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 200 len: 1277 microversion: 2.47 time: 0.231737 Jul 30 21:14:34.517258 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1723/3575] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:34 2022] GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:34.523585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37aa2493-7c7d-4c6d-b6e3-ade227dfa83c tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5c0d5d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:34.581215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.591121 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee41d5a5-d864-47b3-a0b3-28ac1b6af0c7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1488 microversion: 2.1 time: 0.436629 Jul 30 21:14:34.609606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1853/3576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:34 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1488 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:34.621463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:34.632517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:34.650906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:34.651642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:34.653229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:34.655684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:34.940633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.960066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.964531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:34.971841 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4fe08c5b-30f8-4a7e-ac5a-4ccc374d9052 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.360622 Jul 30 21:14:34.974449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1854/3577] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:34 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:35.008459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:35.009005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:35.037687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.038157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.038957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.047681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.150122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:14:35.440699 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-314a37a2-5d21-4ded-a7d2-500bd4a03556 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 204 len: 0 microversion: 2.1 time: 0.462430 Jul 30 21:14:35.443845 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1855/3578] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:14:34 2022] DELETE /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:35.461823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1383330526", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:35.508890 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37aa2493-7c7d-4c6d-b6e3-ade227dfa83c tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/0b97f10c-b454-49a7-93b3-229980ac1bfe" status: 202 len: 0 microversion: 2.1 time: 0.988371 Jul 30 21:14:35.509551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1724/3579] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Jul 30 21:14:34 2022] DELETE /compute/v2.1/os-security-group-rules/0b97f10c-b454-49a7-93b3-229980ac1bfe => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:35.515623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "4a0f8ce0-4b07-404b-afab-9e61aceb22e2"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-plugged", "status": "completed", "tag": "746ec4d9-67d7-4e13-9f5b-d70bfab012ca"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:35.563049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.568370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.569735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:35.571409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:35.572422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:35.573056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:35.573702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:35.586687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.587331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.589177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.589815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.605809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] Creating event network-vif-plugged:4a0f8ce0-4b07-404b-afab-9e61aceb22e2 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:35.606721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] Creating event network-vif-plugged:746ec4d9-67d7-4e13-9f5b-d70bfab012ca for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:35.625163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Getting quotas for project ec9cf72add9f4d0d8fa2652095636289. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:35.625941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-af11cb27-b8f3-44ba-9f01-108a83f0e0ad req-08b13b9c-f1c4-424c-9a86-2d132a5e683e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108768 Jul 30 21:14:35.631653 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1725/3580] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:35.656938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:35.658141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:35.659904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Getting quotas for user 682921a9a9374c90be43ebe98669fb95 and project ec9cf72add9f4d0d8fa2652095636289. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:35.667231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.668032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.669172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.669795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.698312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:14:35.703084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:14:35.856241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5c19594-4a52-4dc8-ae57-a9f3fd041d5c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.408852 Jul 30 21:14:35.866325 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1856/3581] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:14:35.877947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:35.879083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:35.895623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.896562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:35.897974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:35.899396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:36.194278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.205924 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14e317d8-4b1e-44b3-a0bf-5078dfff7036 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1494 microversion: 2.1 time: 0.333070 Jul 30 21:14:36.206993 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1857/3582] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:35 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1494 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:36.211804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-643dc7bf-b8ea-4d19-a33a-c681e769a0fa tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5cbf8a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1856321969", "description": "tempest-description-1429150118"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:36.275598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.287131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.289905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.290055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-325f1bd0-fe6a-4fa3-9cd6-58236b58093b tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.653496 Jul 30 21:14:36.290709 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1726/3583] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:35 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:36.316698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4ad1a11-b2e5-4cd6-84c0-58c487625f78 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:36.319252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4ad1a11-b2e5-4cd6-84c0-58c487625f78 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:36.452881 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4ad1a11-b2e5-4cd6-84c0-58c487625f78 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "PUT /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 992 microversion: 2.47 time: 0.160488 Jul 30 21:14:36.458202 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1727/3584] 10.222.0.17 () {62 vars in 1297 bytes} [Sat Jul 30 21:14:36 2022] PUT /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 992 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:14:36.471854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:36.476558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-643dc7bf-b8ea-4d19-a33a-c681e769a0fa tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.268501 Jul 30 21:14:36.484795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:36.484981 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1858/3585] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:36 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:36.493432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:36.494299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:36.495432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:36.496304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:36.497931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:36.498631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:36.610614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.620908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.622868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.624723 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-530bd083-e501-4f29-aaed-7accf525bd16 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1278 microversion: 2.47 time: 0.138233 Jul 30 21:14:36.625485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1859/3586] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:36 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:36.631500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4598bb68-6407-4318-a943-4078f5df0c1f tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c64e310>, body: {"security_group_rule": {"parent_group_id": "5e9c1d2d-b62f-432d-90e1-f42f9ab890ab", "ip_protocol": "tcp", "from_port": 783298163, "to_port": 22}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:36.716943 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4598bb68-6407-4318-a943-4078f5df0c1f tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Invalid port range 783298163:22. Former value cannot be greater than the later Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4598bb68-6407-4318-a943-4078f5df0c1f tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 145 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: {"security_group_rule": {"parent_group_id": "5e9c1d2d-b62f-432d-90e1-f42f9ab890ab", "ip_protocol": "tcp", "from_port": 783298163, "to_port": 22}} Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid port range 783298163:22. Former value cannot be greater than the later Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5e9c1d2d-b62f-432d-90e1-f42f9ab890ab', 'ip_protocol': 'tcp', 'from_port': 783298163, 'to_port': 22}}} Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 783298163:22. Former value cannot be greater than the later Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 783298163:22. Former value cannot be greater than the later Jul 30 21:14:36.720722 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 783298163:22. Former value cannot be greater than the later Jul 30 21:14:36.724762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.738187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4598bb68-6407-4318-a943-4078f5df0c1f tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: Invalid port range 783298163:22. Former value cannot be greater than the later {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:36.746214 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4598bb68-6407-4318-a943-4078f5df0c1f tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.117639 Jul 30 21:14:36.756200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1860/3587] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:36 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:36.768453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ed3ef3e-e3de-4682-98aa-b525c9d1a3ad tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb4fe59790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-727248033", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:36.802221 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5ed3ef3e-e3de-4682-98aa-b525c9d1a3ad tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Security group id should be uuid Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ed3ef3e-e3de-4682-98aa-b525c9d1a3ad tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 130 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-727248033", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group id should be uuid Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-727248033', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:36.810516 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:36.818957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 30 21:14:36.818957 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:36.827937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ed3ef3e-e3de-4682-98aa-b525c9d1a3ad tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: Security group id should be uuid {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:36.838033 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ed3ef3e-e3de-4682-98aa-b525c9d1a3ad tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.073888 Jul 30 21:14:36.841141 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1861/3588] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:36 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:36.854599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2f72327-75fe-4e74-8285-0c63cc43f611 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5d6d1550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1390071469", "description": "tempest-description-1905266970"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:36.977156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.992967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:36.996328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:37.000281 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3950954-b882-43a3-8511-ce71828d4192 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.538610 Jul 30 21:14:37.017449 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1728/3589] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:36 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:37.236917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:37.237695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:37.248808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:37.249295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:37.250096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:37.250553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:37.507995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:37.526513 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae7a0431-d202-4369-983b-9e0bdba9afde tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1494 microversion: 2.1 time: 0.301553 Jul 30 21:14:37.545639 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1729/3590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:37 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1494 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:37.560163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:37.563239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:37.572503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:37.573394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:37.575033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:37.575709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:37.921845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:37.944664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:37.952878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:37.955810 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e278a5f-f4bc-4c19-b3f2-1c681d7e05f6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 1880 microversion: 2.32 time: 0.408769 Jul 30 21:14:37.956886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1730/3591] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:37 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:37.964975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:37.965870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:38.000554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.000554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.001147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.001446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.119839 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2f72327-75fe-4e74-8285-0c63cc43f611 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.270988 Jul 30 21:14:38.121279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1862/3592] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:36 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:14:38.144425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:38.146438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:38.193322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.199871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.206074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.207946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.240146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:38.248449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:38.250042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:38.251208 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e7b13bc-3395-4cec-bba1-c1dd676bb332 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1338 microversion: 2.47 time: 0.292498 Jul 30 21:14:38.279694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1731/3593] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:37 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:38.290489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fc576e3-772c-41eb-b6e8-670ac7947458 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c1719d0>, body: {"security_group_rule": {"parent_group_id": "8d21ec7e-cc13-4a93-94a2-6f04f4b74bf2", "ip_protocol": "tempest-999-645603457", "from_port": 22, "to_port": 22}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:38.390920 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6fc576e3-772c-41eb-b6e8-670ac7947458 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Invalid IP protocol tempest-999-645603457. Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fc576e3-772c-41eb-b6e8-670ac7947458 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 156 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: {"security_group_rule": {"parent_group_id": "8d21ec7e-cc13-4a93-94a2-6f04f4b74bf2", "ip_protocol": "tempest-999-645603457", "from_port": 22, "to_port": 22}} Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid IP protocol tempest-999-645603457. Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8d21ec7e-cc13-4a93-94a2-6f04f4b74bf2', 'ip_protocol': 'tempest-999-645603457', 'from_port': 22, 'to_port': 22}}} Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-645603457. Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-645603457. Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:38.393961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-645603457. Jul 30 21:14:38.398048 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:38.400532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fc576e3-772c-41eb-b6e8-670ac7947458 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: Invalid IP protocol tempest-999-645603457. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:38.401978 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fc576e3-772c-41eb-b6e8-670ac7947458 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.120563 Jul 30 21:14:38.406605 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1732/3594] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:38 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:14:38.437697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbbce665-a188-4139-b2ba-37f6ba084122 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c14dd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1263587216", "description": "tempest-description-1787097683"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:38.660560 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cbbce665-a188-4139-b2ba-37f6ba084122 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.241629 Jul 30 21:14:38.661773 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1733/3595] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:38 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:38.666730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:38.667802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:38.682969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.683878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.684943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:38.686524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:38.894672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:38.907313 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e0a388a7-3c73-4401-b66f-ec50f1c8d84d tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1494 microversion: 2.1 time: 0.244191 Jul 30 21:14:38.908291 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1734/3596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:38 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1494 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:38.914713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6af100d5-6cb6-4e6e-9141-debd0922758b tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c171f70>, body: {"security_group_rule": {"parent_group_id": "4b7dee17-5661-499f-a717-578c627b8b03", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:39.019128 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6af100d5-6cb6-4e6e-9141-debd0922758b tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6af100d5-6cb6-4e6e-9141-debd0922758b tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 138 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: {"security_group_rule": {"parent_group_id": "4b7dee17-5661-499f-a717-578c627b8b03", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4b7dee17-5661-499f-a717-578c627b8b03', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 30 21:14:39.022332 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 30 21:14:39.026967 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:39.029269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6af100d5-6cb6-4e6e-9141-debd0922758b tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:39.033108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6af100d5-6cb6-4e6e-9141-debd0922758b tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.121752 Jul 30 21:14:39.033931 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1735/3597] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:39.067192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:39.071176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:39.078806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.085425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.086146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.087744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.088458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.089964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.094908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.102768 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de417e7d-976f-4433-b3e8-34f01da173f2 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.977530 Jul 30 21:14:39.103982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1863/3598] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:38 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:39.119882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f5cf3c9-e23d-4677-bf04-a242d58303ca tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb4fe593a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-810195106", "description": "tempest-description-1028301339"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:39.553180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.571242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.581521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.584393 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b5ccbe2-bc2f-439e-820c-0b9e08aed92f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2831 microversion: 2.32 time: 0.543943 Jul 30 21:14:39.585482 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1736/3599] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:39 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2831 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:39.595137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:39.596058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:39.611888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.612624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.614325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.615456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.737572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.751831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.753704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:39.755775 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe97c1c4-e7b0-4d6e-9fc7-1f341efb21e9 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1336 microversion: 2.47 time: 0.168085 Jul 30 21:14:39.756846 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1737/3600] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:39 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:39.761993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ddf9c247-62f7-46d6-9c5f-9d3434436132 req-e9f6d193-0bab-43ec-b5a2-ecc7410d519f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a6e9cf-25f6-4641-865e-1e9953f3dcc9", "name": "network-vif-deleted", "tag": "007e160c-e12e-4682-9aa7-6ffaf550dad4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:39.773016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ddf9c247-62f7-46d6-9c5f-9d3434436132 req-e9f6d193-0bab-43ec-b5a2-ecc7410d519f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.773779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ddf9c247-62f7-46d6-9c5f-9d3434436132 req-e9f6d193-0bab-43ec-b5a2-ecc7410d519f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.787640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ddf9c247-62f7-46d6-9c5f-9d3434436132 req-e9f6d193-0bab-43ec-b5a2-ecc7410d519f service nova] Creating event network-vif-deleted:007e160c-e12e-4682-9aa7-6ffaf550dad4 for instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 on nch2-master-1 Jul 30 21:14:39.798985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ddf9c247-62f7-46d6-9c5f-9d3434436132 req-e9f6d193-0bab-43ec-b5a2-ecc7410d519f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040449 Jul 30 21:14:39.801472 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1738/3601] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:39.815029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:39.816995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:39.831645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.833123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.835609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:39.836244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:39.856321 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f5cf3c9-e23d-4677-bf04-a242d58303ca tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.750889 Jul 30 21:14:39.857968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1864/3602] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:14:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:39.885769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91795584-5abb-4628-8a35-337be846d61d tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb629178b0>, body: {"security_group_rule": {"parent_group_id": "1ffd7e08-7714-40d6-9ce5-8e116ec94704", "ip_protocol": "tcp", "from_port": 22, "to_port": 369736091}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:40.066287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-91795584-5abb-4628-8a35-337be846d61d tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91795584-5abb-4628-8a35-337be846d61d tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 145 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: {"security_group_rule": {"parent_group_id": "1ffd7e08-7714-40d6-9ce5-8e116ec94704", "ip_protocol": "tcp", "from_port": 22, "to_port": 369736091}} Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1ffd7e08-7714-40d6-9ce5-8e116ec94704', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 369736091}}} Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 Jul 30 21:14:40.067997 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91795584-5abb-4628-8a35-337be846d61d tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 400 to user: Invalid port range 22:369736091. Valid TCP ports should be between 1-65535 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91795584-5abb-4628-8a35-337be846d61d tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.200150 Jul 30 21:14:40.078060 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1865/3603] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:39 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:14:40.086633 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e19afd2-109c-4322-8dbd-c09d371715df tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.283314 Jul 30 21:14:40.087945 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1739/3604] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:14:39 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2/os-interface => generated 1831 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:40.094990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Action: 'create', calling method: .version_select at 0x7fbb5c12b8b0>, body: {"security_group_rule": {"parent_group_id": "4f3e0333-3342-4699-b5d5-ee63412b3235", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:40.101555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:40.104949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:40.131727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.132406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.133013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.133459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.173071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG neutronclient.v2_0.client [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist", "detail": ""}} {{(pid=130983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:14:40.173705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Neutron security group 4f3e0333-3342-4699-b5d5-ee63412b3235 not found {{(pid=130983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 30 21:14:40.174257 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.174257 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 138 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: {"security_group_rule": {"parent_group_id": "4f3e0333-3342-4699-b5d5-ee63412b3235", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: exception: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4f3e0333-3342-4699-b5d5-ee63412b3235', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:14:40.176754 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 404 to user: Security group 4f3e0333-3342-4699-b5d5-ee63412b3235 does not exist Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: Neutron server returns request_ids: ['req-1eb6a095-4a0f-42f9-bbcc-9ff086d9cc48'] {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:40.180822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39fc6da7-6d87-456e-98fd-c1bd7fa6a14a tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.089116 Jul 30 21:14:40.185231 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1740/3605] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 30 21:14:40 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:40.189330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:40.189963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:40.214019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.222014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.222953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.223468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.257844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.258319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.258796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'fault' on Instance uuid 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:14:40.355697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:40.358634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:40.375718 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50dca676-6bd9-4acf-b7f6-99e7f1a087dd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 200 len: 1304 microversion: 2.1 time: 0.300890 Jul 30 21:14:40.394267 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1866/3606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:40 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:40.413259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5c655a60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:40.524453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG neutronclient.v2_0.client [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist", "detail": ""}} {{(pid=130984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 30 21:14:40.525805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.security_group_api [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Neutron security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e not found {{(pid=130984) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 30 21:14:40.526422 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] HTTP exception thrown: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.526422 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Request method failure captured: Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-security-group-rules/96f4eb8e-adc1-4cab-b7ca-4c832e62161e HTTP/1.1 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z82pBc9FUp1MKTmgd4xWZhhqVe60rNFFlO_zXAw9SafYhRvbOIttktQD3BoUvifT54zm7qF0KTUTcNE6oSF-5nt9C8ffg5KctewcecfsOhVHJ0MI7wk7dUjdVHTT4BmhjsdFbXni2c9zpgC4kX49TMmVEt18hwHH6V2kPT9v4gWkYU Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ae42a10d54a4ab6aa4ab30fee3e1e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ae42a10d54a4ab6aa4ab30fee3e1e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2ae42a10d54a4ab6aa4ab30fee3e1e69 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cf1514e67acc4c15a04f5ce04957f937 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: exception: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '96f4eb8e-adc1-4cab-b7ca-4c832e62161e'} Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 30 21:14:40.531822 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Returning 404 to user: Security group rule 96f4eb8e-adc1-4cab-b7ca-4c832e62161e does not exist Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: Neutron server returns request_ids: ['req-8c93ead2-e589-4f4a-83d1-cd465e981f92'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:40.536753 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d65d8180-a0b5-4bcf-abe0-d4349b82f338 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/96f4eb8e-adc1-4cab-b7ca-4c832e62161e" status: 404 len: 199 microversion: 2.1 time: 0.139905 Jul 30 21:14:40.539501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1867/3607] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Jul 30 21:14:40 2022] DELETE /compute/v2.1/os-security-group-rules/96f4eb8e-adc1-4cab-b7ca-4c832e62161e => generated 199 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:40.573043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95509861-e6b4-4e13-a51e-f7ff163c9933 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb4fe3a4c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:40.695119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:40.709836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:40.713530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:40.716025 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf5f6558-55aa-4a43-89d6-17d5d3c3ed3d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.531545 Jul 30 21:14:40.717131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1741/3608] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:40 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:40.808578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:40.815844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:40.835970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.849792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:40.850902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:40.851893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.022590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:41.036318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:41.038301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:41.039547 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9fe3537a-9a4f-4029-b82d-416bc97d9fb8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1357 microversion: 2.47 time: 0.253428 Jul 30 21:14:41.040594 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1742/3609] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:40 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:41.067985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:41.074076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:41.093083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.093778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.094366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.094782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.110173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:41.272324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:41.273326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:41.273813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:41.276395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:41.283553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:41.446464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:41.454107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.455106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.456148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.456769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.499953 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61924dc2-50df-435b-8a45-a5b50d47b88a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "POST /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd/action" status: 202 len: 1079 microversion: 2.47 time: 0.431498 Jul 30 21:14:41.502980 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1743/3610] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:14:41 2022] POST /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd/action => generated 1079 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 30 21:14:41.512775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:41.519254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:41.530017 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95509861-e6b4-4e13-a51e-f7ff163c9933 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/1ffd7e08-7714-40d6-9ce5-8e116ec94704" status: 202 len: 0 microversion: 2.1 time: 0.982068 Jul 30 21:14:41.531180 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1868/3611] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:40 2022] DELETE /compute/v2.1/os-security-groups/1ffd7e08-7714-40d6-9ce5-8e116ec94704 => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:41.538358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:41.544276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:41.548813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.554308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.555434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.563589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.569314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.569804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.570887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:41.571134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:41.606779 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 HTTP/1.1 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '26a6e9cf-25f6-4641-865e-1e9953f3dcc9'} Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:14:41.615141 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:14:41.620057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:14:41.620562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce4b52d7-4b43-454f-8a4d-aa902131a805 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 404 len: 111 microversion: 2.1 time: 0.113579 Jul 30 21:14:41.623126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1744/3612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:41 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:14:41.644402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2da00038-6358-4d27-b845-e1e175c4c1b2 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5c0d5430>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:42.068030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.078923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.084453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.086002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a793e37a-c8fb-4336-8f42-1431fdf02b72 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.553344 Jul 30 21:14:42.087086 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1869/3613] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:41 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:42.095746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:42.096643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:42.106499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:42.107218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:42.108963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:42.109513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:42.199457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2da00038-6358-4d27-b845-e1e175c4c1b2 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4b7dee17-5661-499f-a717-578c627b8b03" status: 202 len: 0 microversion: 2.1 time: 0.573594 Jul 30 21:14:42.200719 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1745/3614] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:41 2022] DELETE /compute/v2.1/os-security-groups/4b7dee17-5661-499f-a717-578c627b8b03 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:42.215949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1713460329", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "fc657769-9696-48d7-9451-e793f867c1a1"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:42.336316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] validate_networks() for [('fc657769-9696-48d7-9451-e793f867c1a1', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:14:42.370213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.387773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.389859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:42.407329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d820a1ca-24d7-440f-a785-db4fe526c706 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.318667 Jul 30 21:14:42.407923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1870/3615] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:42 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:42.425320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7058df4-e2b0-4ed4-b857-6202366895f3 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5d6d1550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:42.958773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7058df4-e2b0-4ed4-b857-6202366895f3 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/8d21ec7e-cc13-4a93-94a2-6f04f4b74bf2" status: 202 len: 0 microversion: 2.1 time: 0.547459 Jul 30 21:14:42.964683 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1871/3616] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:42 2022] DELETE /compute/v2.1/os-security-groups/8d21ec7e-cc13-4a93-94a2-6f04f4b74bf2 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:42.973997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-244962ec-4f08-4188-98a5-ed2b0f40c0a5 req-bfe21bea-8499-4482-943f-e6bb54edcc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "tag": "ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:43.016558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-244962ec-4f08-4188-98a5-ed2b0f40c0a5 req-bfe21bea-8499-4482-943f-e6bb54edcc8a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:43.020187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-244962ec-4f08-4188-98a5-ed2b0f40c0a5 req-bfe21bea-8499-4482-943f-e6bb54edcc8a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:43.058384 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-244962ec-4f08-4188-98a5-ed2b0f40c0a5 req-bfe21bea-8499-4482-943f-e6bb54edcc8a service nova] Creating event network-changed:ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:14:43.072330 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-244962ec-4f08-4188-98a5-ed2b0f40c0a5 req-bfe21bea-8499-4482-943f-e6bb54edcc8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101783 Jul 30 21:14:43.074734 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1872/3617] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:43.098781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0a46734-7ce6-42df-b263-dd4715a9f0e1 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5cbf8310>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:43.694265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:43.694735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:43.695621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:43.696263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:43.696762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:43.709039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:43.709509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:43.710530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:43.710980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:43.751240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:43.770853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Getting quotas for user b839893e78134428a3cf451901129edc and project 0743c6764e9d487a9a3efa52e8e2b611. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:43.822717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:14:43.826280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:14:43.900180 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c99e05e3-1f0b-4fa8-9ae5-6250a826603a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696049 Jul 30 21:14:43.900708 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1746/3618] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:14:43.906278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:43.907181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:43.914920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:43.916548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:43.917615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:43.918363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:44.025639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.036259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.038483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.040125 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f075b90e-2d31-4ced-976d-6d1a9e83732d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.138187 Jul 30 21:14:44.041237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1747/3619] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:43 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:44.046726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:44.048133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:44.055027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:44.055727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:44.056688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:44.057436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:44.308222 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0a46734-7ce6-42df-b263-dd4715a9f0e1 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5e9c1d2d-b62f-432d-90e1-f42f9ab890ab" status: 202 len: 0 microversion: 2.1 time: 1.231733 Jul 30 21:14:44.310005 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1873/3620] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/5e9c1d2d-b62f-432d-90e1-f42f9ab890ab => generated 0 bytes in 1234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:44.316262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-38cbbb6d-fc86-4191-b380-564f6b754d17 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:44.317220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-38cbbb6d-fc86-4191-b380-564f6b754d17 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:44.379690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.394304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.396375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.397774 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23b1e425-2cf3-4748-87fb-68fd56897c1f tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.355345 Jul 30 21:14:44.411918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1748/3621] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:44 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:44.453962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a073aaf-8970-45b2-940d-9c58f688b176 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] Calling method '.version_select at 0x7fbb5c10c550>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:44.587890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-38cbbb6d-fc86-4191-b380-564f6b754d17 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:44.598000 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-38cbbb6d-fc86-4191-b380-564f6b754d17 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1215 microversion: 2.1 time: 0.286309 Jul 30 21:14:44.615655 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1874/3622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:44 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:44.820220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a073aaf-8970-45b2-940d-9c58f688b176 tempest-SecurityGroupRulesNegativeTestJSON-1191769743 tempest-SecurityGroupRulesNegativeTestJSON-1191769743-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/1d3df954-7569-41a9-b006-fdc779c7a758" status: 202 len: 0 microversion: 2.1 time: 0.402270 Jul 30 21:14:44.825532 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1749/3623] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/1d3df954-7569-41a9-b006-fdc779c7a758 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:14:45.071909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:45.072809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:45.085980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.086704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.087819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.088479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.369664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.394234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.396769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.406121 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b20a422-a31d-43e4-a4f3-61c9a2ca76d7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.342600 Jul 30 21:14:45.426592 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1875/3624] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:45 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:45.427080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:45.427862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:45.436672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.443140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.444060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.444546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.625012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:45.626318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:45.637167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:45.642402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.643117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.648657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:45.649343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:45.784952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.796130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.802171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.805485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b50ae1b0-b081-4681-a1df-aa9f517143d6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.381115 Jul 30 21:14:45.806616 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1750/3625] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:45 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:45.901809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:45.912016 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-641a0c41-9bc8-4260-94e8-8b74344dd0d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1267 microversion: 2.1 time: 0.291183 Jul 30 21:14:45.939737 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1876/3626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:45 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:46.434790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:46.435556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:46.452642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.455070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:46.455952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.456428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:46.487922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-959282384", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": "none"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:46.579133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:46.580816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:46.581512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:46.582512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:46.583185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:46.594856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.595652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:46.596853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.597472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:46.618406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Getting quotas for project 89f89748dd014b50ba710e4a2e82381d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:46.626418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Getting quotas for user 28f39af9487e4dee8e84bbbf58a85124 and project 89f89748dd014b50ba710e4a2e82381d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:46.646727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:46.661154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:14:46.667701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:14:46.762889 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c3113b8-39e1-4808-b59d-9f0e4fd715be tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.720812 Jul 30 21:14:46.765733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1751/3627] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:14:46.784834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:46.787497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:46.883429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:46.891529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:46.893068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:46.896105 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05854d10-5e96-4985-9bda-d82a1f38ef89 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1277 microversion: 2.54 time: 0.121430 Jul 30 21:14:46.897167 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1752/3628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:46 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:46.901944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:46.902736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:46.920109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.921328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:46.923162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:46.923802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:47.009926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.023150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.027192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.033800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f29881f-e727-455c-87e7-be8a4a9bad6c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.604208 Jul 30 21:14:47.034499 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1877/3629] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:46 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:47.043764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:47.047793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:47.062000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:47.064330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:47.067112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:47.067722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:47.208200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.226149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.230797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.233549 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2f74e27-a084-4e73-ac97-a94ea838b365 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.334613 Jul 30 21:14:47.234560 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1753/3630] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:46 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:47.258868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:47.271343 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5fb4efff-43dc-433b-bc4a-b8f345246312 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1273 microversion: 2.1 time: 0.234447 Jul 30 21:14:47.280891 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1878/3631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:47 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:47.921912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:47.922547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:47.947846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:47.949266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:47.951071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:47.952967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.064088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:48.065528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:48.088690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.088690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.088690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.088690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.146824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.159168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.160808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.161997 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-299e224f-d8a8-48bf-9368-8d840cea0c27 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1273 microversion: 2.54 time: 0.244889 Jul 30 21:14:48.169761 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1754/3632] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:47 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:48.261193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:48.261809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:48.270828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.271328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.272129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.272591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.405926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.425540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.430182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.434933 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67d69676-df3a-4abe-a428-c5e62f302235 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.376495 Jul 30 21:14:48.438448 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1879/3633] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:48 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:48.448726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:48.450079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:48.459092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.460494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.461996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:48.462795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:48.591008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.602004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.604808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:48.606313 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac0933aa-7652-4315-ac0c-67f5391fc069 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.351904 Jul 30 21:14:48.608292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1755/3634] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:48 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:49.015232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.030442 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3beea536-d038-415d-a9ad-5c93d576d9a0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.588738 Jul 30 21:14:49.031485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1880/3635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:48 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:49.197324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:49.198642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:49.207333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.208167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.209246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.210068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.315424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.331210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.337519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.341912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-360080ac-4ff0-4ed9-91c7-60bd9900ae2d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1335 microversion: 2.54 time: 0.149392 Jul 30 21:14:49.347876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1756/3636] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:49 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:49.470459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:49.471104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:49.481221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.482305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.484186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.484808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.630250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.634053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:49.634978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:49.645342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.646251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.649156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.655753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.656645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.657121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.658349 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e8ebabb-5b6a-49ad-ac95-3dc0cc675455 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.198673 Jul 30 21:14:49.661275 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1881/3637] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:49 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:49.804972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-14b898f6-4158-4b66-908a-f2a7f1caf4a8 req-3302931b-b3f0-42e9-8b75-4953bc49f467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f93ae0-2b1a-4494-9c79-51c3982fb34a", "tag": "a3d569d2-afc4-40e5-b7cf-3f3fd33a0892"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:49.841256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-14b898f6-4158-4b66-908a-f2a7f1caf4a8 req-3302931b-b3f0-42e9-8b75-4953bc49f467 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:49.841749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-14b898f6-4158-4b66-908a-f2a7f1caf4a8 req-3302931b-b3f0-42e9-8b75-4953bc49f467 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:49.889677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-14b898f6-4158-4b66-908a-f2a7f1caf4a8 req-3302931b-b3f0-42e9-8b75-4953bc49f467 service nova] Creating event network-changed:a3d569d2-afc4-40e5-b7cf-3f3fd33a0892 for instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a on nch1-master-1 Jul 30 21:14:49.902143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-14b898f6-4158-4b66-908a-f2a7f1caf4a8 req-3302931b-b3f0-42e9-8b75-4953bc49f467 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100634 Jul 30 21:14:49.904120 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1882/3638] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:14:49.905840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.921505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.925708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:49.927942 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0345af75-d938-4e56-b60f-fbb08802d193 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.297743 Jul 30 21:14:49.947904 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1757/3639] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:49 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:50.060495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:50.061954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:50.071204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.072086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.074081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.077431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.373730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:50.375124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:50.386557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.387519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.391480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.392374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.503481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.520490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.523028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.525505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-95b7c46d-bb1e-4fed-a257-c7567a2fcda6 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1335 microversion: 2.54 time: 0.159902 Jul 30 21:14:50.526685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1758/3640] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:50 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:50.664900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.679752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-710f6efd-3fd0-4288-b739-c6f5bbffe8bd tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.624487 Jul 30 21:14:50.697904 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1883/3641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:50 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:50.704652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:50.706064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:50.722390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.723427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.726254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.727914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.907374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.916384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.924903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:50.926540 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b04e26c-3175-4ff6-ac8b-a09eec41c04a tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.227536 Jul 30 21:14:50.927354 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1759/3642] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:50 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:50.956318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:50.956940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:50.974867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.977201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:50.978349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:50.980952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.282791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.291913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.296662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.298813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-492eceb7-c159-47a1-9a9c-6e141df34d3b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1739 microversion: 2.20 time: 0.346446 Jul 30 21:14:51.311932 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1884/3643] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:50 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:51.552721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:51.554163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:51.566316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.566991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.567982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.568587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.684871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.696600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.698829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:51.700383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c75c2e7c-2144-48e2-a646-bf84b99a9c10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1356 microversion: 2.54 time: 0.153742 Jul 30 21:14:51.701086 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1760/3644] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:51 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:51.729105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:51.730509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:51.731408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2cbd599-b72f-428b-9e99-68b5f00c7d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Action: 'create', calling method: .version_select at 0x7fbb5c0a90d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-33663768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl7J5WVxrsLS8CZY8xFFiz94I3WLe6cdXxfcbAyovAHn4y2FlU9jMyzIXsQRif5Br3rL97eqc+Yrft46MA5J8t+s0TsyVINKBNtZt5JdyktzRDI05SXqJXRrGTqkusCFw=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:51.744123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.745445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.747884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.748612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.767936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d2cbd599-b72f-428b-9e99-68b5f00c7d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Getting quotas for project 89f89748dd014b50ba710e4a2e82381d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:14:51.781281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d2cbd599-b72f-428b-9e99-68b5f00c7d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Getting quotas for user 28f39af9487e4dee8e84bbbf58a85124 and project 89f89748dd014b50ba710e4a2e82381d. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:14:51.823926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2cbd599-b72f-428b-9e99-68b5f00c7d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.096432 Jul 30 21:14:51.824346 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1761/3645] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:14:51 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:14:51.835657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-33663768", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:51.838909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:51.850733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.851213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.852045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:51.852562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:51.956924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:14:51.957571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:14:51.958070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:14:51.958497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:14:51.958930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:14:52.001244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:52.061745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:52.069848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.070457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.071531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.072431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.116801 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d31e048f-291e-45b5-b88c-9cee5d8028ae tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "POST /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8/action" status: 202 len: 1137 microversion: 2.54 time: 0.285548 Jul 30 21:14:52.123471 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1762/3646] 10.222.0.17 () {62 vars in 1320 bytes} [Sat Jul 30 21:14:51 2022] POST /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8/action => generated 1137 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 30 21:14:52.132959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:52.133900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:52.141026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.141603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.142648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.143469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.222334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.234158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.236215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.237677 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d36e0275-08a6-4b35-92ed-6dadfc646c48 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.112889 Jul 30 21:14:52.238901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1763/3647] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:52 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:52.267740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:52.270698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:52.289967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.290450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.291280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.291767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.391474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.400838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.402330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.403574 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47438b17-96b2-4f65-a340-6a7840c7225d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.163399 Jul 30 21:14:52.404144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1764/3648] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:52 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:52.409590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:52.410222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:52.425502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.425502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.426484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:52.426941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:52.546407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.555494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69f68e41-a96f-40f0-8de6-794ce6b7a2a1 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.842633 Jul 30 21:14:52.562335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1885/3649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:51 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:52.623859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.635232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.637569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:52.639903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-86de8c83-84e9-4ffd-8cf7-9fb7ad6e8b46 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1721 microversion: 2.20 time: 0.233202 Jul 30 21:14:52.640734 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1765/3650] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:52 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:53.264651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:53.265444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:53.272894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.280325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.281403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.281849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.431280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.437020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:53.440498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:53.444387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.447944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.450932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39270a1a-f543-49b9-9e25-9ae4421e5b44 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.190774 Jul 30 21:14:53.455391 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1886/3651] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:53 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:53.461369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.463185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.466344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.467450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.582786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:53.584816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:53.595073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.596043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.597043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.597795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.710583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.719903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.721463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.722666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2705d013-f723-47dd-b299-5c6c5ec2ccff tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.296520 Jul 30 21:14:53.723760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1766/3652] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:53 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:53.728703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:53.729328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:53.735701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.736161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.736954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:53.737404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:53.795673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:53.804213 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b9f3e31-2768-4ab3-b090-3510637667d8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.227704 Jul 30 21:14:53.805344 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1887/3653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:53 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:53.997837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.010270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.012757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.015256 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d5ff4a65-8c2d-438e-acd6-88b92a67f5dd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1721 microversion: 2.20 time: 0.290415 Jul 30 21:14:54.016096 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1767/3654] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:53 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:54.480412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:54.481048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:54.499544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.500332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.501919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.502441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.583673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.592892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.594435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.595729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39468e07-6a6f-4e73-9227-3a2ba135a67f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.120311 Jul 30 21:14:54.611886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1888/3655] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:54 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:54.747480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:54.748138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:54.755678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.756435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.757238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.757860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.825491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:54.826225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:54.832033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:54.834652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.835391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.836650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:54.837505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:54.838313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.851472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.853127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:54.854449 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c31e6b1a-d616-4ed5-bdee-5abfe14fe368 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.112240 Jul 30 21:14:54.867928 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1768/3656] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:54 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:54.996141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.000373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:55.008285 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b4b13e0-4ab7-40db-a2f9-2e869aa7a510 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.186814 Jul 30 21:14:55.008889 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1889/3657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:54 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:55.038781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:55.039539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:55.046742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.047216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.048041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.048498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.230132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.240562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.242174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.243414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd02e93f-8d93-4ced-87e5-4edc3e1eefa4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1721 microversion: 2.20 time: 0.209137 Jul 30 21:14:55.244125 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1769/3658] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:55 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:55.620438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:55.620975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:55.628414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.628845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.629963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.630427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.707482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.717718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.719489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.720680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c474b4a-0524-4f5a-8f2d-1c691f01d140 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.105238 Jul 30 21:14:55.721236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1890/3659] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:55 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:55.879647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:55.880861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:55.888384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.888888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.889696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:55.890262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:55.962562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.971455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.973230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:55.974704 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b805c42-ed34-4114-8197-7622df516f58 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.099567 Jul 30 21:14:55.975497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1770/3660] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:55 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:56.029969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:56.030611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:56.037704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.038187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.038986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.039651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.072522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-fa0effe5-8815-472f-bacd-4703234e3880 req-92431bed-4cba-4a55-9aee-bd28075482d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "name": "network-vif-unplugged", "status": "completed", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:56.091433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fa0effe5-8815-472f-bacd-4703234e3880 req-92431bed-4cba-4a55-9aee-bd28075482d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.099520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fa0effe5-8815-472f-bacd-4703234e3880 req-92431bed-4cba-4a55-9aee-bd28075482d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.118656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.server_external_events [req-fa0effe5-8815-472f-bacd-4703234e3880 req-92431bed-4cba-4a55-9aee-bd28075482d9 service nova] Unable to find a host for instance b470f888-1977-485a-82c0-0efd3d32bf06. Dropping event network-vif-unplugged {{(pid=130983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 21:14:56.121047 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-fa0effe5-8815-472f-bacd-4703234e3880 req-92431bed-4cba-4a55-9aee-bd28075482d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050941 Jul 30 21:14:56.125489 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1771/3661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 30 21:14:56.270220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:56.271132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:56.280485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.281269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.282874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.283521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.319831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.329243 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-afaa73f4-ec57-4518-bb34-36c7c1bcaab8 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.303714 Jul 30 21:14:56.332023 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1891/3662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:56 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:56.506001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.517265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.519824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.521872 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ce97355-fc9f-40b5-a810-b7878e359397 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1664 microversion: 2.20 time: 0.257323 Jul 30 21:14:56.535311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1772/3663] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:56 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:56.546774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:56.549329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:56.571731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:56.576093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.577699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.579310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.579975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.744420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:56.745131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:56.747050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:56.756962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.758722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.759974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:56.762757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:56.867588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.888366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.891995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:56.893583 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-450d4619-46a2-42d7-a4ab-406439efb50b tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.153112 Jul 30 21:14:56.894892 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1773/3664] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:56 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:57.001063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:57.001978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:57.022962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.024819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.027529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.028970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.125068 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8633b634-18d6-45a1-80e8-90298f63d6c8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.583051 Jul 30 21:14:57.126724 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1892/3665] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Jul 30 21:14:56 2022] POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments => generated 188 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:14:57.172955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:57.188254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:57.188254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:57.188254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7047edf-f113-47b7-aab4-705087cc5ae7 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.189792 Jul 30 21:14:57.188254 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1774/3666] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:56 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:57.334762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:57.335311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:57.346362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.346832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.348700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.350014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.350701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:57.351493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:57.365628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.366256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.367158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.367906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.618010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:57.633835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83456344-11d9-48e9-af8d-a320a5b84ce5 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.287205 Jul 30 21:14:57.652717 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1775/3667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:57 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:14:57.776181 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b970f611-ce65-4f35-ace4-33b54dc3cee6 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments/e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac" status: 202 len: 0 microversion: 2.20 time: 0.443538 Jul 30 21:14:57.778020 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1893/3668] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Jul 30 21:14:57 2022] DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments/e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:57.858413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:57.859435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:57.866009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.866724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.867551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.868004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.923407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:57.924053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:57.928986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130983) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 21:14:57.931620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.932110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:57.933006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:57.933467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.014663 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49bb84ae-5750-4fa7-b9a1-24a6363b0125 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/action" status: 202 len: 0 microversion: 2.20 time: 0.160531 Jul 30 21:14:58.019029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1776/3669] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 30 21:14:57 2022] POST /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:14:58.024484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:58.025157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:58.030383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.034694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.035201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.036302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.036762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.045919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.048128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.049781 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2f677f6-bae4-49c6-932a-2518deb12fe2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.131999 Jul 30 21:14:58.050891 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1894/3670] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:57 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:58.148296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f8780f6d-476c-4569-92ae-a87dc0690a6d req-aabddb5e-ea41-4581-9dba-457ee569f3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f93ae0-2b1a-4494-9c79-51c3982fb34a", "name": "network-vif-plugged", "status": "completed", "tag": "a3d569d2-afc4-40e5-b7cf-3f3fd33a0892"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:14:58.161702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f8780f6d-476c-4569-92ae-a87dc0690a6d req-aabddb5e-ea41-4581-9dba-457ee569f3e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.162577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f8780f6d-476c-4569-92ae-a87dc0690a6d req-aabddb5e-ea41-4581-9dba-457ee569f3e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.180531 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f8780f6d-476c-4569-92ae-a87dc0690a6d req-aabddb5e-ea41-4581-9dba-457ee569f3e3 service nova] Creating event network-vif-plugged:a3d569d2-afc4-40e5-b7cf-3f3fd33a0892 for instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a on nch1-master-1 Jul 30 21:14:58.187106 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f8780f6d-476c-4569-92ae-a87dc0690a6d req-aabddb5e-ea41-4581-9dba-457ee569f3e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043238 Jul 30 21:14:58.187783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1895/3671] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:14:58.214094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:58.215982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:58.227144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.227648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.228458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.229115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.262661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.267775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:58.278853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.281561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.284474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-396f5286-8df4-4217-b0f6-ffb17486ede8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1672 microversion: 2.20 time: 0.262978 Jul 30 21:14:58.285370 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1777/3672] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:58 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:58.656681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:58.657567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:58.668764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.669404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.678166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:58.678671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:58.728664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.738838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.741000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.742490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-014aeb69-ec22-4a3c-8cc5-76b591db5a46 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.534822 Jul 30 21:14:58.757250 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1896/3673] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:58 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:14:58.960207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:58.986289 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f3cb4f2-04f9-4d49-bca4-07a58395f693 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.320929 Jul 30 21:14:58.992029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1778/3674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:14:58 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:14:59.079914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:59.081112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:59.098506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.100001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.101198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.102185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.244433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.255044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.256608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.257797 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11ed4c25-ce48-416d-afae-62d3f51204a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.184305 Jul 30 21:14:59.258365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1897/3675] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:59 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:59.309876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:59.311318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:59.319377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.320131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.321151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.323776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.575699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.593254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.595542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.597375 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6501ed3-bdbc-4c93-a2af-73ea7857b0db tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1672 microversion: 2.20 time: 0.291438 Jul 30 21:14:59.598268 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1779/3676] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:59 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:14:59.770666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:14:59.771745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:14:59.781106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.781793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.782990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:14:59.783657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:14:59.875860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.888058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.890426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:14:59.892696 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-54fd2532-f515-4ec1-8458-2b5ed64dc24f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.125591 Jul 30 21:14:59.893326 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1898/3677] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:14:59 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:00.012721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:00.014913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:00.022674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.023373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.024821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.025439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.284475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:00.285112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:00.296622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.299783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.300747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.301289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.308771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:00.321609 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67290f44-9828-40a9-8859-6096deb3cd58 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1315 microversion: 2.1 time: 0.312634 Jul 30 21:15:00.322844 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1780/3678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:00 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:00.436149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:00.451680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:00.453308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:00.461033 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1638ee61-83a0-44c5-8435-45b559a82339 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.174617 Jul 30 21:15:00.463997 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1899/3679] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:00 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:00.635636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:00.637347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:00.647550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.648334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.652373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.654764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.931055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:00.937427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:00.951117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.952458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:00.954567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:00.955266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.024934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.040015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.042038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.044054 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2699a374-545a-4a29-89b5-191d9317d608 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.423370 Jul 30 21:15:01.052119 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1781/3680] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:00 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:01.097576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.116973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.127152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.129118 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1933d7e1-2892-4f1d-b6b0-57d1c2a45b0c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.215958 Jul 30 21:15:01.146913 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1900/3681] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:00 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:01.346800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:01.352125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:01.372189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.373699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.376101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.377429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.492479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:01.494441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:01.508731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.509193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.509992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.510440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.705153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.711239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.716968 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5f6f1676-c888-4c2c-b1fe-c5ebed02d6b7 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1502 microversion: 2.1 time: 0.375257 Jul 30 21:15:01.718255 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1782/3682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:01 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:01.719773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:01.729416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.732531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8bbeb214-5b3c-4591-bcef-ca4ffd2373ee req-ea2bc631-3790-4e9e-be97-708fac965e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:01.734464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:01.736358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b170b16c-2876-4a10-a92e-461a2746a300 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.250109 Jul 30 21:15:01.739057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1901/3683] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:01 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:01.747353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:01.748615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8bbeb214-5b3c-4591-bcef-ca4ffd2373ee req-ea2bc631-3790-4e9e-be97-708fac965e76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.748818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:01.749275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8bbeb214-5b3c-4591-bcef-ca4ffd2373ee req-ea2bc631-3790-4e9e-be97-708fac965e76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.761302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.761958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.762766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.763221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.769486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8bbeb214-5b3c-4591-bcef-ca4ffd2373ee req-ea2bc631-3790-4e9e-be97-708fac965e76 service nova] Creating event network-changed:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch1-master-1 Jul 30 21:15:01.780505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8bbeb214-5b3c-4591-bcef-ca4ffd2373ee req-ea2bc631-3790-4e9e-be97-708fac965e76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060704 Jul 30 21:15:01.781817 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1783/3684] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:01.801826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=20 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:01.805433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'flavor' on Instance uuid 88f93ae0-2b1a-4494-9c79-51c3982fb34a {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:15:01.875797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6d3c6f9c-0e49-4556-94c9-d13c85039dd6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Action: 'create', calling method: .version_select at 0x7fbb5c09c9d0>, body: {"keypair": {"name": "tempest-keypair-383790504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe5Kd/LPWo/8+Zy2p/WmDoxTTeGvj3BNRRWdJFogpGtpeglDnWvxQF/hYgNnM5lo2e+rz3kWfYvFuM3dZsvuTqt6T7h804C93Z40WeMLCwdmE9PPbF/OqZ3KPc6WRVTuA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:01.905677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6d3c6f9c-0e49-4556-94c9-d13c85039dd6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Getting quotas for project e33adbba42e242c394fc4e395ecbdca7. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:01.912258 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9542ee8-84c1-4933-8faa-eb825bea806b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "POST /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a/action" status: 202 len: 0 microversion: 2.1 time: 0.170750 Jul 30 21:15:01.913292 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1902/3685] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:15:01 2022] POST /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:15:01.918173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6d3c6f9c-0e49-4556-94c9-d13c85039dd6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Getting quotas for user 4b4290dc9e8042b58ae1965c00dfe78b and project e33adbba42e242c394fc4e395ecbdca7. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:01.930291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:01.931816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:01.942267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:01.942474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.943218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.944356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:01.944990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:01.965715 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6d3c6f9c-0e49-4556-94c9-d13c85039dd6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182352 Jul 30 21:15:01.966322 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1784/3686] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:15:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:02.070458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:02.072017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:02.083638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.084405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.085451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.086139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.229819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.251679 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-452cd0de-4602-4fe4-a084-1d6ddac8dfb0 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1510 microversion: 2.1 time: 0.333965 Jul 30 21:15:02.253103 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1903/3687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:01 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:02.269433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:02.270068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:02.278256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.279599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.281268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.281961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.313524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.324772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.326738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.328395 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e78cc5d-2ae0-47dd-a0f1-806360985fe0 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.262530 Jul 30 21:15:02.329544 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1785/3688] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:02 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:02.389835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.403999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.407616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.408841 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9258f00-dd67-444f-8fb8-f04e4c836eb0 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.154547 Jul 30 21:15:02.409415 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1904/3689] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:02 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:02.769145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:02.769880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:02.778562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.780656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.781675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:02.782270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:02.875157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.886378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.890483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:02.893057 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f04863af-1dc2-489d-8d5e-dc01391f04cb tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.131690 Jul 30 21:15:02.893786 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1786/3690] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:02 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:03.087659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.107697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.114140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Searching by: {'deleted': False, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:15:03.127479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.133143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.136035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.136502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.186400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:15:03.223404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-be1db08b-a526-4538-838b-9ba71dea2c91 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.148250 Jul 30 21:15:03.232146 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1905/3691] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/servers => generated 334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:03.245701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.256118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.259116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Searching by: {'deleted': False, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:15:03.273736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.275162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:03.281341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.281737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.281930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.282590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.283063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.285794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.286644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.287102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.344542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:15:03.390324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.398166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.398926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.627488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-039ffdce-0a94-40f8-aa02-00b302ab8b33 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.394141 Jul 30 21:15:03.644443 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1787/3692] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:03.644443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.644443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:03.657879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.658901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.660207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.661072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.867951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.879647 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f5f7663-6845-4482-ba36-bcd678f36d26 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1493 microversion: 2.1 time: 0.609720 Jul 30 21:15:03.887659 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1906/3693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1493 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:03.893611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.899385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:03.908953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.914238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.917991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.919097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.919840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.929024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.930813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:03.932935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b0df79a-a2d2-4c85-8f46-3320182a54b8 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.302410 Jul 30 21:15:03.934014 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1788/3694] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:03.940470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-069ef202-20e1-4d75-b2e5-3a7a396907fd tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.951628 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-069ef202-20e1-4d75-b2e5-3a7a396907fd tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015558 Jul 30 21:15:03.952195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1789/3695] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:03.958766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:03.959544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:03.967534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.968285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:03.969803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:03.970576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.006927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:04.120863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.143521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.145971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.152447 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-034d4ec9-8364-4c1c-bf1d-e9b4462d8851 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.261197 Jul 30 21:15:04.156097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1907/3696] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:03 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:04.170676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:04.171996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:04.173763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-52ae6ab8-771c-4e41-9dd6-f5a3c3f9d5d6 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 204 len: 0 microversion: 2.1 time: 0.219726 Jul 30 21:15:04.175354 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1790/3697] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:03 2022] DELETE /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:04.189774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.194403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.195701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.197696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:04.198064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.203855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:04.215924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.216739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.217722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.218337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.387378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.414897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.416522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.417761 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-02c2df91-c023-41cc-9bcc-67cfd531c8dc tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.256576 Jul 30 21:15:04.418350 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1908/3698] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:04 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:04.422624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:04.436992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b455da83-94d6-472f-bd90-f9bcad266fcf tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1499 microversion: 2.1 time: 0.253597 Jul 30 21:15:04.437996 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1791/3699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:04 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:04.637595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:04.638036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:04.644318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.645006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.645818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.646531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.675142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:04.768912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b281104-5f69-4513-83e7-56ea7145b1dc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 204 len: 0 microversion: 2.1 time: 0.134920 Jul 30 21:15:04.770422 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1909/3700] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:04 2022] DELETE /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:15:04.780353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:04.781923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:04.802505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.803096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.804091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:04.804615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:04.953824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e119b72c-25cd-439a-aee3-4c78910a3bbf"}], "security_groups": [{"name": "tempest-securitygroup--468445753"}], "key_name": "tempest-keypair-383790504", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:05.004993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.019785 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78e66a15-63e7-4ed3-a99c-264430b467a0 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1702 microversion: 2.1 time: 0.244599 Jul 30 21:15:05.021070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1792/3701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:04 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1702 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:05.026473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:05.027331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:05.042248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.042950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.043928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.044691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.118466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] validate_networks() for [('e119b72c-25cd-439a-aee3-4c78910a3bbf', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:15:05.271953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.297613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.299747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.301304 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a470c1e-e007-46bd-9e80-7b2bdd8028a5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.278949 Jul 30 21:15:05.302099 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1793/3702] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:05 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:05.307350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:05.308260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:05.315526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.316631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.317666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.318346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.393063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.396782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:05.403990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.405612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.406892 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4e73124-4785-41cb-8217-2557c1e6e9e2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.103617 Jul 30 21:15:05.407877 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1794/3703] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:05 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:05.449175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:05.452058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:05.471750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.472737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.474062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.474882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.606171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.629823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.632505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.634050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c66bb716-26f3-4d4f-a42f-47e6aefa99a2 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.189198 Jul 30 21:15:05.645174 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1795/3704] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:05 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:05.647320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:05.647320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:05.666297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.666935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.668045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.668484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.675629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:15:05.676199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:15:05.676595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:15:05.676992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:15:05.677538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:15:05.691698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.692171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.693213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:05.693870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:05.715109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Getting quotas for project e33adbba42e242c394fc4e395ecbdca7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:05.728499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Getting quotas for user 4b4290dc9e8042b58ae1965c00dfe78b and project e33adbba42e242c394fc4e395ecbdca7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:05.749006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:15:05.752039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:15:05.845138 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee136583-cc09-44b5-bd3e-6915b00072a8 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.900789 Jul 30 21:15:05.846835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1910/3705] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:15:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:15:05.857947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1cd6f6c-0d7d-4e71-95e4-a4cea9babe36 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:05.869434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b1cd6f6c-0d7d-4e71-95e4-a4cea9babe36 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:05.922953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.936570 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-91fdf34e-332d-48cb-bc3f-4ef52652c7d2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1499 microversion: 2.1 time: 0.297905 Jul 30 21:15:05.950130 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1796/3706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:05 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1499 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:05.987664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1cd6f6c-0d7d-4e71-95e4-a4cea9babe36 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:05.996628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1cd6f6c-0d7d-4e71-95e4-a4cea9babe36 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1225 microversion: 2.1 time: 0.142998 Jul 30 21:15:06.000790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1911/3707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:05 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:06.046121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:06.046884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:06.054549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.055099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.056159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.057136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.302773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.313876 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7df23fc6-234f-4a4f-9543-dcd3f26c4395 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1702 microversion: 2.1 time: 0.274121 Jul 30 21:15:06.315228 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1797/3708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:06 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1702 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:06.339249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:06.339975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:06.350376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.350886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.351770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.353280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.437873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:06.438966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:06.445590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.446061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.446852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.449446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.609304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.632573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.635976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.637536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c268b40-2819-48a0-b343-a30d95c1ba84 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.205790 Jul 30 21:15:06.643383 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1798/3709] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:06 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:06.665737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:06.670576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:06.692883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.693861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.695263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.696298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.800071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.811280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.813470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.815341 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fcaf26c8-b29b-4b7e-a75e-44e0a79a303e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.155133 Jul 30 21:15:06.816535 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1799/3710] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:06 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:06.961113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:06.966077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:06.966216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.976676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.980595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.981173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.982833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:06.983277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:06.989183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:06.991210 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50b60635-39bf-4e22-9fce-01a266f22b8e tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.655972 Jul 30 21:15:06.991858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1912/3711] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:06 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:07.022295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:07.022856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:07.055907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.061336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.062552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.063208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.265596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:07.276413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfa6d9ec-6a8b-4e69-91a2-b4f0e6ae7f6f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1221 microversion: 2.1 time: 0.258002 Jul 30 21:15:07.283386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1913/3712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:07 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:07.338408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:07.339541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:07.354843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:07.356314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.356946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.357969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.360066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.367437 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a917fcd-ce97-42d8-ab19-9132dd5d63bc tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1499 microversion: 2.1 time: 0.412492 Jul 30 21:15:07.368307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1800/3713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:06 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1499 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:07.663014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:07.663702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:07.680605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.681041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.681999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.682455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.842320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:07.852731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:07.854282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:07.855649 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ec9a12b-e6fa-485a-be50-ff8beaeaacef tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.197664 Jul 30 21:15:07.856711 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1801/3714] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:07 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:07.863080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:07.868458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:07.889374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.890177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:07.890499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:07.890932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.064041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.084678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.086237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.087713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d980d892-270d-473e-af02-24fd4ff1a8ad tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.229960 Jul 30 21:15:08.103696 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1802/3715] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:07 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:08.109693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:08.110582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:08.117882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.118612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.119638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.120257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.295328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.304859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba496593-6518-4d07-8303-3bc48e0f7f19 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1702 microversion: 2.1 time: 0.970342 Jul 30 21:15:08.310225 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1914/3716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:07 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1702 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:08.315596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:08.328266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:08.334969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.335721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.336760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.340435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.409845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.430115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.436865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.439626 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1310bfc8-b1e5-4c2e-8d24-c30dceb2d944 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.334054 Jul 30 21:15:08.441343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1803/3717] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:08 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:08.452812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:08.453425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:08.471454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.471882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.477054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.477795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.519175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.531112 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-88153803-9924-4f46-a6c4-79c7f50d45f4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1295 microversion: 2.1 time: 0.219287 Jul 30 21:15:08.547759 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1915/3718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:08 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1295 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:08.706862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:08.718835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f92cb6b1-7148-4984-a02d-94134aa12889 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1499 microversion: 2.1 time: 0.274496 Jul 30 21:15:08.720038 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1804/3719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:08 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1499 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:08.885685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:08.887307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:08.895940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.896747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.898023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:08.898998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:08.925229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:09.078565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.093381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.098004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.100628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-defd8645-7e15-4289-b6b8-63ec9d463a56 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.219452 Jul 30 21:15:09.118121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:09.119200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:09.121574 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1916/3720] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:08 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:09.136105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.140502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.142837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.144123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.343676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:09.345659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:09.359724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.367130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.370208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.371043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.371586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.373860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.374472 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a853db2f-7ee6-45f2-8cce-80ce3fa7b3b8 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.261544 Jul 30 21:15:09.376603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.377040 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1805/3721] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:09 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:09.472691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:09.475282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:09.492929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.495695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.497282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.501587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.654153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6e06e9270a48b7bc6cecf4b2d73509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a35c62a04494e1f89562e4aca3a3da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.678199 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce0bb5fb-5af4-4d27-a69c-5434f5b19ffc tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 200 len: 1634 microversion: 2.1 time: 0.345673 Jul 30 21:15:09.689325 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1917/3722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:09 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 1634 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:09.703077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:09.704194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:09.724046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.727037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.727037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.727037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.856402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.881082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.890343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.892481 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2961796c-151f-45ae-8d1c-ed6253698f1d tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.431047 Jul 30 21:15:09.905372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:09.917011 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f23a9cb4-47a6-4586-bc1c-d7c7e3c222e9 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1283 microversion: 2.1 time: 0.223613 Jul 30 21:15:09.918068 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1918/3723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:09 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:09.926884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:09.927932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:09.928275 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1806/3724] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:09 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:09.953063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.953997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.958524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:09.961387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:09.966072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7d008cdc-455c-475d-bc40-21dbb7c8add2 req-22d1682a-b99c-47b5-9f1d-6003bf5db065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1827d384-d5f8-4f58-ab27-9988b01a6d5d", "name": "network-vif-deleted", "tag": "79ce3b06-ef96-4dd2-bd64-4d21163fcd94"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:10.019506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7d008cdc-455c-475d-bc40-21dbb7c8add2 req-22d1682a-b99c-47b5-9f1d-6003bf5db065 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.020455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7d008cdc-455c-475d-bc40-21dbb7c8add2 req-22d1682a-b99c-47b5-9f1d-6003bf5db065 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.057773 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7d008cdc-455c-475d-bc40-21dbb7c8add2 req-22d1682a-b99c-47b5-9f1d-6003bf5db065 service nova] Creating event network-vif-deleted:79ce3b06-ef96-4dd2-bd64-4d21163fcd94 for instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d on nch2-master-1 Jul 30 21:15:10.078102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7d008cdc-455c-475d-bc40-21dbb7c8add2 req-22d1682a-b99c-47b5-9f1d-6003bf5db065 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115795 Jul 30 21:15:10.080024 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1807/3725] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:15:10.139690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.140574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:10.161382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.162584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.165473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.166753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.329509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.346435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.350419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.352036 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e0c3bff-d3ee-4c05-be72-cb3a14b47b54 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.223205 Jul 30 21:15:10.353483 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1808/3726] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:10 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:10.406710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.407703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:10.424848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.425799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.426044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.426590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.573121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.589124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.591017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.600085 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92a114a0-8967-48d1-b9de-7f9ad0a65f8e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.200656 Jul 30 21:15:10.601196 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1809/3727] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:10 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:10.606548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-cc7e5d58-1ebc-4d79-a385-e9f11042c4d1 req-fd35cfc5-94bb-45f2-9c2f-c8d9685b35f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f93ae0-2b1a-4494-9c79-51c3982fb34a", "name": "network-vif-unplugged", "status": "completed", "tag": "a3d569d2-afc4-40e5-b7cf-3f3fd33a0892"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:10.645788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cc7e5d58-1ebc-4d79-a385-e9f11042c4d1 req-fd35cfc5-94bb-45f2-9c2f-c8d9685b35f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.646392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cc7e5d58-1ebc-4d79-a385-e9f11042c4d1 req-fd35cfc5-94bb-45f2-9c2f-c8d9685b35f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.677623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-cc7e5d58-1ebc-4d79-a385-e9f11042c4d1 req-fd35cfc5-94bb-45f2-9c2f-c8d9685b35f4 service nova] Creating event network-vif-unplugged:a3d569d2-afc4-40e5-b7cf-3f3fd33a0892 for instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a on nch1-master-1 Jul 30 21:15:10.690291 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-cc7e5d58-1ebc-4d79-a385-e9f11042c4d1 req-fd35cfc5-94bb-45f2-9c2f-c8d9685b35f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083694 Jul 30 21:15:10.694901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1810/3728] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:10.710276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:10.723494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.724219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] [instance: 1827d384-d5f8-4f58-ab27-9988b01a6d5d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:10.726559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7281bbe-2511-4da3-8da5-5aa861c058ba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1499 microversion: 2.1 time: 0.804850 Jul 30 21:15:10.727679 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1919/3729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:09 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1499 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:10.754856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.755485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.756373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.757567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.813314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] HTTP exception thrown: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Request method failure captured: Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d HTTP/1.1 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z8b3EGzM2-2otrsZagqKf_jzL0dnarcQd7t1djQtChhCZM31R8v92D1NeH7N57ZW3Pl6GvxZvbyYm39fUYt3wbLQ4S65uJIOgamVkYcgT0ng8prn6Di0BWXEg0HlAUlRsbXW46VplBSfV8MQiHSspb6hDv-p1MnDUuARI-6dweNLBo Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 3a35c62a04494e1f89562e4aca3a3da6 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-974665452 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3a35c62a04494e1f89562e4aca3a3da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3a35c62a04494e1f89562e4aca3a3da6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a35c62a04494e1f89562e4aca3a3da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3a35c62a04494e1f89562e4aca3a3da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-974665452 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 3a35c62a04494e1f89562e4aca3a3da6 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-974665452 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-974665452-project Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7f6e06e9270a48b7bc6cecf4b2d73509 Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-974665452-project Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1827d384-d5f8-4f58-ab27-9988b01a6d5d'} Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:10.815330 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Returning 404 to user: Instance 1827d384-d5f8-4f58-ab27-9988b01a6d5d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bd08ae7-b026-4895-ab6e-dd5682d41ac7 tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d" status: 404 len: 111 microversion: 2.1 time: 0.113948 Jul 30 21:15:10.820898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1811/3730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:10 2022] GET /compute/v2.1/servers/1827d384-d5f8-4f58-ab27-9988b01a6d5d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:10.827876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-66d6aa7c-087b-4ae2-89e3-a7a4c0de6f9e tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] Calling method '.version_select at 0x7fbb629988b0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.875947 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-66d6aa7c-087b-4ae2-89e3-a7a4c0de6f9e tempest-ServersTestJSON-974665452 tempest-ServersTestJSON-974665452-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978460134" status: 202 len: 0 microversion: 2.1 time: 0.052189 Jul 30 21:15:10.885885 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1920/3731] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978460134 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:15:10.923757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.925761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:10.936954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.937428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.942652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.944110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.946373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:10.947007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:10.959248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.959847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:10.960687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:10.961236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.421134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.431993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.439423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.447133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b29c04c-9d99-4bd4-877d-03bf713a8b91 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.529564 Jul 30 21:15:11.448418 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1812/3732] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:10 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:11.464490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:11.465139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:11.478121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.478588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.479552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.480082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.537864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:11.633515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.642632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.644198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.676399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff39bb1c-a114-4c3f-9a3b-82a07dab42b1 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.211109 Jul 30 21:15:11.677665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1813/3733] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:11 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:11.682665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:11.703311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:11.723120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.745645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.746406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.749590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.750138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.753134 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a60291d-af4d-45e4-91c4-070aa51d8d7c tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.808189 Jul 30 21:15:11.755433 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1921/3734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:10 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:11.778669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:11.783017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:11.804250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.807450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.809158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:11.822778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:11.953675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.980374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.981989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:11.983918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-46b2e566-b206-4843-8221-2d4a27b04d46 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.305020 Jul 30 21:15:11.984499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1814/3735] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:11 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:12.182434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-fbbcf960-472e-47f3-b3a4-c68337a7f535 req-66292a68-c076-422d-a34f-ce170e66154b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f93ae0-2b1a-4494-9c79-51c3982fb34a", "name": "network-vif-deleted", "tag": "a3d569d2-afc4-40e5-b7cf-3f3fd33a0892"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:12.191006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.196336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fbbcf960-472e-47f3-b3a4-c68337a7f535 req-66292a68-c076-422d-a34f-ce170e66154b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:12.197058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fbbcf960-472e-47f3-b3a4-c68337a7f535 req-66292a68-c076-422d-a34f-ce170e66154b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:12.203905 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39d7a4a6-1fab-4cbb-b5f7-33322784e71b tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1291 microversion: 2.1 time: 0.445666 Jul 30 21:15:12.207015 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1922/3736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:11 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1291 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:12.222575 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-fbbcf960-472e-47f3-b3a4-c68337a7f535 req-66292a68-c076-422d-a34f-ce170e66154b service nova] Creating event network-vif-deleted:a3d569d2-afc4-40e5-b7cf-3f3fd33a0892 for instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a on nch1-master-1 Jul 30 21:15:12.233915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-fbbcf960-472e-47f3-b3a4-c68337a7f535 req-66292a68-c076-422d-a34f-ce170e66154b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061741 Jul 30 21:15:12.237458 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1815/3737] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:15:12.480589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:12.481233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:12.491933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:12.499577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:12.500929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:12.501561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:12.721053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:12.753594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:12.792822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:12.793562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:12.794623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:12.795108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:12.935865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.950448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.955033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.959481 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe4b39d0-001d-4c94-968c-679da5bda539 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.250812 Jul 30 21:15:12.965726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.977238 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1816/3738] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:12 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:12.986170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.986801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:12.988616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:12.993111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:12.998468 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0548e054-b020-486f-8699-675c8de3d7da tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.521665 Jul 30 21:15:13.001489 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1923/3739] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:12 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:13.031617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:13.032296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:13.048855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.049647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.050628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.053007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.055155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.055847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.057591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.058320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.216578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:13.230281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:13.231758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:13.242987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4124d768-83f0-4d90-bdcc-ff245ca07042 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1366 microversion: 2.47 time: 0.213260 Jul 30 21:15:13.246135 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1924/3740] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:13 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:13.253170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:13.254139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:13.264027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.265298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.266602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.267429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.299454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:13.388463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:13.395814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:13.396815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:13.423063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lazy-loading 'fault' on Instance uuid 88f93ae0-2b1a-4494-9c79-51c3982fb34a {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:15:13.558564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:13.568995 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f758be79-7348-46f9-91ed-5656d289d0b6 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.588176 Jul 30 21:15:13.571587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1817/3741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:12 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:13.801473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b839893e78134428a3cf451901129edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0743c6764e9d487a9a3efa52e8e2b611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:13.815885 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3a67ba3-4b88-4ab7-983d-fe338622185f tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 200 len: 1305 microversion: 2.1 time: 0.567874 Jul 30 21:15:13.817884 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1925/3742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:13 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 1305 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:13.988490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:13.989097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.001414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.005242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.006439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.007097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.034550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:14.036133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.061560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.064240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.065302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.068300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.312396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.329869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.331912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.333369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f716e76-ba66-4b78-b608-77bcc691269f tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.349079 Jul 30 21:15:14.347708 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1818/3743] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:13 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:14.347708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:14.347708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.366467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.368950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.370685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.371515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.519987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.530760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.538645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.542522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b2d532f-7b69-4178-9ef4-98d4623eadbe tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.515781 Jul 30 21:15:14.543421 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1926/3744] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:14 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:14.552634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-292ee4b3-2bf1-4d3f-aa16-289733e81fb6 req-4e7e6ea8-9b32-4680-ab33-43be31f54fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f899fb4-394f-4c44-9f20-17495b7d9e49", "tag": "109e4efe-c5a1-4d3c-ae48-9374977b607b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:14.578993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-292ee4b3-2bf1-4d3f-aa16-289733e81fb6 req-4e7e6ea8-9b32-4680-ab33-43be31f54fe0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.580250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-292ee4b3-2bf1-4d3f-aa16-289733e81fb6 req-4e7e6ea8-9b32-4680-ab33-43be31f54fe0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.615000 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-292ee4b3-2bf1-4d3f-aa16-289733e81fb6 req-4e7e6ea8-9b32-4680-ab33-43be31f54fe0 service nova] Creating event network-changed:109e4efe-c5a1-4d3c-ae48-9374977b607b for instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 on nch2-master-1 Jul 30 21:15:14.633430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-292ee4b3-2bf1-4d3f-aa16-289733e81fb6 req-4e7e6ea8-9b32-4680-ab33-43be31f54fe0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084243 Jul 30 21:15:14.634514 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1927/3745] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:14.640439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:14.641398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.644240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:14.651393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.652010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.653149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.654387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.699733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.710524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.712203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:14.713976 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99df30d1-2fca-4e6d-9c0a-0d241c19d963 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1372 microversion: 2.47 time: 0.376919 Jul 30 21:15:14.714889 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1819/3746] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:14 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:14.844385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:14.845349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.865978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.873132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.875676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.876894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.928025 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a HTTP/1.1 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '88f93ae0-2b1a-4494-9c79-51c3982fb34a'} Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:14.934152 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:14.940524 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:14.944498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:14.946870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9577bc89-057d-402d-bcf6-275144056ab2 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 404 len: 111 microversion: 2.1 time: 0.107418 Jul 30 21:15:14.948786 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1820/3747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:14 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:15:14.967464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:14.968481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:14.977430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.979159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:14.981424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:14.982414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.030613 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a HTTP/1.1 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '88f93ae0-2b1a-4494-9c79-51c3982fb34a'} Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.038629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.045530 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61c46aa4-2c74-4d55-b384-c7d63c8060ff tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 404 len: 111 microversion: 2.1 time: 0.080282 Jul 30 21:15:15.046544 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1821/3748] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:14 2022] DELETE /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:15:15.062351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.064075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 88f93ae0-2b1a-4494-9c79-51c3982fb34a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.085358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.086221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.087643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.090499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.117433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a HTTP/1.1 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '88f93ae0-2b1a-4494-9c79-51c3982fb34a'} Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.120159 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.125340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 88f93ae0-2b1a-4494-9c79-51c3982fb34a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.126855 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e2c4626-6585-4800-b64e-4ea82d25b171 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a" status: 404 len: 111 microversion: 2.1 time: 0.074551 Jul 30 21:15:15.127979 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1822/3749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/88f93ae0-2b1a-4494-9c79-51c3982fb34a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.136631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.137657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.145478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.146502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.147822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.148516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.168534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 HTTP/1.1 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '26a6e9cf-25f6-4641-865e-1e9953f3dcc9'} Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.171212 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.177128 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.178684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.179658 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e25c4ca6-6b85-42df-a338-f40b018d8c98 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 404 len: 111 microversion: 2.1 time: 0.047375 Jul 30 21:15:15.180249 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1823/3750] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:15 2022] DELETE /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.188985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.190771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 26a6e9cf-25f6-4641-865e-1e9953f3dcc9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.199968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.200785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.202532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.203660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.222604 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 HTTP/1.1 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '26a6e9cf-25f6-4641-865e-1e9953f3dcc9'} Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.224994 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. Jul 30 21:15:15.230958 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.234048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 26a6e9cf-25f6-4641-865e-1e9953f3dcc9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.235256 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb7c8432-b6c9-4f93-a94e-49d8d43b5c9c tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9" status: 404 len: 111 microversion: 2.1 time: 0.050390 Jul 30 21:15:15.236575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1824/3751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/26a6e9cf-25f6-4641-865e-1e9953f3dcc9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.245989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.253725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.255026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.255799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.257145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.257966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.281146 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 HTTP/1.1 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0ed8a44b-ef0e-4b0c-b57f-79e3dd896678'} Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.283218 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.289748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.292242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.293622 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa646191-91c9-495d-bd16-7f8e6d2ffce3 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 404 len: 111 microversion: 2.1 time: 0.053095 Jul 30 21:15:15.295311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1825/3752] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:15 2022] DELETE /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.310198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.311438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.320409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.321223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.322260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.323072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.344674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 HTTP/1.1 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0ed8a44b-ef0e-4b0c-b57f-79e3dd896678'} Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.347625 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. Jul 30 21:15:15.352594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.354165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.355329 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d3405e0-4eff-4fae-95a6-8137fc37022a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678" status: 404 len: 111 microversion: 2.1 time: 0.056029 Jul 30 21:15:15.356570 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1826/3753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/0ed8a44b-ef0e-4b0c-b57f-79e3dd896678 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.363931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.364865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.374794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.375646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.376871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.378168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.548507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:15.578207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:15.586985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:15.592616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0aebef7-8c46-41b6-b83d-21f531863a8a tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.234113 Jul 30 21:15:15.593236 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1827/3754] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:15.606487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.608634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.625639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.626022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.628632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.628632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.665788 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 HTTP/1.1 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6dc48a8b-9966-4fac-91a0-8ad341a31b96'} Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.668961 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-372dc59f-5e52-43ee-81e2-a2f70e5b8b5a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 404 len: 111 microversion: 2.1 time: 0.073790 Jul 30 21:15:15.679668 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1828/3755] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:15 2022] DELETE /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.690549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.692129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.706619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:15.709912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:15.714462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.715315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.720467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.728609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.830951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:15.840629 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7088a0aa-6f22-49b3-92ac-72223bba0e54 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 1.204720 Jul 30 21:15:15.842191 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1928/3756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:14 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:15.847184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.848177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 6dc48a8b-9966-4fac-91a0-8ad341a31b96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.855706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.856263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.858649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.859119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.876301 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 HTTP/1.1 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '6dc48a8b-9966-4fac-91a0-8ad341a31b96'} Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:15.878430 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. Jul 30 21:15:15.883152 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:15.884893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 6dc48a8b-9966-4fac-91a0-8ad341a31b96 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:15.885859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd808c53-3334-49c2-8067-4b8ee1a50955 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96" status: 404 len: 111 microversion: 2.1 time: 0.042485 Jul 30 21:15:15.886518 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1929/3757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/6dc48a8b-9966-4fac-91a0-8ad341a31b96 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:15.894141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:15.894789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:15.901081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.901565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.902348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:15.902834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:15.977798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:15.995210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.000900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:16.004278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.011729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.013616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.015065 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ca5eb9e-99ae-4f09-9241-d446ecb144ed tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.339777 Jul 30 21:15:16.015661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.016354 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1829/3758] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:16.017488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1b8cec76-1af2-4177-aaab-a58a7d61c2a3 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1372 microversion: 2.47 time: 0.128557 Jul 30 21:15:16.018262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1930/3759] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:15 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:16.036992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:16.037614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:16.045674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.047144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.048561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.049134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.066573 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a HTTP/1.1 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1995038e-9833-4bc9-8b5f-b63cca34a74a'} Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:16.068292 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-293f81e6-0285-4879-92eb-80a805c11b93 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a" status: 404 len: 111 microversion: 2.1 time: 0.053079 Jul 30 21:15:16.073673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1830/3760] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:16 2022] DELETE /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:16.080329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:16.081006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 1995038e-9833-4bc9-8b5f-b63cca34a74a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:16.087485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.087963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.088760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.089254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.110613 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a HTTP/1.1 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1995038e-9833-4bc9-8b5f-b63cca34a74a'} Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:16.112280 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 1995038e-9833-4bc9-8b5f-b63cca34a74a could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27f8867d-39f0-498c-9153-9c5ac1280d4a tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a" status: 404 len: 111 microversion: 2.1 time: 0.038250 Jul 30 21:15:16.116817 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1931/3761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:16 2022] GET /compute/v2.1/servers/1995038e-9833-4bc9-8b5f-b63cca34a74a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:16.619268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:16.619976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:16.636214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.636686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.637495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.638085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.745298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.764760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.768873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:16.771254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-034032ff-98ca-4d03-bf0f-d18723a1ebd2 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.155809 Jul 30 21:15:16.772687 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1831/3762] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:16 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:16.862813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:16.864048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:16.871907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.873197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:16.874268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:16.874906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.040739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.041661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.049420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.050028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.051625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.052080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.183190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.192022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.193565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.194751 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7a99d88-9998-43a9-b8c7-2f4fade37f7a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.158103 Jul 30 21:15:17.195345 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1832/3763] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:17.209798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.218825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.219494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.220057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d07eb21c-47cf-4ca9-8f2f-d10aa236ba49 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.361095 Jul 30 21:15:17.220926 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1932/3764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:16 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:17.233670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.234351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.235191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.235686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.301298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.303018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.303767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.318652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.319145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.319737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.320969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.321424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.322875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.327638 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81da6cf0-217b-46b7-968c-66f9a7001a0d tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1357 microversion: 2.47 time: 0.115054 Jul 30 21:15:17.329540 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1833/3765] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1357 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:17.348205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 HTTP/1.1 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7f329f20-3dfe-4874-8c91-5ec9e9fe36a6'} Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:17.350103 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.356085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:17.358617 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b737fda-2426-49b8-8c6b-66abeb14c774 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 404 len: 111 microversion: 2.1 time: 0.054292 Jul 30 21:15:17.359403 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1933/3766] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:17 2022] DELETE /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:15:17.362465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.366818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.367787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Searching by: {'deleted': False, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:15:17.373943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.375690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.376340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.377323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.378033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.383943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.401458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.404655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.406086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.409645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.444661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 HTTP/1.1 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7f329f20-3dfe-4874-8c91-5ec9e9fe36a6'} Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.446608 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. Jul 30 21:15:17.450914 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.473318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:17.474612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-040fcdc3-dd1e-4be0-bcba-c7df2fd7aaba tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6" status: 404 len: 111 microversion: 2.1 time: 0.110593 Jul 30 21:15:17.487568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1934/3767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/7f329f20-3dfe-4874-8c91-5ec9e9fe36a6 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:17.495740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.496286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.513115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.513247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.514032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.515899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.537289 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 HTTP/1.1 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '17a61d8b-8384-4314-9ba4-a04db0c365f9'} Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:17.538958 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2cb88b0-02ea-4808-bc21-4c6c6001907e tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "DELETE /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 404 len: 111 microversion: 2.1 time: 0.051872 Jul 30 21:15:17.548293 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1935/3768] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:15:17 2022] DELETE /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:15:17.552250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.553291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] [instance: 17a61d8b-8384-4314-9ba4-a04db0c365f9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.554753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:15:17.564603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.565006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.565892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.566370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.587436 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] HTTP exception thrown: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Request method failure captured: Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 HTTP/1.1 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z5Q1n__wwtBfdHpJr1FuI69liz2fylK3HtMdiph-oz5CHpGPRJSTpQ_MoxfZWhx5heijHlyu5kEmtJX2rKRdYZ5-vhPhA_psMOklY47CYHWfnaazYRkBjSnC0NEl4e20ewfUTAsJuHwNnm6XjWD_csjDD3N2nU2Uf3hlTFDEAqvJ9s Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0743c6764e9d487a9a3efa52e8e2b611", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0743c6764e9d487a9a3efa52e8e2b611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 0743c6764e9d487a9a3efa52e8e2b611 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715350511 Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: b839893e78134428a3cf451901129edc Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-1715350511-project Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '17a61d8b-8384-4314-9ba4-a04db0c365f9'} Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:17.589172 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. Jul 30 21:15:17.594586 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:17.596782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] Returning 404 to user: Instance 17a61d8b-8384-4314-9ba4-a04db0c365f9 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:17.598199 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b78fd54f-33a1-4cb5-86cb-3d7787bf6b42 tempest-DeleteServersTestJSON-1715350511 tempest-DeleteServersTestJSON-1715350511-project] 10.222.0.17 "GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9" status: 404 len: 111 microversion: 2.1 time: 0.050422 Jul 30 21:15:17.603714 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1936/3769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/17a61d8b-8384-4314-9ba4-a04db0c365f9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:15:17.664986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.674713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.676646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.689010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.690601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.738191 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e0beca9-ce38-4816-8d4b-0a0f9e8e0ba1 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.389567 Jul 30 21:15:17.739302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1834/3770] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:17.768027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.768549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.774682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.775157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.775988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.776443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.797223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.798037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.805131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.805611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.806418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.809576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:17.812307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.875882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:17.938356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.941272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dbb2c5df-9e07-4ba0-a06f-42cda7d06724 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 204 len: 0 microversion: 2.47 time: 0.175661 Jul 30 21:15:17.948031 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1937/3771] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:15:17 2022] DELETE /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:15:17.949690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.952295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:17.957209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:17.958217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:17.959639 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f1d6710-20f0-49cf-b84c-c48f7d60833c tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.166251 Jul 30 21:15:17.960260 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1835/3772] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:17.969524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.970366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:17.971454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:17.972154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:18.094278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.110335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.126538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.128605 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00da42fb-bba6-4a5b-957b-2887ffa0c84c tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1363 microversion: 2.47 time: 0.176466 Jul 30 21:15:18.129360 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1938/3773] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:17 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:18.225645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:18.226349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:18.234499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:18.236167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:18.241636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:18.242151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:18.253337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:18.254231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:18.254912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:18.255758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:18.256668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:18.257135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:18.269867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:18.536948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.553586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.557202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.561884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d377c8bb-82b3-4702-ba70-358f02e60ffd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.340405 Jul 30 21:15:18.562492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1836/3774] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:18 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:18.671424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:18.683188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-030b3e72-75dc-4039-8f99-8eb33cf8c28e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.445663 Jul 30 21:15:18.688006 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1939/3775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:18 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:18.991568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:18.993078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:19.027042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.028226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.029698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.030295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.156852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:19.157627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:19.175427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.181310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.182491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.183018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.372122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.385955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.388142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.389872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d5020bd-2c80-4259-bfde-750356226a63 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1363 microversion: 2.47 time: 0.237584 Jul 30 21:15:19.393706 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1940/3776] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:19 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:19.495131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.511520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.513268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.515306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-641f3c13-f0bd-49c9-8fa6-c6ec965e779b tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.530200 Jul 30 21:15:19.523933 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1837/3777] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:18 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:19.588284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:19.588977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:19.598138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.598719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.600034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.600492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.709762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:19.710782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:19.717797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.718481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.719037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:19.719579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:19.890968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:19.899211 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f34fa7d-c089-4408-85fb-53fae6c742c4 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.194152 Jul 30 21:15:19.913668 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1838/3778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:19 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:20.234994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.248184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.253105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.254717 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a5d81e72-0b65-46ef-876c-bb6979af64e5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.671626 Jul 30 21:15:20.258955 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1941/3779] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:19 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:20.403847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1e9fc3f3-4444-4a87-877a-f9c694b441e7 req-57da715d-e3db-4a24-81fb-eb8bfe8d6326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "name": "network-vif-plugged", "status": "completed", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:20.417937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1e9fc3f3-4444-4a87-877a-f9c694b441e7 req-57da715d-e3db-4a24-81fb-eb8bfe8d6326 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.418164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:20.418614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1e9fc3f3-4444-4a87-877a-f9c694b441e7 req-57da715d-e3db-4a24-81fb-eb8bfe8d6326 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.418721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:20.428199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.428943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.430613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.432130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1e9fc3f3-4444-4a87-877a-f9c694b441e7 req-57da715d-e3db-4a24-81fb-eb8bfe8d6326 service nova] Creating event network-vif-plugged:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch1-master-1 Jul 30 21:15:20.432615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.439459 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1e9fc3f3-4444-4a87-877a-f9c694b441e7 req-57da715d-e3db-4a24-81fb-eb8bfe8d6326 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039745 Jul 30 21:15:20.440739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1839/3780] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:20.483972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.484917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.485214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lazy-loading 'fault' on Instance uuid 31ed4327-6859-4038-8430-3e8378b75dbd {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:15:20.548795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:20.549775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:20.577699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.578190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.580206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.580983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.621532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.640323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.646769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.650225 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27ee6255-68be-4847-b3db-17f4254fb54e tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 200 len: 1368 microversion: 2.47 time: 0.238214 Jul 30 21:15:20.650831 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1942/3781] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:20 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:20.756667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.786206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.792834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:20.798121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5e269f2-9a7f-47b5-8ebe-9ad5907e2fb4 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.256214 Jul 30 21:15:20.801368 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1840/3782] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:20 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:20.921632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:20.922770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:20.931366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.932887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:20.934466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:20.936008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.174298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:21.182832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b30c6fb9-7717-4045-b105-dc7dcef2237d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.266445 Jul 30 21:15:21.183754 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1943/3783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:20 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:21.284614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:21.285253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:21.292963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.293442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.294826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.295320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.570294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:21.582559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:21.584732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:21.586589 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dea3fcfd-99c4-4295-a54a-c2763efe0f12 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.305790 Jul 30 21:15:21.587528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1841/3784] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:21 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:21.681006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:21.684088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 31ed4327-6859-4038-8430-3e8378b75dbd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:21.693443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.694321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.695195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.695893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.713518 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] HTTP exception thrown: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Request method failure captured: Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd HTTP/1.1 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z84H48A3_VFRlupZCJobFgzANzDArK8ccGlh5Rfx6csqIykxDJT8KiZyyDUUc1PVU4VC-MgqN6LymCiugZ0amz41xZP2LQr6NkZ5O5YH94tlICITk8oDoScyDs2fzt6cNZwFzSCW9bvFrU_fXy5nGpbiAtfZguD5X6Mq_Wxi964KwE Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.47 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ec9cf72add9f4d0d8fa2652095636289 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerShowV247Test-553200698 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec9cf72add9f4d0d8fa2652095636289", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerShowV247Test-553200698 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ec9cf72add9f4d0d8fa2652095636289 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerShowV247Test-553200698 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerShowV247Test-553200698-project Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 682921a9a9374c90be43ebe98669fb95 Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerShowV247Test-553200698-project Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '31ed4327-6859-4038-8430-3e8378b75dbd'} Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:21.715333 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. Jul 30 21:15:21.721028 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:21.722838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Returning 404 to user: Instance 31ed4327-6859-4038-8430-3e8378b75dbd could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:21.724187 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22b64eba-a551-4aa4-ae85-8719decc0530 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd" status: 404 len: 111 microversion: 2.47 time: 0.048222 Jul 30 21:15:21.725319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1944/3785] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:21 2022] GET /compute/v2.1/servers/31ed4327-6859-4038-8430-3e8378b75dbd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:15:21.741259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:21.742015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:21.752566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.754142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.756592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.757064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.794280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:21.843180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:21.852234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:21.860924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.861392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.863240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.864126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.939523 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de74de55-3b29-48d4-9a87-771b767c16a7 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 204 len: 0 microversion: 2.47 time: 0.208611 Jul 30 21:15:21.940131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1842/3786] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:15:21 2022] DELETE /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:15:21.954644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:21.956625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:21.968342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.969084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:21.970114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:21.970909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.025329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.039275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.045046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.048239 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f9de9b9-1cec-4ac8-8109-76f49abc620d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.227866 Jul 30 21:15:22.051421 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1945/3787] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:21 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:22.193547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.203761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:22.204684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:22.214200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.215808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:22.216647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.217475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:22.217944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.221853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.226494 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ed613a7-fe15-4f4a-957d-45080517454f tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 200 len: 1362 microversion: 2.47 time: 0.281739 Jul 30 21:15:22.228881 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1843/3788] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:21 2022] GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:22.616222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:22.616912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:22.627054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:22.627914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.628784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:22.630213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.902885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.913300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.914903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.917462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31d08607-446a-4836-8cab-500a0f35c35a tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.305731 Jul 30 21:15:22.918036 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1844/3789] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:22 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:22.924229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e9b4bf29-e4ff-4f6f-b861-8d2898d07964 req-3ea44b9e-f971-4940-a9f5-e939b9574603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f899fb4-394f-4c44-9f20-17495b7d9e49", "name": "network-vif-plugged", "status": "completed", "tag": "109e4efe-c5a1-4d3c-ae48-9374977b607b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:22.955503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e9b4bf29-e4ff-4f6f-b861-8d2898d07964 req-3ea44b9e-f971-4940-a9f5-e939b9574603 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:22.956274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e9b4bf29-e4ff-4f6f-b861-8d2898d07964 req-3ea44b9e-f971-4940-a9f5-e939b9574603 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:22.966005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:22.986283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f416737-b969-45ce-ad5e-4dc2dc52e4a3 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.786546 Jul 30 21:15:22.986890 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1946/3790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:22 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:22.989178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e9b4bf29-e4ff-4f6f-b861-8d2898d07964 req-3ea44b9e-f971-4940-a9f5-e939b9574603 service nova] Creating event network-vif-plugged:109e4efe-c5a1-4d3c-ae48-9374977b607b for instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 on nch2-master-1 Jul 30 21:15:23.015499 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e9b4bf29-e4ff-4f6f-b861-8d2898d07964 req-3ea44b9e-f971-4940-a9f5-e939b9574603 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091184 Jul 30 21:15:23.017576 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1845/3791] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:23.093379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:23.094061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:23.111371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.111849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:23.123257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.123815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:23.257957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:23.263470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:23.282457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.283241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:23.284299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.284916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:23.362180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.378303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.380302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.381780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-639f639a-f99b-49e4-b15f-9ee7d756c71e tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.306490 Jul 30 21:15:23.382905 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1947/3792] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:23 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:23.728474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.750378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.753203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:23.755481 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0484bc9a-cc08-4f17-bac9-9e2be74ffb71 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 200 len: 1362 microversion: 2.47 time: 0.502677 Jul 30 21:15:23.771477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1846/3793] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:23 2022] GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:23.945906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:23.946863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:23.960682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.961432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:23.962726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:23.963532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.015200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:24.027280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:24.036204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.036727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.037547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.038033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.322736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.333090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.334919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.336544 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a122a0b-6b20-4fd5-9e86-dc6530d4244b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1730 microversion: 2.20 time: 0.395513 Jul 30 21:15:24.337364 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1948/3794] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:23 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1730 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:24.377349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.391004 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a37293f9-2972-4785-a5dc-9ed0f1eb7a56 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.387287 Jul 30 21:15:24.391636 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1847/3795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:24 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:24.408742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:24.409633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:24.420491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.420966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.422918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.423643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.554968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.566352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.569575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.571218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f86d137a-3b18-41a8-9300-941c68109516 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1406 microversion: 2.54 time: 0.169423 Jul 30 21:15:24.572311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1949/3796] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:24 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:24.786388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:24.787821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:24.802517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.806413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.807585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.808763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.878744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:24.879498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:24.880253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lazy-loading 'fault' on Instance uuid 4045009f-004d-4855-bdb3-6152a67bd01e {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:15:24.941452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.952091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.953860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '682921a9a9374c90be43ebe98669fb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9cf72add9f4d0d8fa2652095636289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:24.955190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e653cdfb-8f94-4956-b866-35afbfc22ce0 tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 200 len: 1367 microversion: 2.47 time: 0.173450 Jul 30 21:15:24.956245 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1848/3797] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:24 2022] GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:25.363276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:25.363987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:25.379841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.380688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.382930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.384399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.419003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:25.420196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:25.441532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.442894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.444192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.444870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.675835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.690797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.698267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.710227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b0180eb-19f8-43b5-a7ff-70a7e3503972 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1717 microversion: 2.20 time: 0.342811 Jul 30 21:15:25.711505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1950/3798] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:25 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1717 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:25.740041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:25.743657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:25.759630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.760591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.764899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:25.765554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:25.889514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.897635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.903457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.911915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:25.912859 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4162b90-dc87-49df-b49f-efb8e26c9b3e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1350 microversion: 2.1 time: 0.499659 Jul 30 21:15:25.916488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4fb5516d-8e7b-4eb4-b8ae-65be36ec5a35 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1412 microversion: 2.54 time: 0.202075 Jul 30 21:15:25.918271 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1951/3799] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:25 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:25.937960 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1849/3800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:25 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1350 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:25.996751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:25.998640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] [instance: 4045009f-004d-4855-bdb3-6152a67bd01e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:26.018515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.023279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:26.026007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.028715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:26.061347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] HTTP exception thrown: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Request method failure captured: Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e HTTP/1.1 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z84H48A3_VFRlupZCJobFgzANzDArK8ccGlh5Rfx6csqIykxDJT8KiZyyDUUc1PVU4VC-MgqN6LymCiugZ0amz41xZP2LQr6NkZ5O5YH94tlICITk8oDoScyDs2fzt6cNZwFzSCW9bvFrU_fXy5nGpbiAtfZguD5X6Mq_Wxi964KwE Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.47 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ec9cf72add9f4d0d8fa2652095636289 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerShowV247Test-553200698 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec9cf72add9f4d0d8fa2652095636289", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec9cf72add9f4d0d8fa2652095636289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerShowV247Test-553200698 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ec9cf72add9f4d0d8fa2652095636289 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerShowV247Test-553200698 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerShowV247Test-553200698-project Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 682921a9a9374c90be43ebe98669fb95 Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerShowV247Test-553200698-project Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4045009f-004d-4855-bdb3-6152a67bd01e'} Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:26.064393 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] Returning 404 to user: Instance 4045009f-004d-4855-bdb3-6152a67bd01e could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:26.068588 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05f16b00-1c19-411b-b8b6-ffe04b0c8dde tempest-ServerShowV247Test-553200698 tempest-ServerShowV247Test-553200698-project] 10.222.0.17 "GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e" status: 404 len: 111 microversion: 2.47 time: 0.088491 Jul 30 21:15:26.073202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1952/3801] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:25 2022] GET /compute/v2.1/servers/4045009f-004d-4855-bdb3-6152a67bd01e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:15:26.945264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:26.945901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:26.949337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:26.950183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:26.961620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.962105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:26.962926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.966113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:26.967425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.972633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:26.972915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:26.984765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:27.188102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:27.200237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:27.208629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:27.211926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e46963a1-8e1d-4f2b-9e89-cfc894920d04 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1412 microversion: 2.54 time: 0.269043 Jul 30 21:15:27.213711 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1850/3802] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:26 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1412 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:27.468336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:27.512405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26bb6842-6e4e-4bc0-a341-84585f07da37 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1539 microversion: 2.1 time: 0.570410 Jul 30 21:15:27.534821 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1953/3803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:26 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1539 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:27.542289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:27.546375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:27.565742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:27.574543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:27.575857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:27.577683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:27.578939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:27.668293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:27.875178 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3c88894-bf26-442a-9d44-85923dcfb837 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338500 Jul 30 21:15:27.883550 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1851/3804] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:15:27 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:28.246308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:28.249256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:28.263670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:28.264119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:28.265015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:28.265586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:28.304160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:28.930443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:28.943558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:28.945073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:28.946298 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1614d1bb-1c39-4145-9f6c-b61dee58f5fb tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1397 microversion: 2.54 time: 0.710146 Jul 30 21:15:28.949535 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1954/3805] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:28 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1397 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:28.977630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee9a67ee-2557-4f20-9d08-e40c9f140230 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '.version_select at 0x7fbb5c0f60d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:29.062160 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee9a67ee-2557-4f20-9d08-e40c9f140230 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-33663768" status: 204 len: 0 microversion: 2.54 time: 0.090840 Jul 30 21:15:29.063977 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1852/3806] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 30 21:15:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-33663768 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:15:29.098901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:29.099648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:29.109833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:29.114700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:29.117931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:29.118421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:29.225468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:29.353506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eecbc2df-c7c8-4fa3-879b-fb3f45f9ec24 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 204 len: 0 microversion: 2.54 time: 0.275302 Jul 30 21:15:29.363658 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1955/3807] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:15:29 2022] DELETE /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:15:29.378591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:29.379242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:29.394820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:29.396229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:29.397251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:29.397882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:29.430353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:29.874519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:29.892205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:29.896727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:29.900835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-464bbc5d-7602-4582-bec9-a9c52df1a936 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1403 microversion: 2.54 time: 0.537959 Jul 30 21:15:29.902251 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1853/3808] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:29 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1403 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:30.425269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5fa3f003-046b-4b01-ada4-75503d15733f req-ab422c5b-4969-4549-b4f9-fc0f58f90604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f899fb4-394f-4c44-9f20-17495b7d9e49", "tag": "109e4efe-c5a1-4d3c-ae48-9374977b607b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:30.451212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5fa3f003-046b-4b01-ada4-75503d15733f req-ab422c5b-4969-4549-b4f9-fc0f58f90604 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:30.452319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5fa3f003-046b-4b01-ada4-75503d15733f req-ab422c5b-4969-4549-b4f9-fc0f58f90604 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:30.477278 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5fa3f003-046b-4b01-ada4-75503d15733f req-ab422c5b-4969-4549-b4f9-fc0f58f90604 service nova] Creating event network-changed:109e4efe-c5a1-4d3c-ae48-9374977b607b for instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 on nch2-master-1 Jul 30 21:15:30.493400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5fa3f003-046b-4b01-ada4-75503d15733f req-ab422c5b-4969-4549-b4f9-fc0f58f90604 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084918 Jul 30 21:15:30.498193 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1956/3809] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:30.934309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:30.934309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:30.946440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:30.948568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:30.949573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:30.949923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:31.104322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:31.117837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:31.121476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:31.128336 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc35b35b-ba0d-4f46-ad4c-33864f459a10 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1403 microversion: 2.54 time: 0.200504 Jul 30 21:15:31.132893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1854/3810] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:30 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1403 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:31.515266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-417941ac-0c1c-4f1e-81fb-6811093a07ad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Action: 'create', calling method: .version_select at 0x7fbb5d3b41f0>, body: {"keypair": {"name": "tempest-keypair-424559247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvAFGFJb7OIbyo9b0HUWA1r0k71DR+mFas+9oPeP74Todl5PlEhaAuo0WkmPShDlQREHhRhA/m1MLlcuIiKYgnUuM3MknPNJb99P7Fxht5jrhTx71L05NT0mTdnattozQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:31.585450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-417941ac-0c1c-4f1e-81fb-6811093a07ad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for project e153111da8d54ad598f44e7bbc83661d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:31.616143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-417941ac-0c1c-4f1e-81fb-6811093a07ad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for user fed2e7125f98476c8083cab9b20aa1c3 and project e153111da8d54ad598f44e7bbc83661d. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:31.674898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-417941ac-0c1c-4f1e-81fb-6811093a07ad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.463281 Jul 30 21:15:31.694659 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1957/3811] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:15:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:32.157630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:32.158952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:32.170327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:32.171384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:32.173374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:32.174925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:32.354692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:32.356249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:32.366047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lazy-loading 'fault' on Instance uuid 1fba1ce4-512c-4603-95b6-4a49e09157e8 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:15:32.769433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:32.787795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:32.790947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28f39af9487e4dee8e84bbbf58a85124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f89748dd014b50ba710e4a2e82381d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:32.796037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-243cbbb8-8eb9-4559-8d4b-deee56358111 tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 200 len: 1408 microversion: 2.54 time: 0.644616 Jul 30 21:15:32.798004 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1855/3812] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:32 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 1408 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:33.823231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:33.824769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] [instance: 1fba1ce4-512c-4603-95b6-4a49e09157e8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:33.837919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:33.839002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:33.843783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:33.844836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:33.867880 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] HTTP exception thrown: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Request method failure captured: Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 HTTP/1.1 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z9FW2rD1IY6m457I6ou_wL3G8L01Vq8nsazDnjiHPeTxuj09_PhW6Q64on1wx2SS142oe3apoFh49DHhED4SG3JAHQt6ikA54Hr1hCSvx5C9sT6lMqslWXtN83a-hYVyx5ggMfEF7oRIuNX5llsVzKYmWoENBWpQoS449bRxZc3rjo Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.54 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 89f89748dd014b50ba710e4a2e82381d Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerShowV254Test-1734140275 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89f89748dd014b50ba710e4a2e82381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89f89748dd014b50ba710e4a2e82381d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f89748dd014b50ba710e4a2e82381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89f89748dd014b50ba710e4a2e82381d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerShowV254Test-1734140275 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 89f89748dd014b50ba710e4a2e82381d Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerShowV254Test-1734140275 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerShowV254Test-1734140275-project Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 28f39af9487e4dee8e84bbbf58a85124 Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerShowV254Test-1734140275-project Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1fba1ce4-512c-4603-95b6-4a49e09157e8'} Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:15:33.870930 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] Returning 404 to user: Instance 1fba1ce4-512c-4603-95b6-4a49e09157e8 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22033771-7019-414d-8cc9-048cce72942d tempest-ServerShowV254Test-1734140275 tempest-ServerShowV254Test-1734140275-project] 10.222.0.17 "GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8" status: 404 len: 111 microversion: 2.54 time: 0.063406 Jul 30 21:15:33.883097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1958/3813] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:33 2022] GET /compute/v2.1/servers/1fba1ce4-512c-4603-95b6-4a49e09157e8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:15:36.428233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1925887646", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ac50cbf5-e7c6-4931-aa74-77b8735cd727"}], "security_groups": [{"name": "tempest-securitygroup--407846716"}], "key_name": "tempest-keypair-424559247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:36.958841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] validate_networks() for [('ac50cbf5-e7c6-4931-aa74-77b8735cd727', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:15:38.443506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for project e153111da8d54ad598f44e7bbc83661d. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:38.456001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for user fed2e7125f98476c8083cab9b20aa1c3 and project e153111da8d54ad598f44e7bbc83661d. Resources: dict_keys(['metadata_items']) {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:38.490833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:15:38.491706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:15:38.492369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:15:38.492982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:15:38.493740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:15:38.508086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:38.509021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:38.510438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:38.513051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:38.540337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for project e153111da8d54ad598f44e7bbc83661d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:38.549941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Getting quotas for user fed2e7125f98476c8083cab9b20aa1c3 and project e153111da8d54ad598f44e7bbc83661d. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:38.572999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:15:38.578557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:15:38.696688 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23e7bad8-691c-4ca8-8e48-b1b2700fb9f5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.273420 Jul 30 21:15:38.716052 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1856/3814] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:15:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:15:38.725776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-508c8b24-dd8d-4acc-a6ab-b57857a8350d tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:38.726403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-508c8b24-dd8d-4acc-a6ab-b57857a8350d tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:39.120377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-508c8b24-dd8d-4acc-a6ab-b57857a8350d tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:39.130587 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-508c8b24-dd8d-4acc-a6ab-b57857a8350d tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1277 microversion: 2.1 time: 0.409288 Jul 30 21:15:39.133488 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1959/3815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:38 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1277 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:40.154736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:40.155670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:40.181681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:40.183222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:40.184379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:40.186399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:40.588571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:40.602566 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa4eed2f-f0bf-48f9-8ea4-98af778b65df tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1273 microversion: 2.1 time: 0.452327 Jul 30 21:15:40.603185 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1857/3816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:40 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:41.567424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1025338021", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "0ca03cb7-a5f8-4515-8a6e-b8102a63f6b3"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:41.629093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:41.629723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:41.642715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:41.643198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:41.644038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:41.644505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:41.662268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] validate_networks() for [('0ca03cb7-a5f8-4515-8a6e-b8102a63f6b3', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:15:41.834160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:41.845419 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7a57f61-3dc1-4bfa-8e22-83b75c3efaa5 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1335 microversion: 2.1 time: 0.220264 Jul 30 21:15:41.863918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1858/3817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:41 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:42.875011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:42.876414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:42.884201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:42.884875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:42.885870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:42.886502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:43.062447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:43.071200 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d9c3254-6599-4e62-93a0-fcc31172733e tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1335 microversion: 2.1 time: 0.200087 Jul 30 21:15:43.083888 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1859/3818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:42 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1335 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:43.472422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:15:43.472935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:15:43.473480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:15:43.473946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:15:43.474376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:15:43.485907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:43.486382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:43.487196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:43.487680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:43.517976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Getting quotas for project 874222f573704f10bff5cb7cdce08465. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:43.544465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Getting quotas for user 4ef2420cd50d4006b7ba4e651fdaaaaa and project 874222f573704f10bff5cb7cdce08465. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:43.561315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:43.563007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:15:43.565904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:15:43.629313 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd18b86a-128e-42fc-9fd7-cd6ba1f9add2 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258504 Jul 30 21:15:43.630544 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1960/3819] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:15:43.642905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37f12d76-646f-4c42-816a-ee4b076e39c8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:43.643873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-37f12d76-646f-4c42-816a-ee4b076e39c8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:43.646443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:43.789101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37f12d76-646f-4c42-816a-ee4b076e39c8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:43.796954 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37f12d76-646f-4c42-816a-ee4b076e39c8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1225 microversion: 2.1 time: 0.157877 Jul 30 21:15:43.797333 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1860/3820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:43 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:44.106963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:44.107724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:44.153255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:44.153741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:44.154593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:44.159542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:44.824300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5941ace0-e3f8-4023-a131-87f4a30691f4 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:44.826967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5941ace0-e3f8-4023-a131-87f4a30691f4 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:44.844827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:44.854994 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd26cc81-cecd-4c31-8d41-f2f947ab7239 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.755397 Jul 30 21:15:44.855277 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1961/3821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:44 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:45.010499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5941ace0-e3f8-4023-a131-87f4a30691f4 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:45.022445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5941ace0-e3f8-4023-a131-87f4a30691f4 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1225 microversion: 2.1 time: 0.205679 Jul 30 21:15:45.026188 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1861/3822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:44 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:45.308740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1969407582", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:45.480476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:15:45.882280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:45.884555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:45.909986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:45.910521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:45.911366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:45.911834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:46.832462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:46.850996 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83651065-e7df-4436-81c0-7905cfd87dd0 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.976354 Jul 30 21:15:46.866503 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1862/3823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:45 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:46.881278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:46.882068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:46.911059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:46.912573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:46.913857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:46.914551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:47.031801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:47.050295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4971bcc4-148e-4329-bbaf-a055ac91d8ac tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1283 microversion: 2.1 time: 0.182009 Jul 30 21:15:47.053463 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1863/3824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:46 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:47.078452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8cdadc52-6060-4828-a416-48bc5872972d req-8091b3bc-6073-42a5-bac3-8bbe8d289e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775f3ea4-5108-4f1c-95b8-cf3c2b20e147", "tag": "7e2b2f19-fc6f-4439-8d8e-a2a86da32888"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:47.107383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8cdadc52-6060-4828-a416-48bc5872972d req-8091b3bc-6073-42a5-bac3-8bbe8d289e02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:47.108291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8cdadc52-6060-4828-a416-48bc5872972d req-8091b3bc-6073-42a5-bac3-8bbe8d289e02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:47.131021 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8cdadc52-6060-4828-a416-48bc5872972d req-8091b3bc-6073-42a5-bac3-8bbe8d289e02 service nova] Creating event network-changed:7e2b2f19-fc6f-4439-8d8e-a2a86da32888 for instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 on nch1-master-1 Jul 30 21:15:47.139106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8cdadc52-6060-4828-a416-48bc5872972d req-8091b3bc-6073-42a5-bac3-8bbe8d289e02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066048 Jul 30 21:15:47.140187 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1864/3825] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:47.239467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:15:47.240735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:15:47.242271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:15:47.243389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:15:47.244161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:15:47.265990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:47.266823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:47.270729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:47.271676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:47.326626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:47.339434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:47.370303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:15:47.381205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:15:47.510942 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e874ffb8-25b4-4d4e-8888-7c8fbdd4f5aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.579689 Jul 30 21:15:47.514879 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1962/3826] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:15:47.528255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee4f2a7e-b3db-47f0-82b6-2f0bb0aa6f57 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:47.529374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee4f2a7e-b3db-47f0-82b6-2f0bb0aa6f57 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:47.664120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ee4f2a7e-b3db-47f0-82b6-2f0bb0aa6f57 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:47.677872 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee4f2a7e-b3db-47f0-82b6-2f0bb0aa6f57 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1193 microversion: 2.1 time: 0.153481 Jul 30 21:15:47.681110 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1865/3827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:47 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:47.874098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:47.874884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:47.889602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:47.890162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:47.892914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:47.893655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:48.076241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:48.085710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:48.131891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:48.139584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:48.145239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:48.146207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:48.387813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:48.397071 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ae3af60-365f-419a-be20-1f6976e5e087 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1283 microversion: 2.1 time: 0.326272 Jul 30 21:15:48.401948 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1866/3828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:48 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1283 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:48.700356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b778a52e-a554-421c-91b6-0871a7c4a9bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:48.701445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b778a52e-a554-421c-91b6-0871a7c4a9bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:48.745203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:48.892084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:48.919491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b2d0837-b0aa-4471-a4c3-65332487dc1f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 1.050186 Jul 30 21:15:48.922512 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1963/3829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:47 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:48.958587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b778a52e-a554-421c-91b6-0871a7c4a9bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:48.967273 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b778a52e-a554-421c-91b6-0871a7c4a9bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1193 microversion: 2.1 time: 0.272374 Jul 30 21:15:48.971462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1867/3830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:48 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1193 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:49.435036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:49.437747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:49.478621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:49.484657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:49.490488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:49.491253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:49.839571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:49.863804 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-caff8f87-74c4-45fd-aef0-16086e187068 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.441244 Jul 30 21:15:49.867322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1964/3831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:49 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:49.954865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:49.955603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:49.968952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:49.969751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:49.971697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:49.972689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:50.220768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:50.244741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04c9c402-7ae8-494c-8ee6-48c6bfb2ac07 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.302373 Jul 30 21:15:50.247192 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1868/3832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:49 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:50.248255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1135557397", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:50.255652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:50.256542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:50.268809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:50.269712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:50.270844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:50.271384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:50.381724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] validate_networks() for [('2e0fd2fc-6829-4cec-b5ca-c934eab0b307', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:15:50.476072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:50.485100 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7db28c8-5c80-4e5f-b93d-c7cb939e8d01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1245 microversion: 2.1 time: 0.234389 Jul 30 21:15:50.486063 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1869/3833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:50 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1245 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:50.890757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:50.891906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:50.900481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:50.901417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:50.902502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:50.903177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:51.084192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:51.106562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd6200f4-4d63-4489-9955-d74630835fa6 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.217850 Jul 30 21:15:51.110492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1870/3834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:50 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:51.272690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:51.273192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:51.287863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:51.288679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:51.289946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:51.290651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:51.498660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:51.511671 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6699f81f-8ad1-4475-97a2-cdbeac5a462f tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.247850 Jul 30 21:15:51.527231 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1871/3835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:51 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:51.534090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:51.535272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:51.543742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:51.544440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:51.558154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:51.560526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:51.640616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:51.649628 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b546bc2c-f691-44c7-986c-88ec591ad23f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1251 microversion: 2.1 time: 0.120282 Jul 30 21:15:51.650373 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1872/3836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:51 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1251 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:52.139989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:52.142880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:52.169555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.170786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.172157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.173861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.389117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:52.401072 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f292d8b-2722-4a42-8c17-3e58da47faf9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.268642 Jul 30 21:15:52.411505 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1873/3837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:52 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:52.538201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:52.539099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:52.549073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.551030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.553498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.554249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.760908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:15:52.761635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:15:52.762338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:15:52.762915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:15:52.764496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:15:52.791897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:52.798967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.799824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.805539 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-636dc800-9d3a-419d-ae60-9e50badc21e1 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.274311 Jul 30 21:15:52.810407 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1874/3838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:52 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:52.811983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.812781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.829033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:52.830019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:52.850621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.852378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Getting quotas for project 73245fdcb10c4144a60fa8ca6b6a7ab8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:15:52.852548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.854946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:52.856173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:52.862813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Getting quotas for user 23ba5ddf22424eff840602440872f86e and project 73245fdcb10c4144a60fa8ca6b6a7ab8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:15:52.872477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:52.934551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:15:52.941621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:15:53.020698 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c1f0c38-f794-4f4f-b431-ec8da55f8302 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.078529 Jul 30 21:15:53.023895 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1965/3839] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:15:53.038398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae96f08b-089e-4bb1-9c70-10a3ffe59468 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:53.040030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae96f08b-089e-4bb1-9c70-10a3ffe59468 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:53.147272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:53.164582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-201c8ae9-8ed3-4050-9fbf-3bd3fdf7f2ac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1251 microversion: 2.1 time: 0.352463 Jul 30 21:15:53.170040 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1875/3840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:52 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1251 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:53.187949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ae96f08b-089e-4bb1-9c70-10a3ffe59468 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:53.203674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae96f08b-089e-4bb1-9c70-10a3ffe59468 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1217 microversion: 2.1 time: 0.172021 Jul 30 21:15:53.205015 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1966/3841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:53 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:53.431701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:53.432899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:53.460592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:53.461295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:53.464000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:53.468052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:53.974524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:53.988652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b09e0444-c4c5-4f6e-8f82-aba992b82b17 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.562636 Jul 30 21:15:53.999423 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1876/3842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:53 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:53.999423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:53.999423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:54.024320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.026331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.027182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.029450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.191044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8d9639fc-21de-46c0-9038-0373ab9863d0 req-bc60e3ac-9bf0-4a6b-b916-39ab347488c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc89c4a-7455-4a3a-b490-cbafe2829518", "tag": "f047f40e-40cc-47a9-97f3-18e95aa25959"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:54.239212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d9639fc-21de-46c0-9038-0373ab9863d0 req-bc60e3ac-9bf0-4a6b-b916-39ab347488c9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.240187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d9639fc-21de-46c0-9038-0373ab9863d0 req-bc60e3ac-9bf0-4a6b-b916-39ab347488c9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.264046 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8d9639fc-21de-46c0-9038-0373ab9863d0 req-bc60e3ac-9bf0-4a6b-b916-39ab347488c9 service nova] Creating event network-changed:f047f40e-40cc-47a9-97f3-18e95aa25959 for instance ddc89c4a-7455-4a3a-b490-cbafe2829518 on nch2-master-1 Jul 30 21:15:54.269841 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8d9639fc-21de-46c0-9038-0373ab9863d0 req-bc60e3ac-9bf0-4a6b-b916-39ab347488c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474597 Jul 30 21:15:54.270805 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1967/3843] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:15:54.292964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:54.294739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:54.302994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.303861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.309337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.310075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.464488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:54.474218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-75337050-2969-424c-8783-d78c45868f76 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1251 microversion: 2.1 time: 0.201604 Jul 30 21:15:54.481063 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1968/3844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:54 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1251 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:54.497737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:54.498764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:54.506133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.509905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.510999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:54.513702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:54.618834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:54.673186 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6421df69-a75c-40b2-91d0-f5423a906d58 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.678843 Jul 30 21:15:54.681632 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1877/3845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:53 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:54.828555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:54.852526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15d37662-aaa2-4819-b423-1e0475f02992 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1213 microversion: 2.1 time: 0.369758 Jul 30 21:15:54.859552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1969/3846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:54 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1213 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:55.018152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:55.018965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:55.048524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.055543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.058102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.062924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.365258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9ea14dab-4f4f-42ae-a723-b27eaf24f9a9 req-0f98f278-d69f-484a-8321-d8e18f5decd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775f3ea4-5108-4f1c-95b8-cf3c2b20e147", "name": "network-vif-plugged", "status": "completed", "tag": "7e2b2f19-fc6f-4439-8d8e-a2a86da32888"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:55.390102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ea14dab-4f4f-42ae-a723-b27eaf24f9a9 req-0f98f278-d69f-484a-8321-d8e18f5decd5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.391344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ea14dab-4f4f-42ae-a723-b27eaf24f9a9 req-0f98f278-d69f-484a-8321-d8e18f5decd5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.419947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:55.424324 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9ea14dab-4f4f-42ae-a723-b27eaf24f9a9 req-0f98f278-d69f-484a-8321-d8e18f5decd5 service nova] Creating event network-vif-plugged:7e2b2f19-fc6f-4439-8d8e-a2a86da32888 for instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 on nch1-master-1 Jul 30 21:15:55.428762 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fb0a467-d868-4853-a23c-f5bbf82540b8 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.417364 Jul 30 21:15:55.434457 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1878/3847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:55 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:55.436272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9ea14dab-4f4f-42ae-a723-b27eaf24f9a9 req-0f98f278-d69f-484a-8321-d8e18f5decd5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077707 Jul 30 21:15:55.438552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1970/3848] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:15:55.501042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:55.501825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:55.513290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.513761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.514575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.515034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.705811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:55.706849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:55.722205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.722666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.723496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.723948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.787246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:55.797640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-650419cf-075b-49e2-8a3d-3c2c4a30da0c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.300485 Jul 30 21:15:55.799204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1879/3849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:55 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:55.889053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:55.891621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:55.908524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.909198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:55.910164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:55.910620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.076083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:56.085392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f00960d-3720-487c-959a-a6071a42b88c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1277 microversion: 2.1 time: 0.209942 Jul 30 21:15:56.100936 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1880/3850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:55 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:56.100936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:56.102682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:56.110221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.110696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.111518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.112511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.157126 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0fecbf0e-6526-439a-8705-27d00fda3d06 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066001 Jul 30 21:15:56.157880 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1881/3851] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Jul 30 21:15:56 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:56.252379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:56.254653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:56.264326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.264898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.265771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.266302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.321616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:15:56.442747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c2a45ee-3ac1-4c35-8fb3-ee6bac954165 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 204 len: 0 microversion: 2.20 time: 0.196304 Jul 30 21:15:56.443912 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1882/3852] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:15:56 2022] DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 30 21:15:56.463017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:56.465316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:56.473927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.474887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.476286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.477455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.561277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:56.578041 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-081d8400-94d4-4c49-aa23-77336d11fd11 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.873390 Jul 30 21:15:56.580126 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1971/3853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:55 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:56.592844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:56.595268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:56.613053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.614013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.618123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.618617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.710037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:56.726099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:56.728729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:56.730465 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c43772d7-839e-402f-ace4-3c0dca9bac9b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.277503 Jul 30 21:15:56.744956 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1883/3854] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:56 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:15:56.821526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:56.822197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:56.846846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.847403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:56.848406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:56.849101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.084990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:57.101347 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4d83c9f-2452-4184-9e71-859815b97faa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.284463 Jul 30 21:15:57.105384 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1884/3855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:56 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:57.119676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:57.120320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:57.136695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.140788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.143132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.144535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.286950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:57.317197 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22460cd2-1445-41e1-b084-f78b71444ba8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1275 microversion: 2.1 time: 0.208399 Jul 30 21:15:57.318130 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1885/3856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:57 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:57.610153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:57.611148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:57.623753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.624467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.626799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.628137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.703433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:57.715181 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0c9c866-e1cd-4a66-821b-c7e597c56dce tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 1.132783 Jul 30 21:15:57.720292 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1972/3857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:56 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:57.762707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:57.763817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:57.780509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.781658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.782747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:57.783621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:57.861616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:57.869652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c6f10b2-26ca-403d-a401-05c92cd9bc10 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1402 microversion: 2.1 time: 0.271909 Jul 30 21:15:57.870626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1886/3858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:57 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1402 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:58.131568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:58.132859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:58.143172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.145006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.146401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.147076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.328012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:58.337449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:58.341790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:58.343435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:58.344810 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35da5955-a35b-4544-9474-c4e8b238e731 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.589642 Jul 30 21:15:58.351130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe9e6cf3-4645-4e4f-9e60-cc5fddcfd29b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.227864 Jul 30 21:15:58.351563 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1973/3859] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:57 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:58.355230 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1887/3860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:58 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:15:58.362089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1d8bebdf-7802-4690-97fd-ad4a32b3cb7d req-3179e55f-68fc-49e0-887b-60a7afe53b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc7afed-292d-43c7-a874-d82be0ea06e3", "tag": "89dd8e7c-46cb-4197-ad95-61783f180736"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:15:58.374096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:58.377240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:58.390779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.391320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.392123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.392637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.395179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d8bebdf-7802-4690-97fd-ad4a32b3cb7d req-3179e55f-68fc-49e0-887b-60a7afe53b70 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.396842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d8bebdf-7802-4690-97fd-ad4a32b3cb7d req-3179e55f-68fc-49e0-887b-60a7afe53b70 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.413141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:58.439244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1d8bebdf-7802-4690-97fd-ad4a32b3cb7d req-3179e55f-68fc-49e0-887b-60a7afe53b70 service nova] Creating event network-changed:89dd8e7c-46cb-4197-ad95-61783f180736 for instance afc7afed-292d-43c7-a874-d82be0ea06e3 on nch1-master-1 Jul 30 21:15:58.451936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1d8bebdf-7802-4690-97fd-ad4a32b3cb7d req-3179e55f-68fc-49e0-887b-60a7afe53b70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098952 Jul 30 21:15:58.452598 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1974/3861] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:58.524656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:58.533919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ebc1ed1-fca2-4d97-a045-9686fcbb72ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1275 microversion: 2.1 time: 0.177226 Jul 30 21:15:58.534390 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1888/3862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:58 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:58.738457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:58.739187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:58.751314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.751945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.753206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.753666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.893456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:58.894216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:58.907916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.908708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.909886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:58.910471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:58.966398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=18 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:59.117021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.125357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b3764d5-f586-44d9-8d37-147d4e512216 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1589 microversion: 2.1 time: 0.238626 Jul 30 21:15:59.126200 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1889/3863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:58 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1589 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:59.148102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:59.148902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:59.156571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.157053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.157854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.158321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.162976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:59.265317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fad6cd92-f4e4-43c0-b8ba-5abdd7f15342 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121956 Jul 30 21:15:59.265951 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1890/3864] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:15:59 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:15:59.306300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.322746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ffcf090f-470a-4f65-8370-f516a67d5b84 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.588443 Jul 30 21:15:59.329983 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1975/3865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:58 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:59.379057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:59.379612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:59.380191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:59.380791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:59.389817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.391526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.392410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.392787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.394644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.395857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.396601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.397169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.936823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.942907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.949874 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d22da34-edb8-481d-b75e-e9b353c6fdf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.574660 Jul 30 21:15:59.963380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.963380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:15:59.963722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1976/3866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:59 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:15:59.963838 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3709aff6-4cb4-48d2-9eb7-dd8d18a45ccd tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1723 microversion: 2.20 time: 0.584421 Jul 30 21:15:59.973660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:15:59.973937 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1891/3867] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:15:59 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1723 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:15:59.974304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:15:59.990622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.991213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:15:59.992602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:15:59.994285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.327577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-71c0846b-1eb9-4f8c-9934-2d69e2736084 req-b8a43ccb-ed5c-4f25-8882-5229142012df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc89c4a-7455-4a3a-b490-cbafe2829518", "name": "network-vif-plugged", "status": "completed", "tag": "f047f40e-40cc-47a9-97f3-18e95aa25959"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:00.339557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-71c0846b-1eb9-4f8c-9934-2d69e2736084 req-b8a43ccb-ed5c-4f25-8882-5229142012df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:00.340005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-71c0846b-1eb9-4f8c-9934-2d69e2736084 req-b8a43ccb-ed5c-4f25-8882-5229142012df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.372295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-71c0846b-1eb9-4f8c-9934-2d69e2736084 req-b8a43ccb-ed5c-4f25-8882-5229142012df service nova] Creating event network-vif-plugged:f047f40e-40cc-47a9-97f3-18e95aa25959 for instance ddc89c4a-7455-4a3a-b490-cbafe2829518 on nch2-master-1 Jul 30 21:16:00.382786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-71c0846b-1eb9-4f8c-9934-2d69e2736084 req-b8a43ccb-ed5c-4f25-8882-5229142012df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059477 Jul 30 21:16:00.384360 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1892/3868] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:00.391100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:00.392266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:00.398949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:00.399778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.400815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:00.401432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.561448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:00.569826 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-819569f5-bc05-4843-ae02-960036d7719d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.183803 Jul 30 21:16:00.570350 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1893/3869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:00 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:00.736503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:00.747058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-36c86be2-f732-4849-a8c9-4bfe08b13d49 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.788133 Jul 30 21:16:00.748623 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1977/3870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:15:59 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:00.978405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:00.979034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:00.986924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:00.988208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.989341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:00.989799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:00.991053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:00.991713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:01.009085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.009756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.016015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.016410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.171517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:01.183547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:01.186963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:01.188806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-58ff9493-7b66-4473-aec6-0a4189999336 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1656 microversion: 2.20 time: 0.201408 Jul 30 21:16:01.189994 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1978/3871] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:00 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1656 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:16:01.284463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:01.295987 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e50acaf4-dab2-4762-8c3b-67cbcc923413 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.321688 Jul 30 21:16:01.309527 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1894/3872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:00 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:01.451953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:01.453268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:01.460007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.460819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.462064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.463407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.465365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-cf6edba4-8810-43b3-bef0-ec4969f6209e req-e607f451-fbe1-41ac-860a-730149a1a059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775f3ea4-5108-4f1c-95b8-cf3c2b20e147", "tag": "7e2b2f19-fc6f-4439-8d8e-a2a86da32888"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:01.481335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cf6edba4-8810-43b3-bef0-ec4969f6209e req-e607f451-fbe1-41ac-860a-730149a1a059 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.482773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cf6edba4-8810-43b3-bef0-ec4969f6209e req-e607f451-fbe1-41ac-860a-730149a1a059 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.498797 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-cf6edba4-8810-43b3-bef0-ec4969f6209e req-e607f451-fbe1-41ac-860a-730149a1a059 service nova] Creating event network-changed:7e2b2f19-fc6f-4439-8d8e-a2a86da32888 for instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 on nch1-master-1 Jul 30 21:16:01.511425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-cf6edba4-8810-43b3-bef0-ec4969f6209e req-e607f451-fbe1-41ac-860a-730149a1a059 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047304 Jul 30 21:16:01.524110 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1895/3873] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:01.591396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:01.592675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:01.600073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.600938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.602155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.602623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.901796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:01.915034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dfdb44f6-c5af-462d-9023-5b798bc3b6bd tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1325 microversion: 2.1 time: 0.327885 Jul 30 21:16:01.915962 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1896/3874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:01 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:01.923993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:01.933128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:01.943345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.954133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:01.955522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:01.956149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.044029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.062687 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17ca93e8-329e-4eae-9936-c599dc45b195 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1589 microversion: 2.1 time: 0.616225 Jul 30 21:16:02.063567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1979/3875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:01 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1589 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:02.075977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-795992b9-92ad-4b11-b286-5c28e4360523 req-181e152e-6296-4112-9cb3-21a264d5850f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b470f888-1977-485a-82c0-0efd3d32bf06", "name": "network-vif-deleted", "tag": "85da7d2d-a289-48a6-87fb-7a091eba73cd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:02.101463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-795992b9-92ad-4b11-b286-5c28e4360523 req-181e152e-6296-4112-9cb3-21a264d5850f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.102140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-795992b9-92ad-4b11-b286-5c28e4360523 req-181e152e-6296-4112-9cb3-21a264d5850f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.141339 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-795992b9-92ad-4b11-b286-5c28e4360523 req-181e152e-6296-4112-9cb3-21a264d5850f service nova] Creating event network-vif-deleted:85da7d2d-a289-48a6-87fb-7a091eba73cd for instance b470f888-1977-485a-82c0-0efd3d32bf06 on nch1-master-1 Jul 30 21:16:02.155921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-795992b9-92ad-4b11-b286-5c28e4360523 req-181e152e-6296-4112-9cb3-21a264d5850f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090101 Jul 30 21:16:02.156770 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1980/3876] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:02.216994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:02.217984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:02.241315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.242245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.244747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.245538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.338990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.345814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.346429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lazy-loading 'fault' on Instance uuid b470f888-1977-485a-82c0-0efd3d32bf06 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:16:02.472303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.488461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67eba2ce-9da0-4c75-aaa3-31b978266636 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.566171 Jul 30 21:16:02.490895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1897/3877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:01 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:02.493775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.505575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:02.506766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:02.510281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.512179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f00d46cd63d94b49abfa65d6106c7d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4c650076ad4077874a72f6e64461f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.513569 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c22260d-9f76-4913-80f3-92b46ca1211b tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 200 len: 1372 microversion: 2.20 time: 0.301955 Jul 30 21:16:02.514413 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1981/3878] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:02 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:16:02.525355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.528184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.530108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.533114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.741034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:02.752066 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd7d88da-fd5d-4589-9d87-267b2b6a4529 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.258474 Jul 30 21:16:02.754164 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1898/3879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:02 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:02.850810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:02.942292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:02.942919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:02.954932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.955433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:02.959122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:02.962086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.051247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Calling method '.version_select at 0x7fbb5d774c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.052184 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:16:03.052184 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:16:03.053391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.053860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.070265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.070734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.084365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.085140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.116957 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e43d90d-b570-4fc8-aa20-ddfac1448086 tempest-PortsAdminExtendedAttrsTestJSON-218618788 tempest-PortsAdminExtendedAttrsTestJSON-218618788-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.270658 Jul 30 21:16:03.118256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1982/3880] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:16:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:03.176261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:03.186458 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b19c8d2-c676-460b-9794-1184eb0a1781 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1521 microversion: 2.1 time: 0.249710 Jul 30 21:16:03.187451 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1899/3881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:02 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:03.212900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.213573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.216121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=26 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:03.222336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.223230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.224703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.225381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.262218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] HTTP exception thrown: Action 999 not found Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Request method failure captured: Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518/os-instance-actions/999 HTTP/1.1 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z98KzJ4KPyoB4Rdj6tXbA_onZVcjL4wjEvPQzXlk_7chKK4pQfKuLtUCu2JKbPZKa7k02TFc9CE3qeJUljwcHVK7Rt7ogymfwGrhnJTPKmcVD51H_GufF3txE3k2wfwRIFb4q49zd-XnvmWPSV4bvSJ8CI9K2y_oXostSRES84R4zo Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/874222f573704f10bff5cb7cdce08465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_874222f573704f10bff5cb7cdce08465", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4ef2420cd50d4006b7ba4e651fdaaaaa Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: exception: Action 999 not found Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'ddc89c4a-7455-4a3a-b490-cbafe2829518', 'id': '999'} Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 30 21:16:03.270540 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.276763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Returning 404 to user: Action 999 not found {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:03.277892 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b58e856-e3be-404f-b603-fb81fbc310eb tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.070377 Jul 30 21:16:03.282995 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1983/3882] 10.222.0.17 () {58 vars in 1308 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518/os-instance-actions/999 => generated 66 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:16:03.289441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '.version_select at 0x7fbb5c0339d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.290058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: 3cd73eca-706a-4e08-b133-c23c9131cb59] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.297761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] HTTP exception thrown: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Request method failure captured: Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/3cd73eca-706a-4e08-b133-c23c9131cb59/os-instance-actions HTTP/1.1 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z98KzJ4KPyoB4Rdj6tXbA_onZVcjL4wjEvPQzXlk_7chKK4pQfKuLtUCu2JKbPZKa7k02TFc9CE3qeJUljwcHVK7Rt7ogymfwGrhnJTPKmcVD51H_GufF3txE3k2wfwRIFb4q49zd-XnvmWPSV4bvSJ8CI9K2y_oXostSRES84R4zo Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/874222f573704f10bff5cb7cdce08465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_874222f573704f10bff5cb7cdce08465", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4ef2420cd50d4006b7ba4e651fdaaaaa Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': '3cd73eca-706a-4e08-b133-c23c9131cb59'} Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:03.299888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. Jul 30 21:16:03.304571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.306862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Returning 404 to user: Instance 3cd73eca-706a-4e08-b133-c23c9131cb59 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:03.308231 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1142223-1088-4fa7-95d6-f275943329e9 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/3cd73eca-706a-4e08-b133-c23c9131cb59/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023627 Jul 30 21:16:03.309856 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1900/3883] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/3cd73eca-706a-4e08-b133-c23c9131cb59/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:03.319596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.327372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.334759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.335601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.336870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.337542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.369764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:03.479620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49d88524-31e3-460c-a993-885b906c6756 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 204 len: 0 microversion: 2.1 time: 0.164190 Jul 30 21:16:03.481338 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1984/3884] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:03 2022] DELETE /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:03.490066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.491737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.503498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.505533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.505533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.505533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.520066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.521197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.528834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.529434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.530808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.531571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.693363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:03.703740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4a1aa0c5-cb52-4943-b60f-d403b6d094d3 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1527 microversion: 2.1 time: 0.217396 Jul 30 21:16:03.704644 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1901/3885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1527 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:03.727204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.729257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.736616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.737114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.738098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.738741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.762058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 HTTP/1.1 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b470f888-1977-485a-82c0-0efd3d32bf06'} Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.764395 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-62c8b297-2c52-4470-9c6b-b714035bdd66 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 404 len: 111 microversion: 2.20 time: 0.060005 Jul 30 21:16:03.773359 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1902/3886] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:03.776774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.778244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:03.781814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:03.790289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.791105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.792394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:03.793872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:03.823944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:03.834303 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-016ab249-8245-43d2-9dc1-446abb16060a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.326689 Jul 30 21:16:03.835575 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1985/3887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:03.842780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ded336a-8a03-4110-b804-476058b580ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '.version_select at 0x7fbb5d774160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:03.874674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ded336a-8a03-4110-b804-476058b580ef tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075932922" status: 204 len: 0 microversion: 2.20 time: 0.037847 Jul 30 21:16:03.875667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1986/3888] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075932922 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:16:04.000066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:04.011816 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1c3b2716-897f-4b9e-a930-56fc4cdfd4a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.240969 Jul 30 21:16:04.013935 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1903/3889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:03 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:04.209207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b171574f-b4e2-42fb-9a6e-659706999b12 req-4e55ae1a-efc8-474d-a5bb-b23a42570ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:04.215993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:04.224155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b171574f-b4e2-42fb-9a6e-659706999b12 req-4e55ae1a-efc8-474d-a5bb-b23a42570ed1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.224650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b171574f-b4e2-42fb-9a6e-659706999b12 req-4e55ae1a-efc8-474d-a5bb-b23a42570ed1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.236704 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b171574f-b4e2-42fb-9a6e-659706999b12 req-4e55ae1a-efc8-474d-a5bb-b23a42570ed1 service nova] Creating event network-changed:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch2-master-1 Jul 30 21:16:04.248595 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b171574f-b4e2-42fb-9a6e-659706999b12 req-4e55ae1a-efc8-474d-a5bb-b23a42570ed1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044864 Jul 30 21:16:04.255797 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1987/3890] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:04.277859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:04.278338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:04.286914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.287658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.289121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.289809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.337905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:04.442712 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f9d782b-7aff-4fe3-b367-9afdf1c55f2d tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 204 len: 0 microversion: 2.1 time: 0.169002 Jul 30 21:16:04.444770 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1904/3891] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:04 2022] DELETE /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:04.454787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:04.455938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:04.463361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.464396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.466200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.466722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.729091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:04.734817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:04.736779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:04.741965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46042b50-fbc5-467c-aa40-c213459203c0 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1663 microversion: 2.1 time: 0.292612 Jul 30 21:16:04.747549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.748022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.748995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.749456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.763057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1988/3892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:04 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1663 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:04.823957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-73f638ce-c1aa-413a-8fc7-e282a7bfa62c req-01f36f3b-cd03-41ee-a7e9-bf9e4090926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc7afed-292d-43c7-a874-d82be0ea06e3", "name": "network-vif-plugged", "status": "completed", "tag": "89dd8e7c-46cb-4197-ad95-61783f180736"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:04.840043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-73f638ce-c1aa-413a-8fc7-e282a7bfa62c req-01f36f3b-cd03-41ee-a7e9-bf9e4090926b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.840969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-73f638ce-c1aa-413a-8fc7-e282a7bfa62c req-01f36f3b-cd03-41ee-a7e9-bf9e4090926b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.864355 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-73f638ce-c1aa-413a-8fc7-e282a7bfa62c req-01f36f3b-cd03-41ee-a7e9-bf9e4090926b service nova] Creating event network-vif-plugged:89dd8e7c-46cb-4197-ad95-61783f180736 for instance afc7afed-292d-43c7-a874-d82be0ea06e3 on nch1-master-1 Jul 30 21:16:04.870480 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-73f638ce-c1aa-413a-8fc7-e282a7bfa62c req-01f36f3b-cd03-41ee-a7e9-bf9e4090926b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054736 Jul 30 21:16:04.872178 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1989/3893] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:04.879615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:04.880855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:04.890597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.891780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.892731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:04.893261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:04.934199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:04.942857 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ad1fd3f-c15e-4b2c-a76a-3e0b1be492e1 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1527 microversion: 2.1 time: 0.218855 Jul 30 21:16:04.944592 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1905/3894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:04 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1527 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:05.035735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:05.036663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:05.044457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.044927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.045751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.046385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.304087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:05.304706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:05.312799 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b476c16c-9b8c-49ea-87dd-0a59648f37de tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.281054 Jul 30 21:16:05.313389 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1906/3895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:05 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:05.322121 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a8ea128e-bce0-4dcc-a7a5-1e4660837ad2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.447697 Jul 30 21:16:05.324464 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1990/3896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:05.770378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:05.771173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:05.779915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.780389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.781223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.781678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.966057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:05.966802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:05.973862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.974401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.975281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:05.976015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:05.978346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:05.988494 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20647168-6323-4b9b-bc9e-fba92c84629e tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1663 microversion: 2.1 time: 0.221996 Jul 30 21:16:05.989365 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1907/3897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:05 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:06.133486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:06.141586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb3fbeff-3675-4c99-94e2-57ae7932d379 tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1527 microversion: 2.1 time: 0.180632 Jul 30 21:16:06.142214 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1991/3898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:05 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:06.337787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:06.338858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:06.348222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:06.348897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:06.350445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.355436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.355436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.355436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.356630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.357321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.358466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.359118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.378720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:06.399156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:06.557641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:06.567307 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e820532-93cf-4bb9-8ac6-8a3309b1350f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.222849 Jul 30 21:16:06.568186 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1992/3899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:06 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:06.573536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:06.574826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:06.582336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.583327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.584382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.585410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.596061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:06.606670 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 HTTP/1.1 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b470f888-1977-485a-82c0-0efd3d32bf06'} Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:06.608912 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:06.615205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-074d5e25-4edb-4b12-b5e1-868a593b53c5 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 404 len: 111 microversion: 2.20 time: 0.042339 Jul 30 21:16:06.616824 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87d5d7c3-e91d-4c81-9437-483dd3c4a792 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1293 microversion: 2.1 time: 0.283830 Jul 30 21:16:06.616824 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1908/3901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:06 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1293 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:06.617992 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1993/3901] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:16:06 2022] DELETE /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:06.622749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:06.623849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: b470f888-1977-485a-82c0-0efd3d32bf06] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:06.631584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.632681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.633665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:06.634285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:06.650963 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 HTTP/1.1 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'b470f888-1977-485a-82c0-0efd3d32bf06'} Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.653570 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance b470f888-1977-485a-82c0-0efd3d32bf06 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a587f43-a830-4cab-94c2-f0210cf876ba tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06" status: 404 len: 111 microversion: 2.20 time: 0.037875 Jul 30 21:16:06.662562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1909/3902] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:06 2022] GET /compute/v2.1/servers/b470f888-1977-485a-82c0-0efd3d32bf06 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:07.020817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:07.022078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:07.030615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.031812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.033006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.034120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.164344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:07.165746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:07.174202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.175184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.176272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.177066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.741848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:07.754119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5e59c618-cbc4-494b-b02b-613ba9d1ce9f tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1663 microversion: 2.1 time: 0.739535 Jul 30 21:16:07.755240 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1994/3903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:07 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1663 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:07.756760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef2420cd50d4006b7ba4e651fdaaaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874222f573704f10bff5cb7cdce08465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:07.762597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:07.767398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:07.770035 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3eab5a26-6140-4c24-8c45-ceef4b97e32d tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 200 len: 1527 microversion: 2.1 time: 0.609595 Jul 30 21:16:07.771479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1910/3904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:07 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 1527 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:07.778779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:07.781825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:07.785746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.786563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.787793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.788423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.792170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.798343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:07.801605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:07.807208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.077519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:08.089429 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72f89a5e-2480-4115-9e1b-b68b58f64dfa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.332812 Jul 30 21:16:08.091501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1995/3905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:07 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:08.112295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:08.116610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:08.125434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.126796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.128593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.129305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.149341 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 HTTP/1.1 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2d593494-4b97-4ea2-94ce-724c5346ffd6'} Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:08.151773 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.156813 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.159656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:08.160869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3d1af3d-84a0-48f3-8ede-69321de04cb4 tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 404 len: 111 microversion: 2.20 time: 0.068124 Jul 30 21:16:08.162695 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1996/3906] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:16:08 2022] DELETE /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:08.169303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:08.195526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3630a291-654f-4618-af75-a7cca1f502bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1473 microversion: 2.1 time: 0.410382 Jul 30 21:16:08.198071 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1911/3907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:07 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:08.199052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:08.200503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] [instance: 2d593494-4b97-4ea2-94ce-724c5346ffd6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:08.217922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.223458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.224853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.225983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.249188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] HTTP exception thrown: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Request method failure captured: Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 HTTP/1.1 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z4HjuICi7t-N7q2gWFa9w8EghRWrbcPU8uR5t-jjDnzcUtWIM3XdUdqpEAJog8ldi0em7Ia-X4lvjQc45Fn67YtpL9c1-tE8sT_qRG4cfwVrKNcTzpyS8HyXxkeeg70PUrE7zC1IzTfgCebXAn0uKFOklm4a_7JCekI3aMltU8TRmA Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b4c650076ad4077874a72f6e64461f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b4c650076ad4077874a72f6e64461f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2b4c650076ad4077874a72f6e64461f3 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107471233 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f00d46cd63d94b49abfa65d6106c7d88 Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107471233-project Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2d593494-4b97-4ea2-94ce-724c5346ffd6'} Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.251526 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. Jul 30 21:16:08.257399 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:08.259790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] Returning 404 to user: Instance 2d593494-4b97-4ea2-94ce-724c5346ffd6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:08.261087 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1b6c385c-60c6-4abe-86e7-28f624c9d5dc tempest-AttachVolumeShelveTestJSON-1107471233 tempest-AttachVolumeShelveTestJSON-1107471233-project] 10.222.0.17 "GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6" status: 404 len: 111 microversion: 2.20 time: 0.082678 Jul 30 21:16:08.262510 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1997/3908] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:08 2022] GET /compute/v2.1/servers/2d593494-4b97-4ea2-94ce-724c5346ffd6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:08.328889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6f0483f5-2a8e-4cc2-9b91-13077997d158 req-a4cb33c1-0108-4c0e-8794-b682a66671ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc89c4a-7455-4a3a-b490-cbafe2829518", "name": "network-vif-deleted", "tag": "f047f40e-40cc-47a9-97f3-18e95aa25959"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:08.344558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f0483f5-2a8e-4cc2-9b91-13077997d158 req-a4cb33c1-0108-4c0e-8794-b682a66671ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.345289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f0483f5-2a8e-4cc2-9b91-13077997d158 req-a4cb33c1-0108-4c0e-8794-b682a66671ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.388902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1490716072", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:08.405732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6f0483f5-2a8e-4cc2-9b91-13077997d158 req-a4cb33c1-0108-4c0e-8794-b682a66671ee service nova] Creating event network-vif-deleted:f047f40e-40cc-47a9-97f3-18e95aa25959 for instance ddc89c4a-7455-4a3a-b490-cbafe2829518 on nch2-master-1 Jul 30 21:16:08.422972 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6f0483f5-2a8e-4cc2-9b91-13077997d158 req-a4cb33c1-0108-4c0e-8794-b682a66671ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101705 Jul 30 21:16:08.424177 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1912/3909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:08.535905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:08.728405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ca82a768-5d78-410d-b864-a6b473f9945c req-2ecfa23e-b4a9-4c5d-b4d0-084e1d6cbd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "name": "network-vif-plugged", "status": "completed", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:08.739152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ca82a768-5d78-410d-b864-a6b473f9945c req-2ecfa23e-b4a9-4c5d-b4d0-084e1d6cbd9f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.739932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ca82a768-5d78-410d-b864-a6b473f9945c req-2ecfa23e-b4a9-4c5d-b4d0-084e1d6cbd9f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.753666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ca82a768-5d78-410d-b864-a6b473f9945c req-2ecfa23e-b4a9-4c5d-b4d0-084e1d6cbd9f service nova] Creating event network-vif-plugged:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch2-master-1 Jul 30 21:16:08.760004 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ca82a768-5d78-410d-b864-a6b473f9945c req-2ecfa23e-b4a9-4c5d-b4d0-084e1d6cbd9f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Jul 30 21:16:08.761136 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1913/3910] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:08.783735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:08.784731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:08.809271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.810460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:08.811706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:08.812299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.017221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4290dc9e8042b58ae1965c00dfe78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33adbba42e242c394fc4e395ecbdca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:09.028039 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-556c20e1-cedb-439a-b6e3-b9803fef9caf tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 200 len: 1596 microversion: 2.1 time: 0.249972 Jul 30 21:16:09.028883 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1914/3911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:08 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 1596 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:09.051214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:09.052255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] [instance: ddc89c4a-7455-4a3a-b490-cbafe2829518] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:09.060884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.061483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.062549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.063234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.083733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] HTTP exception thrown: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Request method failure captured: Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 HTTP/1.1 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z98KzJ4KPyoB4Rdj6tXbA_onZVcjL4wjEvPQzXlk_7chKK4pQfKuLtUCu2JKbPZKa7k02TFc9CE3qeJUljwcHVK7Rt7ogymfwGrhnJTPKmcVD51H_GufF3txE3k2wfwRIFb4q49zd-XnvmWPSV4bvSJ8CI9K2y_oXostSRES84R4zo Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/874222f573704f10bff5cb7cdce08465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_874222f573704f10bff5cb7cdce08465", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/874222f573704f10bff5cb7cdce08465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 874222f573704f10bff5cb7cdce08465 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2100260057 Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4ef2420cd50d4006b7ba4e651fdaaaaa Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2100260057-project Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'ddc89c4a-7455-4a3a-b490-cbafe2829518'} Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:09.086604 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] Returning 404 to user: Instance ddc89c4a-7455-4a3a-b490-cbafe2829518 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f68eeba6-52e4-4e8c-a275-5d87ae769b1f tempest-InstanceActionsNegativeTestJSON-2100260057 tempest-InstanceActionsNegativeTestJSON-2100260057-project] 10.222.0.17 "GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518" status: 404 len: 111 microversion: 2.1 time: 0.049633 Jul 30 21:16:09.093242 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1915/3912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:09 2022] GET /compute/v2.1/servers/ddc89c4a-7455-4a3a-b490-cbafe2829518 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:09.203666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b90eef49-dff0-4bac-a99b-ff5b8daea183 req-20d5fcc7-3d61-4d31-9329-4dbf729b26f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f899fb4-394f-4c44-9f20-17495b7d9e49", "name": "network-vif-deleted", "tag": "109e4efe-c5a1-4d3c-ae48-9374977b607b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:09.218281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b90eef49-dff0-4bac-a99b-ff5b8daea183 req-20d5fcc7-3d61-4d31-9329-4dbf729b26f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.219082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b90eef49-dff0-4bac-a99b-ff5b8daea183 req-20d5fcc7-3d61-4d31-9329-4dbf729b26f4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.237901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b90eef49-dff0-4bac-a99b-ff5b8daea183 req-20d5fcc7-3d61-4d31-9329-4dbf729b26f4 service nova] Creating event network-vif-deleted:109e4efe-c5a1-4d3c-ae48-9374977b607b for instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 on nch2-master-1 Jul 30 21:16:09.244866 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b90eef49-dff0-4bac-a99b-ff5b8daea183 req-20d5fcc7-3d61-4d31-9329-4dbf729b26f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152267 Jul 30 21:16:09.245830 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1916/3913] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:09.254162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:09.255401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:09.264518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.265407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.266407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.267078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.556663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:09.573181 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-40cd1711-8a4f-4a9a-bcae-f4d416edeb4e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1317 microversion: 2.1 time: 0.324121 Jul 30 21:16:09.576937 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1917/3914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:09 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:09.762386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:09.763975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:09.772810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.773633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:09.774597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:09.775821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.062754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:16:10.063611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:16:10.064436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:16:10.065436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:16:10.066128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:16:10.076711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.077473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.078485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.079135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.101110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:10.108003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:10.123515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:16:10.126169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:10.170407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:10.196587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:10.198635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:10.200314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-485bbe36-093a-4048-9ced-e82728ccdd9c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2949 microversion: 2.32 time: 0.443830 Jul 30 21:16:10.200857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1918/3915] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:16:09 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2949 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:16:10.208097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:10.210219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18186be2-b66d-431b-b51b-4116960c6410 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839914 Jul 30 21:16:10.216361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] [instance: 7f899fb4-394f-4c44-9f20-17495b7d9e49] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:10.222075 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1998/3916] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:16:10.232539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.233047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.233905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.234370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.251504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:10.252062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:10.270778 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] HTTP exception thrown: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Request method failure captured: Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 HTTP/1.1 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z9VoJ4GtJl7ziX44GCxvKhbDSiOH84XdyLSQRmLE30Cn0ls1xQQn3Febfwprmu293qfQlA1H3XUHFI6BRkOwFb51KwB4IGujI9WeDpcuvkz9313-9UU5ed-Ry0Z2b97fb2TMa0Sn-6XdvwdsozWKk_wWl27TyoImdsM3X5RD7Pmw1s Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e33adbba42e242c394fc4e395ecbdca7 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestFqdnHostnames-767355233 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e33adbba42e242c394fc4e395ecbdca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e33adbba42e242c394fc4e395ecbdca7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e33adbba42e242c394fc4e395ecbdca7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e33adbba42e242c394fc4e395ecbdca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestFqdnHostnames-767355233 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e33adbba42e242c394fc4e395ecbdca7 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-767355233 Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestFqdnHostnames-767355233-project Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4b4290dc9e8042b58ae1965c00dfe78b Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestFqdnHostnames-767355233-project Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7f899fb4-394f-4c44-9f20-17495b7d9e49'} Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:10.273839 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. Jul 30 21:16:10.280561 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:10.283845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Returning 404 to user: Instance 7f899fb4-394f-4c44-9f20-17495b7d9e49 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:10.285005 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2e3cd22-b576-4b61-962d-2febd2a533f5 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49" status: 404 len: 111 microversion: 2.1 time: 0.080677 Jul 30 21:16:10.285133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:10.286496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1919/3917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:10 2022] GET /compute/v2.1/servers/7f899fb4-394f-4c44-9f20-17495b7d9e49 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:10.294429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:10.295403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:10.305475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.306292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.307837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:10.309281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:10.881225 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.scheduler.client.report [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Deleted allocations for instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 Jul 30 21:16:10.888796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.api [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Instance Mapping does not exist while attempting local delete cleanup. Jul 30 21:16:10.896379 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e35f22cb-c8f6-45a9-8825-df72eccd45e7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78" status: 204 len: 0 microversion: 2.1 time: 0.672787 Jul 30 21:16:10.897212 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 1999/3918] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:10 2022] DELETE /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:10.923037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19f50f7b-9fee-45d2-8989-9f137bd80fb1 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] Calling method '.version_select at 0x7fbb5d4c5c10>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:10.982689 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f18707b-5e5c-43fc-8ed2-679a3bb117ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.694674 Jul 30 21:16:10.984543 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1920/3919] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:16:10 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2/os-interface => generated 1831 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:16:10.994260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:10.997805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:11.002640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19f50f7b-9fee-45d2-8989-9f137bd80fb1 tempest-ServersTestFqdnHostnames-767355233 tempest-ServersTestFqdnHostnames-767355233-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383790504" status: 202 len: 0 microversion: 2.1 time: 0.098002 Jul 30 21:16:11.014551 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2000/3920] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383790504 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:16:11.021418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:11.027233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:11.028222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:11.028687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:11.029357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:11.030196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:11.040510 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 HTTP/1.1 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '79a27031-f86f-4738-8eb9-eb3b38b41f78'} Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:11.046808 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61b183f5-a9cc-46a4-9df1-1ce07735f5c9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78" status: 404 len: 111 microversion: 2.1 time: 0.034077 Jul 30 21:16:11.054257 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2001/3921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:11 2022] GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:11.143403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1280561877", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:11.239710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:11.386799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:11.405921 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9fe75bc0-90dd-4744-96a3-e0a6057a5a54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.419975 Jul 30 21:16:11.406573 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1921/3922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:10 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:11.624362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1525459418", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:11.724514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] validate_networks() for [('2e0fd2fc-6829-4cec-b5ca-c934eab0b307', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:12.743269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:16:12.743842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:16:12.744173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:16:12.744539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:16:12.745251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:16:12.770357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:12.770909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:12.771834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:12.772806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:12.793859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:12.800623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:12.816638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:16:12.819196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:12.878281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22718b91-a8b3-4c66-8c30-0275ddee9d58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.747865 Jul 30 21:16:12.879106 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2002/3923] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:16:12.895927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39f1dbee-09d0-48a6-95d9-ea8638c8d915 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:12.896330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:16:12.896979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:16:12.897364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:16:12.898715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:16:12.898715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:16:12.899582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39f1dbee-09d0-48a6-95d9-ea8638c8d915 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:12.923752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:12.924255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:12.926618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:12.928906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:12.982787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Getting quotas for project 73245fdcb10c4144a60fa8ca6b6a7ab8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:12.997746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Getting quotas for user 23ba5ddf22424eff840602440872f86e and project 73245fdcb10c4144a60fa8ca6b6a7ab8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:13.018361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:16:13.022499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:13.132944 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9e2a3b1-2a35-4ff9-b116-203b7ace6f9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513146 Jul 30 21:16:13.143159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1922/3924] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:16:13.155850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ff7fd86-eb7e-4453-b690-b906f685a18f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:13.159206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ff7fd86-eb7e-4453-b690-b906f685a18f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:13.179847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39f1dbee-09d0-48a6-95d9-ea8638c8d915 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:13.189641 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39f1dbee-09d0-48a6-95d9-ea8638c8d915 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1221 microversion: 2.1 time: 0.300567 Jul 30 21:16:13.192408 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2003/3925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:12 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1221 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:13.373495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6ff7fd86-eb7e-4453-b690-b906f685a18f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:13.381885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ff7fd86-eb7e-4453-b690-b906f685a18f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1217 microversion: 2.1 time: 0.237018 Jul 30 21:16:13.385413 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1923/3926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:13 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:14.224592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:14.225859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:14.244024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:14.246534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:14.247897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:14.250222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:14.409304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:14.410732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:14.420792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:14.422060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:14.425322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:14.428046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:14.454058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:14.464299 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2584f3ca-27bc-4a01-aa35-340438fc0215 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1273 microversion: 2.1 time: 0.243907 Jul 30 21:16:14.472430 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2004/3927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:14 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:14.789287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:14.804667 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41589266-d958-452d-a41a-2728a910e153 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1269 microversion: 2.1 time: 0.402290 Jul 30 21:16:14.808876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1924/3928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:14 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1269 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:15.496832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:15.497527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:15.511026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:15.511993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:15.513112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:15.513933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:15.728120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:15.738563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e5f1ea4-8af9-470f-81ad-a6da9ad9aef8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1279 microversion: 2.1 time: 0.247821 Jul 30 21:16:15.740099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2005/3929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:15 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:15.829465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:15.830710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:15.839700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:15.840464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:15.841245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:15.841859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:15.973817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:15.985484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea39c16f-0f1e-423d-990b-2d9885508273 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1275 microversion: 2.1 time: 0.159624 Jul 30 21:16:16.001844 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1925/3930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:15 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:16.762974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:16.766862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:16.780200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:16.780891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:16.781998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:16.782605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:17.017369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:17.018016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:17.024490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:17.027600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:17.028099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:17.029096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:17.029725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:17.038057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-015dd8b4-b308-4c2c-a64d-dc78baa1b15b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1279 microversion: 2.1 time: 0.280577 Jul 30 21:16:17.039920 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2006/3931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:16 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1279 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:17.506468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:17.515224 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aaab536e-229c-4c37-bb98-78b89f24ffb8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.503052 Jul 30 21:16:17.516114 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1926/3932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:17 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:18.060293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:18.060916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:18.075898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:18.076448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:18.077275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:18.077752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:18.541239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:18.542789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:18.558549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:18.564672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:18.565863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:18.566535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:18.646992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:18.669814 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a21ccd4e-83a1-4280-9f1f-d527657f66fb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.613207 Jul 30 21:16:18.671370 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2007/3933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:18 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:19.143894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7f3d2a38-e8d2-4428-88b7-bd1f8d991a6b req-4e0d52ad-894c-42bb-aa92-4c483238b75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481f91ad-cd2f-4aeb-b953-c2a19e6413fa", "tag": "7d8fd041-a39c-47c0-95b5-56c780f64237"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:19.166488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7f3d2a38-e8d2-4428-88b7-bd1f8d991a6b req-4e0d52ad-894c-42bb-aa92-4c483238b75f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:19.167010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7f3d2a38-e8d2-4428-88b7-bd1f8d991a6b req-4e0d52ad-894c-42bb-aa92-4c483238b75f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:19.187576 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7f3d2a38-e8d2-4428-88b7-bd1f8d991a6b req-4e0d52ad-894c-42bb-aa92-4c483238b75f service nova] Creating event network-changed:7d8fd041-a39c-47c0-95b5-56c780f64237 for instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa on nch2-master-1 Jul 30 21:16:19.193075 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7f3d2a38-e8d2-4428-88b7-bd1f8d991a6b req-4e0d52ad-894c-42bb-aa92-4c483238b75f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054070 Jul 30 21:16:19.194172 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2008/3934] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:19.702228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:19.703666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:19.733225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:19.734015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:19.737768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:19.738484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:19.843578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:19.856926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea22c7e8-93bf-4918-92c8-41d38ea8b958 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 1.321642 Jul 30 21:16:19.884620 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1927/3935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:18 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:20.202996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:20.218290 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5bcdb4a6-0b60-45b7-96a5-b3fc1cf3908a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.521064 Jul 30 21:16:20.219765 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2009/3936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:19 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:20.640682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-341a6f7a-8f5b-4c35-8d4e-7264e11399d1 req-5ecf49a9-757b-4004-a19d-514f14ec07aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f968d321-00af-45a6-b799-4a94eacdcf88", "tag": "cf16e894-c11f-4bdd-88f2-06d032046318"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:20.657953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-341a6f7a-8f5b-4c35-8d4e-7264e11399d1 req-5ecf49a9-757b-4004-a19d-514f14ec07aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:20.658679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-341a6f7a-8f5b-4c35-8d4e-7264e11399d1 req-5ecf49a9-757b-4004-a19d-514f14ec07aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:20.684520 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-341a6f7a-8f5b-4c35-8d4e-7264e11399d1 req-5ecf49a9-757b-4004-a19d-514f14ec07aa service nova] Creating event network-changed:cf16e894-c11f-4bdd-88f2-06d032046318 for instance f968d321-00af-45a6-b799-4a94eacdcf88 on nch2-master-1 Jul 30 21:16:20.693329 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-341a6f7a-8f5b-4c35-8d4e-7264e11399d1 req-5ecf49a9-757b-4004-a19d-514f14ec07aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062113 Jul 30 21:16:20.695190 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1928/3937] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:20.882036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:20.883093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:20.895502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:20.896470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:20.897710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:20.898608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:21.248165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:21.249830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:21.275882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:21.276370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:21.277239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:21.277707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:21.387655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:21.400056 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0a3aae6-3e63-4f7b-82d3-19cf01998ab0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.524175 Jul 30 21:16:21.418995 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2010/3938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:20 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:21.639193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:21.659643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b6212a3-d94b-4717-af3b-028ed8f57ae6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.421296 Jul 30 21:16:21.661605 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1929/3939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:21 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:22.423537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:22.424367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:22.432411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:22.437967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:22.439878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:22.441005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:22.681978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:22.682629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:22.691408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:22.692203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:22.693454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:22.695040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:22.783706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:22.892269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:22.904957 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd716d0d-44b3-4692-a303-274c47d8579a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.486002 Jul 30 21:16:22.906192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2011/3940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:22 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:22.959449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:22.967091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:22.971244 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe8ebb99-af51-4ea0-b628-6e9d30a1dd1f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.294002 Jul 30 21:16:22.985811 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1930/3941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:22 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:23.928089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:23.929697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:23.937014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:23.941760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:23.943255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:23.945203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:23.946009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:23.996729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:23.997542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:24.001263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:24.008592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:24.009518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:24.010613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:24.011564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:24.188381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:24.191846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:24.196376 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a55bff4-46ed-47e8-bc35-9470065d2748 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.272658 Jul 30 21:16:24.199516 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2012/3942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:23 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:24.200760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:24.207656 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf45e709-192c-4bd7-921d-19b308c50b7f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.215060 Jul 30 21:16:24.222438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1931/3943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:23 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:24.522940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13e17760-db5b-4f05-92ca-1218d1c8835e tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Action: 'create', calling method: .version_select at 0x7fbb5d0e4dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-950290625", "metadata": {"Type": "work"}}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13e17760-db5b-4f05-92ca-1218d1c8835e tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 121 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-950290625", "metadata": {"Type": "work"}}} Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-950290625', 'metadata': {'Type': 'work'}}}} Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi '#$%' Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:24.529892 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 21:16:24.535150 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.538421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13e17760-db5b-4f05-92ca-1218d1c8835e tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.539437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-13e17760-db5b-4f05-92ca-1218d1c8835e tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.338085 Jul 30 21:16:24.540297 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2013/3944] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:24.554575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca37be7-6c83-475d-8dce-5cdf08f61d7f tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Action: 'create', calling method: .version_select at 0x7fbb5c40cc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-204474942", "metadata": {"Type": "work"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca37be7-6c83-475d-8dce-5cdf08f61d7f tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 119 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-204474942", "metadata": {"Type": "work"}}} Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-204474942', 'metadata': {'Type': 'work'}}}} Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '0' Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:24.563688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 21:16:24.569600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.572015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ca37be7-6c83-475d-8dce-5cdf08f61d7f tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.574239 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ca37be7-6c83-475d-8dce-5cdf08f61d7f tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025301 Jul 30 21:16:24.575367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1932/3945] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:24.586564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef92bea2-b7ef-43a6-98ba-36eae4cf4f22 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Action: 'create', calling method: .version_select at 0x7fbb5cda71f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-170479104", "metadata": {"Type": "work"}}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef92bea2-b7ef-43a6-98ba-36eae4cf4f22 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 118 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-170479104", "metadata": {"Type": "work"}}} Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-170479104', 'metadata': {'Type': 'work'}}}} Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi '' Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:24.592916 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 21:16:24.600331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.603520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef92bea2-b7ef-43a6-98ba-36eae4cf4f22 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.605806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef92bea2-b7ef-43a6-98ba-36eae4cf4f22 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025121 Jul 30 21:16:24.607099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2014/3946] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:16:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:24.618253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e569ff5e-14f2-4a93-8ab2-7b6dc9c95c09 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Calling method '.version_select at 0x7fbb5c0d55e0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:24.660144 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e569ff5e-14f2-4a93-8ab2-7b6dc9c95c09 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] HTTP exception thrown: Volume tempest-invalid-1623697184 could not be found. Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e569ff5e-14f2-4a93-8ab2-7b6dc9c95c09 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1623697184 HTTP/1.1 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume tempest-invalid-1623697184 could not be found. Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'tempest-invalid-1623697184'} Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1623697184 could not be found. (HTTP 404) (Request-ID: req-bc7b10f4-4cdb-4373-bd81-0656efbe63c6) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:16:24.662239 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1623697184 could not be found. Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1623697184 could not be found. Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1623697184 could not be found. Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e569ff5e-14f2-4a93-8ab2-7b6dc9c95c09 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 404 to user: Volume tempest-invalid-1623697184 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e569ff5e-14f2-4a93-8ab2-7b6dc9c95c09 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1623697184" status: 404 len: 99 microversion: 2.1 time: 0.052871 Jul 30 21:16:24.668550 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1933/3947] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:16:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1623697184 => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:16:24.680405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c3578f2-ee3d-4a6d-afca-c6bf293de43a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004329 Jul 30 21:16:24.681760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2015/3948] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Jul 30 21:16:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 21:16:24.691080 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-08403f53-74ef-458d-994c-01e7e5ad860f tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003833 Jul 30 21:16:24.695070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1934/3949] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:16:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 21:16:24.706227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b638976-5d2c-4283-ae31-c18ba515f56a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Calling method '.version_select at 0x7fbb5d3b4e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:24.750496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2b638976-5d2c-4283-ae31-c18ba515f56a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] HTTP exception thrown: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b638976-5d2c-4283-ae31-c18ba515f56a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-volumes/e38e96ac-aaa8-456e-abd2-e198ae20ec87 HTTP/1.1 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: method: Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: exception: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e38e96ac-aaa8-456e-abd2-e198ae20ec87'} Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. (HTTP 404) (Request-ID: req-a23fb67c-0b7a-4f11-9fa2-4431243e46c6) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:16:24.752513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b638976-5d2c-4283-ae31-c18ba515f56a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 404 to user: Volume e38e96ac-aaa8-456e-abd2-e198ae20ec87 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2b638976-5d2c-4283-ae31-c18ba515f56a tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e38e96ac-aaa8-456e-abd2-e198ae20ec87" status: 404 len: 109 microversion: 2.1 time: 0.053999 Jul 30 21:16:24.758002 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2016/3950] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:16:24 2022] DELETE /compute/v2.1/os-volumes/e38e96ac-aaa8-456e-abd2-e198ae20ec87 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:16:24.767517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cef5940a-9792-45e2-8c9b-98ada9b90c51 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Calling method '.version_select at 0x7fbb5c40ca60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:24.811644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-cef5940a-9792-45e2-8c9b-98ada9b90c51 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] HTTP exception thrown: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cef5940a-9792-45e2-8c9b-98ada9b90c51 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Request method failure captured: Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-volumes/7abc6cc4-a418-42e9-bc99-f754cb565dad HTTP/1.1 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-nTq32YtTdF6zzGGX3JTwG4fTBpsc2soaaNsWmxTPVJgib8NfKlH3aak4TKsIevmgVWdDpBlHoijo5nJL6j5jOdYBSZAW2Jdl7-5NMhv-MBHqAB8YknQRghc8Y8znz64rhekqmHYy_tdeVALaNp3WdrRjs2kkETVWr2dHuJg-QlcI Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/667f980c89e44761854a092ff2addee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_667f980c89e44761854a092ff2addee9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/667f980c89e44761854a092ff2addee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 667f980c89e44761854a092ff2addee9 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesNegativeTest-1638034159 Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cd36f0a48bf3474984d257a447cc826c Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesNegativeTest-1638034159-project Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '7abc6cc4-a418-42e9-bc99-f754cb565dad'} Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. (HTTP 404) (Request-ID: req-12fce7e6-10a6-4e27-9901-86181a2f84c2) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:16:24.813667 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cef5940a-9792-45e2-8c9b-98ada9b90c51 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] Returning 404 to user: Volume 7abc6cc4-a418-42e9-bc99-f754cb565dad could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cef5940a-9792-45e2-8c9b-98ada9b90c51 tempest-VolumesNegativeTest-1638034159 tempest-VolumesNegativeTest-1638034159-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7abc6cc4-a418-42e9-bc99-f754cb565dad" status: 404 len: 109 microversion: 2.1 time: 0.052681 Jul 30 21:16:24.819276 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1935/3951] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:16:24 2022] GET /compute/v2.1/os-volumes/7abc6cc4-a418-42e9-bc99-f754cb565dad => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:25.238511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:25.240707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:25.250560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:25.251423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:25.252393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:25.253334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:25.255254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:25.256322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:25.290594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:25.292515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:25.297908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:25.299308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:25.891437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:25.904543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8c13dc35-1fea-42de-a8d9-4aa5cacb17a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.678306 Jul 30 21:16:25.905376 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2017/3952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:25 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:25.921468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:25.937024 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ead0c39-f4d1-49c3-8049-9c102391871e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.709700 Jul 30 21:16:25.938510 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1936/3953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:25 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:26.934193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:26.935887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:26.946188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:26.952042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:26.953160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:26.953781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:27.400107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d32dcd5c-b7ce-43a6-b569-4f08bac747e3 req-062f8b7e-05a6-4545-9b4a-0623e690ff5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481f91ad-cd2f-4aeb-b953-c2a19e6413fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d8fd041-a39c-47c0-95b5-56c780f64237"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:27.415541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d32dcd5c-b7ce-43a6-b569-4f08bac747e3 req-062f8b7e-05a6-4545-9b4a-0623e690ff5b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:27.416560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d32dcd5c-b7ce-43a6-b569-4f08bac747e3 req-062f8b7e-05a6-4545-9b4a-0623e690ff5b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:27.455324 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d32dcd5c-b7ce-43a6-b569-4f08bac747e3 req-062f8b7e-05a6-4545-9b4a-0623e690ff5b service nova] Creating event network-vif-plugged:7d8fd041-a39c-47c0-95b5-56c780f64237 for instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa on nch2-master-1 Jul 30 21:16:27.466492 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d32dcd5c-b7ce-43a6-b569-4f08bac747e3 req-062f8b7e-05a6-4545-9b4a-0623e690ff5b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.542914 Jul 30 21:16:27.472177 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2018/3954] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:27.482747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:27.509716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df633519-9f7e-44b1-aa78-04c226e79a45 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.580204 Jul 30 21:16:27.513640 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1937/3955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:26 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:27.523580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:27.527835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:27.555036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:27.558089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:27.560276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:27.566099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:28.095226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:28.110094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-307096c4-2793-448a-9acb-2c9edb6af754 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.636086 Jul 30 21:16:28.112536 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2019/3956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:27 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:28.537237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:28.537949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:28.558014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:28.558499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:28.559338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:28.562687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:28.957219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:28.974211 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbdbf28e-e5c2-495d-8531-8223fa5e56b3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1317 microversion: 2.1 time: 0.441035 Jul 30 21:16:28.977234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1938/3957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:28 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:29.144472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:29.145655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:29.158382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:29.160524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:29.164018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:29.164872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:29.170749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:29.547067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-47b429a1-5972-4fcd-8d7f-604d76f62a48 req-a192d272-7e19-4663-86de-e7d56c939307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f968d321-00af-45a6-b799-4a94eacdcf88", "name": "network-vif-plugged", "status": "completed", "tag": "cf16e894-c11f-4bdd-88f2-06d032046318"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:29.570827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-47b429a1-5972-4fcd-8d7f-604d76f62a48 req-a192d272-7e19-4663-86de-e7d56c939307 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:29.572451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-47b429a1-5972-4fcd-8d7f-604d76f62a48 req-a192d272-7e19-4663-86de-e7d56c939307 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:29.607235 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-47b429a1-5972-4fcd-8d7f-604d76f62a48 req-a192d272-7e19-4663-86de-e7d56c939307 service nova] Creating event network-vif-plugged:cf16e894-c11f-4bdd-88f2-06d032046318 for instance f968d321-00af-45a6-b799-4a94eacdcf88 on nch2-master-1 Jul 30 21:16:29.618358 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-47b429a1-5972-4fcd-8d7f-604d76f62a48 req-a192d272-7e19-4663-86de-e7d56c939307 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075361 Jul 30 21:16:29.623214 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1939/3958] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:29.670578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:29.688693 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de7b205d-7f88-403f-b5ac-ad19400b1437 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 0.555317 Jul 30 21:16:29.700223 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2020/3959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:29 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:29.996061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:29.997224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:30.011278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.014039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.014969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.017444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.712724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:30.713406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:30.728158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.728781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.731365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.732452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.813320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:30.822900 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d535628c-133a-41b3-b6e8-1d46af52bb0a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1505 microversion: 2.1 time: 0.831609 Jul 30 21:16:30.840321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1940/3960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:29 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:30.860764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:30.861688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:30.869427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.870750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.871830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:30.872511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:30.918762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:31.088937 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fed2c17-ba38-46d6-b16a-9045d844d6f1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 204 len: 0 microversion: 2.1 time: 0.236070 Jul 30 21:16:31.089957 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1941/3961] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:30 2022] DELETE /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:31.099643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:31.103501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:31.123678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:31.124741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:31.127018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:31.129013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:31.598158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:31.617239 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4980212a-83d4-488a-a72b-379702dfba0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1511 microversion: 2.1 time: 0.522202 Jul 30 21:16:31.628271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1942/3962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:31 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:31.723239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:31.726319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:31.738795 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ad4e70d-5210-4af9-9987-776190e91939 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1321 microversion: 2.1 time: 1.030838 Jul 30 21:16:31.744481 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2021/3963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:30 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1321 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:32.650040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:32.650671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:32.658561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:32.660435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:32.661311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:32.662462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:32.663085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:32.769158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:32.769909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:32.780799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:32.788155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:32.798462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:32.799885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:32.940935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:32.954409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88e3f1d2-b88e-4604-9f17-19725c9021bc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1511 microversion: 2.1 time: 0.308110 Jul 30 21:16:32.955344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1943/3964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:32 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:33.475833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:33.488958 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c60474fe-d25f-440d-a428-de2dc1a09343 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1501 microversion: 2.1 time: 0.724998 Jul 30 21:16:33.504043 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2022/3965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:32 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:33.518460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:33.519420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:33.530374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:33.534241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:33.546372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:33.547099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:33.852374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:33.864103 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3cac76c-f2c4-434e-91ce-a16d9da5b01e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1501 microversion: 2.1 time: 0.356628 Jul 30 21:16:33.864694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1944/3966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:33 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1501 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:33.892488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:33.894395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:33.911817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:33.916122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:33.918463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:33.919682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:33.986794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:33.990148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:33.991030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:34.004257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:34.007554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:34.010366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:34.013237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:34.160493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb088076-dfe8-485f-a894-f06e5e889084 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 204 len: 0 microversion: 2.1 time: 0.275068 Jul 30 21:16:34.162293 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2023/3967] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:33 2022] DELETE /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:34.176830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:34.178017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:34.188036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:34.190441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:34.192315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:34.193166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:34.415866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:34.452577 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb1e0c6c-41e7-4e7f-ad7d-2bec71e5486e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1511 microversion: 2.1 time: 0.474231 Jul 30 21:16:34.463318 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1945/3968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:33 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:34.512704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:34.531791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a326de01-47a2-4f14-9349-fcab1a42da8d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1507 microversion: 2.1 time: 0.357220 Jul 30 21:16:34.532451 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2024/3969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:34 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:34.647272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-20a9d27f-f587-49d3-a144-9c265f9450d9 req-8127de8c-903d-49cd-a7f4-80f311801e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481f91ad-cd2f-4aeb-b953-c2a19e6413fa", "name": "network-vif-deleted", "tag": "7d8fd041-a39c-47c0-95b5-56c780f64237"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:34.664629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-20a9d27f-f587-49d3-a144-9c265f9450d9 req-8127de8c-903d-49cd-a7f4-80f311801e89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:34.665106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-20a9d27f-f587-49d3-a144-9c265f9450d9 req-8127de8c-903d-49cd-a7f4-80f311801e89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:34.695184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-20a9d27f-f587-49d3-a144-9c265f9450d9 req-8127de8c-903d-49cd-a7f4-80f311801e89 service nova] Creating event network-vif-deleted:7d8fd041-a39c-47c0-95b5-56c780f64237 for instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa on nch2-master-1 Jul 30 21:16:34.707630 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-20a9d27f-f587-49d3-a144-9c265f9450d9 req-8127de8c-903d-49cd-a7f4-80f311801e89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067305 Jul 30 21:16:34.710121 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1946/3970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:35.476674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:35.477764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:35.495151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:35.495151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:35.495151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:35.504421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:35.558229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:35.558984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:35.570764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:35.572014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:35.575635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:35.578089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:35.610173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:35.613134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:35.613909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lazy-loading 'fault' on Instance uuid 481f91ad-cd2f-4aeb-b953-c2a19e6413fa {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:16:35.764039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:35.795029 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-36deb3dc-3e27-4eed-8749-dce6e6dd3c89 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 200 len: 1307 microversion: 2.1 time: 0.322926 Jul 30 21:16:35.811563 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2025/3971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:35 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:35.975936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:36.020175 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dcbdddd8-ab59-4227-b0dd-b96c387540f9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1507 microversion: 2.1 time: 0.463958 Jul 30 21:16:36.026987 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1947/3972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:35 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:36.818124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:36.820487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:36.837650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:36.840121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:36.842113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:36.843025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:36.876619 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa HTTP/1.1 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '481f91ad-cd2f-4aeb-b953-c2a19e6413fa'} Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:36.879021 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:16:36.885243 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:36.891758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:36.892671 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2b5cd439-dd0b-40f2-8485-46ce6a47f10e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 404 len: 111 microversion: 2.1 time: 0.079457 Jul 30 21:16:36.907216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:36.908700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:36.933991 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2026/3973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:36 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:36.940207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:36.941891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:36.944212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:36.945189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.050168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:37.053072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:37.074142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.078521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.081388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.084461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.270344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:37.286094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b6bd6cf-f94b-413c-a18f-aa71ee3c2839 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.385678 Jul 30 21:16:37.288049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1948/3974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:36 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:37.492026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ba8c20c-d270-4fcd-9a68-10847258f114 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ba8c20c-d270-4fcd-9a68-10847258f114 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 163 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": 12345, "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 12345 Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:37.496499 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ba8c20c-d270-4fcd-9a68-10847258f114 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ba8c20c-d270-4fcd-9a68-10847258f114 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.012377 Jul 30 21:16:37.506629 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1949/3975] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:37 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:16:37.513126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:37.522003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:37.522881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Searching by: {'deleted': False, 'project_id': 'e153111da8d54ad598f44e7bbc83661d'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:16:37.542136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.544777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.545827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.546478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.601875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:16:37.672725 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ba3ee03a-2de1-4e04-a601-a7dc9152b5d2 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.173181 Jul 30 21:16:37.682759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1950/3976] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:16:37 2022] GET /compute/v2.1/servers => generated 340 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:37.688596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:37.689403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:37.704988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.707603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.708676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:37.710430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:37.954359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:37.982728 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b800a81-ae48-4c93-944c-a39eea04915d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.306958 Jul 30 21:16:37.988629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:38.001775 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1951/3977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:37 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:38.021137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:38.029075 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f96a72f-f116-4376-8057-fa26293ea82c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 200 len: 1507 microversion: 2.1 time: 0.984513 Jul 30 21:16:38.032761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:38.036680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Searching by: {'deleted': False, 'project_id': 'e153111da8d54ad598f44e7bbc83661d'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:16:38.037320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2027/3978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:37 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 1507 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:38.043760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c24659a9-0acc-47c9-aeb1-bf42dcce5356 req-65cf9bae-65fa-4963-b497-cb28614c1ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f968d321-00af-45a6-b799-4a94eacdcf88", "name": "network-vif-deleted", "tag": "cf16e894-c11f-4bdd-88f2-06d032046318"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:38.046219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.047018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.048149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.048856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.086983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c24659a9-0acc-47c9-aeb1-bf42dcce5356 req-65cf9bae-65fa-4963-b497-cb28614c1ced service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.087478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c24659a9-0acc-47c9-aeb1-bf42dcce5356 req-65cf9bae-65fa-4963-b497-cb28614c1ced service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.117315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c24659a9-0acc-47c9-aeb1-bf42dcce5356 req-65cf9bae-65fa-4963-b497-cb28614c1ced service nova] Creating event network-vif-deleted:cf16e894-c11f-4bdd-88f2-06d032046318 for instance f968d321-00af-45a6-b799-4a94eacdcf88 on nch2-master-1 Jul 30 21:16:38.155461 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c24659a9-0acc-47c9-aeb1-bf42dcce5356 req-65cf9bae-65fa-4963-b497-cb28614c1ced service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115677 Jul 30 21:16:38.156078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2028/3979] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:38.174049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:16:38.177932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:38.180997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:38.203107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.207645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.222280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.239166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.270367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:38.292194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:38.317380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:38.318598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:38.565330 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3af1476-9653-4c87-b3f6-929c2a77446c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.560897 Jul 30 21:16:38.565935 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1952/3980] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:16:38 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:38.590353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51238d5a-03c1-4c69-bda3-9e70bed1f97b tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:38.605311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51238d5a-03c1-4c69-bda3-9e70bed1f97b tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019421 Jul 30 21:16:38.605974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1953/3981] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:16:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:38.613499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:38.631796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7823f10-739e-41d2-9524-0695ad41fe8d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.473814 Jul 30 21:16:38.636352 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2029/3982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:38 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:38.999578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:39.000292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:39.016515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.022013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.022952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.027542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.112287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:16:39.376933 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81166cab-32b9-4c66-b766-2844afc25ead tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "DELETE /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 204 len: 0 microversion: 2.1 time: 0.382635 Jul 30 21:16:39.381721 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2030/3983] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:16:38 2022] DELETE /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:16:39.395744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:39.396480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:39.413312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.413816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.418459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.418954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.444543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 HTTP/1.1 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'f968d321-00af-45a6-b799-4a94eacdcf88'} Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:39.453102 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cb26534-ee1c-4ce1-8595-e85cf42b46c2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 404 len: 111 microversion: 2.1 time: 0.071736 Jul 30 21:16:39.459128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2031/3984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:39 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:16:39.487641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:39.488407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:39.517343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.524367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.528405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:39.529080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:39.614658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-932428497", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b5b0f743-61c1-406f-a3c3-3949a45fee5e"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:39.730565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] validate_networks() for [('b5b0f743-61c1-406f-a3c3-3949a45fee5e', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:39.834793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:39.851674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7fb53cec-bf7a-40ca-b07f-aaa6b6b443fd tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1713 microversion: 2.1 time: 0.391515 Jul 30 21:16:39.865728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2032/3985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:39 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1713 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:39.865728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cb01cb3-07b5-42d2-b377-4775643e823d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: .version_select at 0x7fbb5cc07790>, body: {"keypair": {"name": "tempest-key-1835301806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk2/Vn+T6brffk0FqZ/lMqXNAPtb7qg7GDCb0Dbmny8bvNpjHsNsD2DxPLimytxANAoOOe9FMvOwQLTpkIc9bh3dU6XvDpket7/jrigbA6MzLNP4m+mQg4V2CU3sR4zsQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:39.888704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-0cb01cb3-07b5-42d2-b377-4775643e823d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:39.895914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-0cb01cb3-07b5-42d2-b377-4775643e823d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:39.944364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cb01cb3-07b5-42d2-b377-4775643e823d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.088507 Jul 30 21:16:39.945667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2033/3986] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:16:39 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:39.958010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3dd66aa3-7e9c-4697-8e2e-c07be435e52a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '.version_select at 0x7fbb5cde54c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:39.966087 ncdv-master-1 devstack@n-api.service[130984]: WARNING oslo_db.sqlalchemy.utils [None req-3dd66aa3-7e9c-4697-8e2e-c07be435e52a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 30 21:16:39.978793 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3dd66aa3-7e9c-4697-8e2e-c07be435e52a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.026329 Jul 30 21:16:39.981950 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2034/3987] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:16:39 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:16:40.155444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1317626508", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-key-1835301806", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:40.265084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:41.803245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:16:41.803813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:16:41.804323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:16:41.804665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:16:41.809089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:16:41.859200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:41.860644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:41.866232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:41.867053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:41.909527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Getting quotas for project 90a8a347af0e497dbd65c1b79f4cde22. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:41.916551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Getting quotas for user 5f6545058c3d465992b5761677dc5261 and project 90a8a347af0e497dbd65c1b79f4cde22. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:41.932514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Going to run 2 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:16:41.935263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 9b8986e8-b65c-480a-b3b1-91028574ac01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:42.009495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=9b8986e8-b65c-480a-b3b1-91028574ac01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:42.185923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2315ede-bb98-4a1b-90cd-2015715955ad tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.235576 Jul 30 21:16:42.196709 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1954/3988] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:16:42.203274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:42.204436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:42.217431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:42.218305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:42.219548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:42.220231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:42.320703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:16:42.321286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:16:42.321692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:16:42.322125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:16:42.322956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:16:42.339775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:42.340247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:42.355143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:42.356152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:42.433115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:16:42.445422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:16:42.482948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:16:42.485715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:16:42.693880 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3cf5b42-7003-48a3-bcdb-58988884d169 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543828 Jul 30 21:16:42.710075 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2035/3989] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:16:42.730655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b29ba2db-a463-47e6-8654-84b0f39be7b5 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-617805054", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "db10433c-ccc0-4fb5-b776-13e3bc933f4f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:42.911455 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-b29ba2db-a463-47e6-8654-84b0f39be7b5 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b29ba2db-a463-47e6-8654-84b0f39be7b5 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 357 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-617805054", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "db10433c-ccc0-4fb5-b776-13e3bc933f4f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: exception: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-617805054', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'db10433c-ccc0-4fb5-b776-13e3bc933f4f'}], 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:42.924336 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. Jul 30 21:16:42.929917 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:42.932202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b29ba2db-a463-47e6-8654-84b0f39be7b5 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Block Device db10433c-ccc0-4fb5-b776-13e3bc933f4f is not bootable. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:42.937121 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b29ba2db-a463-47e6-8654-84b0f39be7b5 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.225704 Jul 30 21:16:42.937908 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2036/3990] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:42.953675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:42.968280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:42.970737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Searching by: {'deleted': False, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:16:43.008456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:43.048346 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e063b2d-4769-4b45-aadb-e5e2960bacad tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1713 microversion: 2.1 time: 0.849298 Jul 30 21:16:43.054849 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1955/3991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:42 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1713 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:43.065187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.065671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.068318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.071198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9d46aea-1f7a-43ad-8704-a5e3be786486 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:43.086643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9d46aea-1f7a-43ad-8704-a5e3be786486 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:43.097861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.160915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-998af570-cff5-486f-8871-a8d0f5a0adb6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.217969 Jul 30 21:16:43.161935 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2037/3992] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:16:42 2022] GET /compute/v2.1/servers => generated 675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:43.169884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:43.172756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:43.187063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.187877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.188922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.189647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.370376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c9d46aea-1f7a-43ad-8704-a5e3be786486 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:43.388842 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9d46aea-1f7a-43ad-8704-a5e3be786486 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1229 microversion: 2.1 time: 0.329336 Jul 30 21:16:43.391638 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1956/3993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:43 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1229 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:43.408714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-072e4a92-fe0c-4a70-bd68-314a9bc8c66c tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:43.409715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-072e4a92-fe0c-4a70-bd68-314a9bc8c66c tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:43.757635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:43.781853 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e00e48ad-eca9-4ec7-8505-10b299bef7c8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.616452 Jul 30 21:16:43.786054 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2038/3994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:43 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:43.818434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:43.823272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:43.851023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.851556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.857050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:43.860582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:43.861856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-072e4a92-fe0c-4a70-bd68-314a9bc8c66c tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:43.878287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-072e4a92-fe0c-4a70-bd68-314a9bc8c66c tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1219 microversion: 2.1 time: 0.478636 Jul 30 21:16:43.879343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1957/3995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:43 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1219 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:44.078145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:44.081553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:44.175767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.181586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.182942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.183450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.540025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:44.558056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26bdfa14-0a3f-4de2-ac7a-d86851022624 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1646 microversion: 2.1 time: 0.483062 Jul 30 21:16:44.559649 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1958/3996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:44 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1646 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:44.569059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-510deab4-9740-47d2-8639-8f9d7558404a req-5ceaea33-04a8-49ca-a7b6-450c73cbe77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775f3ea4-5108-4f1c-95b8-cf3c2b20e147", "name": "network-vif-deleted", "tag": "7e2b2f19-fc6f-4439-8d8e-a2a86da32888"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:44.605942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-510deab4-9740-47d2-8639-8f9d7558404a req-5ceaea33-04a8-49ca-a7b6-450c73cbe77b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.608592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-510deab4-9740-47d2-8639-8f9d7558404a req-5ceaea33-04a8-49ca-a7b6-450c73cbe77b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.644229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-510deab4-9740-47d2-8639-8f9d7558404a req-5ceaea33-04a8-49ca-a7b6-450c73cbe77b service nova] Creating event network-vif-deleted:7e2b2f19-fc6f-4439-8d8e-a2a86da32888 for instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 on nch1-master-1 Jul 30 21:16:44.656253 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-510deab4-9740-47d2-8639-8f9d7558404a req-5ceaea33-04a8-49ca-a7b6-450c73cbe77b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094025 Jul 30 21:16:44.657306 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1959/3997] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:44.662163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:44.678046 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50c6232d-7758-4f32-bf05-9cdd5dcdfbc9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.863961 Jul 30 21:16:44.698568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2039/3998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:43 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:44.703046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:44.706329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:44.739863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.744487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.745627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.746301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.905268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:44.906070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:44.933941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.934409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:44.940695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:44.943503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:45.078974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:45.091022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f119a07d-d871-4c87-b713-ee9964160e28 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1281 microversion: 2.1 time: 0.432200 Jul 30 21:16:45.093628 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1960/3999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:44 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:45.446640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:45.483357 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5223e3b5-1cbc-42ce-899a-dce472e89ea6 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1271 microversion: 2.1 time: 0.584383 Jul 30 21:16:45.490521 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2040/4000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:44 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1271 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:45.588389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:45.589023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:45.610848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:45.613041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:45.614053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:45.614510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:45.763172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:45.763863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:45.771503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lazy-loading 'fault' on Instance uuid 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:16:46.107874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed2e7125f98476c8083cab9b20aa1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e153111da8d54ad598f44e7bbc83661d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:46.117475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:46.118310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:46.124478 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-447feb47-481e-4ea2-8852-ccf7145b022c tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 200 len: 1367 microversion: 2.1 time: 0.542067 Jul 30 21:16:46.143589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.145798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.163773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.164517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.173784 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1961/4001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:45 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 1367 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:46.190043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:46.460503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:46.472141 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-306d2b8c-4b4e-4a3e-af28-e05403b7139b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1287 microversion: 2.1 time: 0.361858 Jul 30 21:16:46.473925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2041/4002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:46 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1287 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:46.512960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:46.513821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:46.526246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.532238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.534919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.535704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.783808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-debe0a49-7982-4a9f-a31f-7d71a942a775 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1374935180", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "destination_type": "local"}, {"source_type": "volume", "uuid": "48078879-4d0f-4421-a875-29cf671cc11a", "destination_type": "invalid"}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-debe0a49-7982-4a9f-a31f-7d71a942a775 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 495 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1374935180", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "destination_type": "local"}, {"source_type": "volume", "uuid": "48078879-4d0f-4421-a875-29cf671cc11a", "destination_type": "invalid"}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1374935180', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '48078879-4d0f-4421-a875-29cf671cc11a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'invalid' Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:46.788612 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:46.795790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-debe0a49-7982-4a9f-a31f-7d71a942a775 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:46.803497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-debe0a49-7982-4a9f-a31f-7d71a942a775 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.016908 Jul 30 21:16:46.803497 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2042/4003] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:16:46.814581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:46.815436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:46.837391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.837850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.844434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:46.848698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:46.890122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:46.903628 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c388848-03b3-446e-afce-875546774aee tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1277 microversion: 2.1 time: 0.395282 Jul 30 21:16:46.907440 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1962/4004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:46 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:47.177490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:47.178006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] [instance: 775f3ea4-5108-4f1c-95b8-cf3c2b20e147] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:47.189467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.189948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.191005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.193402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.217143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] HTTP exception thrown: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Request method failure captured: Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 HTTP/1.1 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z9zdyMTkrP8-N04ZodWMBVdTuboR-03uUEruOiUsE7Akf9XdDMs7Km9Zrt_zFv-6bhlFq_LoiX8TPry0pHLmYjg2QBJyj69emg_3HGJyJ9ktGMEsOJUtow1_rpjqBb7OzNNv_rLtdQk39dBTygzZ964QkGeNXn1xe5EPy9K4BtAw8w Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e153111da8d54ad598f44e7bbc83661d Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestManualDisk-1573815886 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e153111da8d54ad598f44e7bbc83661d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e153111da8d54ad598f44e7bbc83661d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e153111da8d54ad598f44e7bbc83661d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e153111da8d54ad598f44e7bbc83661d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestManualDisk-1573815886 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e153111da8d54ad598f44e7bbc83661d Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestManualDisk-1573815886 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestManualDisk-1573815886-project Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: fed2e7125f98476c8083cab9b20aa1c3 Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestManualDisk-1573815886-project Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '775f3ea4-5108-4f1c-95b8-cf3c2b20e147'} Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:47.219177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. Jul 30 21:16:47.223947 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:47.225961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Returning 404 to user: Instance 775f3ea4-5108-4f1c-95b8-cf3c2b20e147 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:47.227101 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78194d6f-bb26-40f0-bab2-e52620b946ab tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147" status: 404 len: 111 microversion: 2.1 time: 0.053782 Jul 30 21:16:47.228367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1963/4005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:47 2022] GET /compute/v2.1/servers/775f3ea4-5108-4f1c-95b8-cf3c2b20e147 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:16:47.237115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51c2a9eb-87be-4ad7-a63c-0f78441c1287 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] Calling method '.version_select at 0x7fbb5c40c8b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:47.269123 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51c2a9eb-87be-4ad7-a63c-0f78441c1287 tempest-ServersTestManualDisk-1573815886 tempest-ServersTestManualDisk-1573815886-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424559247" status: 202 len: 0 microversion: 2.1 time: 0.035977 Jul 30 21:16:47.270273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1964/4006] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424559247 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:16:47.495198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:47.496163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:47.509721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.510775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.511655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.512124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.561433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:47.574066 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8aa74ae-8ebb-4ce2-bd01-dd842fefe587 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.770511 Jul 30 21:16:47.574773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2043/4007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:46 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:47.601132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:47.602304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:47.615611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.616349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.617364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.620365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.776094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:47.789383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73995155-77b2-4e74-b6a1-a500f064d402 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1287 microversion: 2.1 time: 0.298913 Jul 30 21:16:47.790717 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1965/4008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:47 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1287 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:47.924693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:47.925628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:47.939548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.940722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:47.941836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:47.942373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:48.097062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:48.114833 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8a38c79c-54de-422d-87f8-cfa75965d2e0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1277 microversion: 2.1 time: 0.193910 Jul 30 21:16:48.118015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1966/4009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:47 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:48.501820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:48.512165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0e192ea9-d708-4367-8a06-b116866f4b2b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.914878 Jul 30 21:16:48.514232 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2044/4010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:47 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:48.758080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a2c236c-94c0-413b-b5f3-dbcda51cb48b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098352537", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a2c236c-94c0-413b-b5f3-dbcda51cb48b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 492 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098352537", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1098352537', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.769403 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 30 21:16:48.774501 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:48.779918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a2c236c-94c0-413b-b5f3-dbcda51cb48b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:48.779918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a2c236c-94c0-413b-b5f3-dbcda51cb48b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026551 Jul 30 21:16:48.779918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1967/4011] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:48 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:48.790682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:48.792737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:48.815102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:48.816180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:48.820444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:48.821265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:48.822557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:48.823440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:48.831700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:48.832850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:48.836854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:48.837273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:49.329655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:49.342661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e0dc8c9-5ee2-4243-87ff-dc08f17d0e62 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.558595 Jul 30 21:16:49.344429 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2045/4012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:48 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:49.351803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:49.353271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:49.361832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:49.362610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:49.363645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:49.364672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:49.406699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:49.420841 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-896eecd0-3e6a-4aa2-8739-27fecf00f876 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.612607 Jul 30 21:16:49.422548 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1968/4013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:48 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:49.427728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:49.428729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:49.436221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:49.437097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:49.438555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:49.439561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:49.809256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:49.818085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe3a396e-7219-475a-884c-713dee61f5e1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.471799 Jul 30 21:16:49.819078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2046/4014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:49 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:50.158008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:50.176274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-648b7a33-6b71-47f9-880e-851e175b52b1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.752329 Jul 30 21:16:50.177159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1969/4015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:49 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:50.319420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-90d8813a-01ff-41a2-a54e-1d865b8c4cbd req-086a375e-7566-474a-9b10-7b349cdff2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8986e8-b65c-480a-b3b1-91028574ac01", "tag": "b3874acb-19f0-489c-9e27-ae907983cd55"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:50.335320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-90d8813a-01ff-41a2-a54e-1d865b8c4cbd req-086a375e-7566-474a-9b10-7b349cdff2f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.335796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-90d8813a-01ff-41a2-a54e-1d865b8c4cbd req-086a375e-7566-474a-9b10-7b349cdff2f2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.342213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e3bba6e-2566-4713-be77-d64af5237021 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e3bba6e-2566-4713-be77-d64af5237021 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 416 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.346303 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:50.350595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e3bba6e-2566-4713-be77-d64af5237021 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:50.352805 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e3bba6e-2566-4713-be77-d64af5237021 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013378 Jul 30 21:16:50.352805 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1970/4016] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:50 2022] POST /compute/v2.1/servers => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:50.364364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:50.364911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:50.375177 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-90d8813a-01ff-41a2-a54e-1d865b8c4cbd req-086a375e-7566-474a-9b10-7b349cdff2f2 service nova] Creating event network-changed:b3874acb-19f0-489c-9e27-ae907983cd55 for instance 9b8986e8-b65c-480a-b3b1-91028574ac01 on nch2-master-1 Jul 30 21:16:50.382318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-90d8813a-01ff-41a2-a54e-1d865b8c4cbd req-086a375e-7566-474a-9b10-7b349cdff2f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066483 Jul 30 21:16:50.383471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.383962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.384914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.385381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.389588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2047/4017] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:50.446194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:50.447022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:50.456928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.457399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.458211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.458671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.887012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:50.896027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9cb68c45-0442-43de-901e-5dec09bc7745 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.454852 Jul 30 21:16:50.911094 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2048/4018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:50 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:50.917071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:50.918690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:50.926151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.927174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:50.928404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:50.929223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.089392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:51.100301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c98acacb-735d-40b9-8b4a-68078b0007f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.743702 Jul 30 21:16:51.101089 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1971/4019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:50 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:51.128241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:51.129202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:51.137751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.138688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.139801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.140470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.447690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:51.456977 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc8fa178-c3be-4762-b262-dfe1e349f9b1 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.544227 Jul 30 21:16:51.471008 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2049/4020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:50 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:51.633546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:51.646856 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-065ff1e4-8ace-4896-91d6-f06b4a48448f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.522985 Jul 30 21:16:51.647499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1972/4021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:51 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:51.724093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-022e112b-b3d0-4ff2-9c61-9cd6573ee980 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504416581", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": -1, "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:51.742931 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-022e112b-b3d0-4ff2-9c61-9cd6573ee980 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Flavor -1 could not be found. Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-022e112b-b3d0-4ff2-9c61-9cd6573ee980 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 205 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504416581", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": -1, "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: exception: Flavor -1 could not be found. Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-504416581', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': -1, 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:51.746061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-022e112b-b3d0-4ff2-9c61-9cd6573ee980 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:51.750792 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-022e112b-b3d0-4ff2-9c61-9cd6573ee980 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.030026 Jul 30 21:16:51.754615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2050/4022] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:51 2022] POST /compute/v2.1/servers => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 30 21:16:51.757066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:51.757687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:51.766333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.766801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.767639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.768602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.871044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6d874ff8-ec6d-4c0f-8009-1d5d7608ebdc req-a964e8f5-1c17-4bfc-ac04-456dedc383ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584f4217-ab9f-4d64-bc00-11fccb7aebb2", "tag": "447a1f2d-ccdf-4ec5-a940-c6d7a523e97a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:51.890013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:51.893964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:51.911880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d874ff8-ec6d-4c0f-8009-1d5d7608ebdc req-a964e8f5-1c17-4bfc-ac04-456dedc383ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.913790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d874ff8-ec6d-4c0f-8009-1d5d7608ebdc req-a964e8f5-1c17-4bfc-ac04-456dedc383ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.933508 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6d874ff8-ec6d-4c0f-8009-1d5d7608ebdc req-a964e8f5-1c17-4bfc-ac04-456dedc383ee service nova] Creating event network-changed:447a1f2d-ccdf-4ec5-a940-c6d7a523e97a for instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 on nch2-master-1 Jul 30 21:16:51.942608 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6d874ff8-ec6d-4c0f-8009-1d5d7608ebdc req-a964e8f5-1c17-4bfc-ac04-456dedc383ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080417 Jul 30 21:16:51.943963 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2051/4023] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:51.950151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:51.950871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:51.959241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.959877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:51.960692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:51.961155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.136873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:52.153845 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cd99338-f797-41e8-a101-b2117ebe4edc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.400946 Jul 30 21:16:52.155124 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1973/4024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:51 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:52.193938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:52.194660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:52.218532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.219677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.220551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.223133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.428957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:52.443979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-edb1305b-71a3-45d6-87e6-4eaa73ba8bd9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.270331 Jul 30 21:16:52.444732 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1974/4025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:52 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:52.460676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2264ee6d-73d2-40bf-8036-f4c1e2cd757b req-04be532c-15f4-41b5-83a2-01482712028f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd3e202-8266-42c4-8975-424915d555a7", "tag": "031665cd-454e-4012-b4a6-077c834ae3a6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:52.465656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:52.492141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2264ee6d-73d2-40bf-8036-f4c1e2cd757b req-04be532c-15f4-41b5-83a2-01482712028f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.492632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2264ee6d-73d2-40bf-8036-f4c1e2cd757b req-04be532c-15f4-41b5-83a2-01482712028f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.513297 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2264ee6d-73d2-40bf-8036-f4c1e2cd757b req-04be532c-15f4-41b5-83a2-01482712028f service nova] Creating event network-changed:031665cd-454e-4012-b4a6-077c834ae3a6 for instance 0cd3e202-8266-42c4-8975-424915d555a7 on nch1-master-1 Jul 30 21:16:52.521068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2264ee6d-73d2-40bf-8036-f4c1e2cd757b req-04be532c-15f4-41b5-83a2-01482712028f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074765 Jul 30 21:16:52.521417 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1975/4026] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:52.532815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:52.534146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:52.543956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.544430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.545224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.552257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.610288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:52.632247 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6116d6e-0101-441a-b3c3-6465dfe09a10 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.685854 Jul 30 21:16:52.632893 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2052/4027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:51 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:52.656558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb4a01e8-1ddf-4adf-9cbe-f3eaebcaf001 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2034097315", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb4a01e8-1ddf-4adf-9cbe-f3eaebcaf001 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 173 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2034097315", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2034097315', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi -1 Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:16:52.668390 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb4a01e8-1ddf-4adf-9cbe-f3eaebcaf001 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb4a01e8-1ddf-4adf-9cbe-f3eaebcaf001 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.024705 Jul 30 21:16:52.676043 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2053/4028] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:52 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:52.691372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:52.692916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:52.706377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.706981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:52.708047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:52.708691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:53.144629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:53.413087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:53.421084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:53.430496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3ed8c04-586c-4d58-be3a-6c5edb86f16c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.752173 Jul 30 21:16:53.432331 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2054/4029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:52 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:53.434298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0af06a4d-831c-452a-a23b-9ae4aa1554df tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.911675 Jul 30 21:16:53.438600 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1976/4030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:52 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:53.467529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:53.468966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:53.478159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:53.479350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:53.480324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:53.481077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:53.668971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:53.669742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:53.684404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:53.684781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:53.685595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:53.686329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:53.698854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:53.870333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:54.037773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:54.058700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d090ba0-53cd-4d51-9317-a6730d95164c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.597103 Jul 30 21:16:54.080157 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2055/4031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:53 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:54.155000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0572e297-47c4-4c0c-93a6-42f3a74095ae tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-436207242", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:54.167477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-0572e297-47c4-4c0c-93a6-42f3a74095ae tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0572e297-47c4-4c0c-93a6-42f3a74095ae tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 215 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-436207242", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-436207242', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:54.170377 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 30 21:16:54.177038 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:54.180894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0572e297-47c4-4c0c-93a6-42f3a74095ae tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:54.184461 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0572e297-47c4-4c0c-93a6-42f3a74095ae tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033348 Jul 30 21:16:54.191233 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2056/4032] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:54 2022] POST /compute/v2.1/servers => generated 123 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:54.205507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:54.207199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:54.224708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.225476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:54.226450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.227140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:54.260623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:54.292185 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc7d1f14-1518-4bfe-a736-fb357f5a4fe9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.629552 Jul 30 21:16:54.303374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1977/4033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:53 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:54.458364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:54.460437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:54.476915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.477637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:54.479181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.481141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:54.759206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:54.778966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db56413b-2671-46b7-a9e2-200fc81146a1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.584233 Jul 30 21:16:54.791467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2057/4034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:54 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:54.803553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:54.804284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:54.816214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.816802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:54.820146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:54.820700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:55.274210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:55.300690 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-387506f1-12cf-4334-b617-40bc351d60d0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.846007 Jul 30 21:16:55.302514 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1978/4035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:54 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:55.320608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:55.321954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:55.339718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:55.340469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:55.341285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:55.343149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:55.488930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:55.499147 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a71002aa-5137-4ec3-b015-43941b7eee41 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.699599 Jul 30 21:16:55.503966 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2058/4036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:54 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:55.640056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1596292706", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-key-1077380213", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:55.724084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] validate_networks() for [('2e0fd2fc-6829-4cec-b5ca-c934eab0b307', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:16:55.765978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:55.774973 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58216dfd-9daa-4b37-8446-1fd06936ce99 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.462492 Jul 30 21:16:55.779808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1979/4037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:55 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:56.323554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:56.324619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:56.333170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:56.334057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:56.335131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:56.336343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:56.620205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:56.629512 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fca5d5c8-1a33-4672-bbaa-07fe2f9a0edd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.311343 Jul 30 21:16:56.630598 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1980/4038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:56 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:56.801843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:56.803216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:56.812623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:56.818399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:56.819564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:56.820190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:56.992773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Invalid key_name provided. Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 247 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1596292706", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-key-1077380213", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid key_name provided. Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1596292706', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'key_name': 'tempest-key-1077380213', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1077380213 not found for user 23ba5ddf22424eff840602440872f86e Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:56.995494 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 30 21:16:57.002001 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:16:57.011013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid key_name provided. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:57.016283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cf6238e-1df1-4e9a-95b9-c428ba18bbe2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.380189 Jul 30 21:16:57.017774 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2059/4039] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:55 2022] POST /compute/v2.1/servers => generated 70 bytes in 1383 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 30 21:16:57.033835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:57.034885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:57.051625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.053131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:57.056005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.058489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:57.247191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:57.257240 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-944ac076-4f4b-4fb5-b080-ed3ebd7efe8a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.459753 Jul 30 21:16:57.265791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1981/4040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:56 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:57.592417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:57.613273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a484157-f079-48e7-820c-95e321be89df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.588747 Jul 30 21:16:57.617143 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2060/4041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:57 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:16:57.641728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:57.642465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:57.653606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:57.654542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:57.670587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:57.672741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.675848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.676738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:57.677583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:57.678803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.683227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:57.684531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:57.684951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.000866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:58.024048 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c5f7c3d-5262-4124-b7a5-85f17f2ed38e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.375961 Jul 30 21:16:58.025481 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2061/4042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:57 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:58.038635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6d53b307-8c93-4e05-874e-cb6da7e72b97 req-3e697eae-4afa-46e8-9375-c7267408d80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8986e8-b65c-480a-b3b1-91028574ac01", "name": "network-vif-plugged", "status": "completed", "tag": "b3874acb-19f0-489c-9e27-ae907983cd55"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:58.067707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d53b307-8c93-4e05-874e-cb6da7e72b97 req-3e697eae-4afa-46e8-9375-c7267408d80f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:58.068426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d53b307-8c93-4e05-874e-cb6da7e72b97 req-3e697eae-4afa-46e8-9375-c7267408d80f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.091248 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6d53b307-8c93-4e05-874e-cb6da7e72b97 req-3e697eae-4afa-46e8-9375-c7267408d80f service nova] Creating event network-vif-plugged:b3874acb-19f0-489c-9e27-ae907983cd55 for instance 9b8986e8-b65c-480a-b3b1-91028574ac01 on nch2-master-1 Jul 30 21:16:58.124439 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6d53b307-8c93-4e05-874e-cb6da7e72b97 req-3e697eae-4afa-46e8-9375-c7267408d80f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085307 Jul 30 21:16:58.125785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2062/4043] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:16:58.146200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:58.155942 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5d2fb20-14ae-4c0b-85b6-f1ff3b5a7068 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.518102 Jul 30 21:16:58.157862 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1982/4044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:57 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:58.279321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:58.280295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:58.294495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:58.295323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.296282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:58.296898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.461927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-663009541", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:16:58.614420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.security_group_api [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Neutron security group does_not_exist not found {{(pid=130983) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 30 21:16:58.617721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 257 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-663009541", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-663009541', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 30 21:16:58.659807 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:16:58.665147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:16:58.672564 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee298011-6882-4b1e-a553-b48afde47ab3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.204018 Jul 30 21:16:58.672564 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1983/4045] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:16:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:16:58.672564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:58.672564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:58.696193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:58.696693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.697907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:58.699575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:58.862074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:58.877692 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e3cf18d8-b8a6-4286-b957-1d96d55090fc tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.603426 Jul 30 21:16:58.879069 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2063/4046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:58 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:59.062281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:59.071854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:59.133030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.136129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:59.137408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.139542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:59.469013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:59.476046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:59.478300 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-62e8396d-3f5a-4f25-a03d-3ffd77ce39dd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.430685 Jul 30 21:16:59.492428 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2064/4047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:59 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:59.539366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:16:59.567133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6620208-bae0-46fb-a71c-e79ad6fe3c33 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.899261 Jul 30 21:16:59.567793 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1984/4048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:58 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:16:59.588791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:59.589437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:59.598768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.599465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:59.600742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.601415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:59.904278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:16:59.904914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:16:59.919661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.920150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:16:59.920974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:16:59.921650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.133738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:00.150914 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e8e1b62-f109-411a-9d47-0be16ac34c24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.566126 Jul 30 21:17:00.152170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2065/4049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:59 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:00.172941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:00.173814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: bbb5ad6d-56e5-4b25-be7b-79252ed2819f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:00.180843 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/bbb5ad6d-56e5-4b25-be7b-79252ed2819f HTTP/1.1 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'bbb5ad6d-56e5-4b25-be7b-79252ed2819f'} Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:00.197331 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:00.202973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance bbb5ad6d-56e5-4b25-be7b-79252ed2819f could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:00.204178 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef0788c1-8f4e-46b2-92f5-bdf787837fb3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bbb5ad6d-56e5-4b25-be7b-79252ed2819f" status: 404 len: 111 microversion: 2.1 time: 0.035531 Jul 30 21:17:00.205385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2066/4050] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:00 2022] DELETE /compute/v2.1/servers/bbb5ad6d-56e5-4b25-be7b-79252ed2819f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:00.214170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:00.216006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:00.226030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.226632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.229572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.232052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.337125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:00.401123 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a89be446-9db6-48da-a841-2038fd4d0f02 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.500558 Jul 30 21:17:00.426139 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1985/4051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:16:59 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:00.454106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:00.463985 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc6f8a87-6d46-4be6-b493-dbd38863bf9a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.253186 Jul 30 21:17:00.465280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2067/4052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:00 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:00.489490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:00.490140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:00.499834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:00.500403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:00.501569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.515316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.515316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.515316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.515832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.515832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.516014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:00.517914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:00.810329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:00.824149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bfcc22c9-6d25-4152-a3e1-63ae0dd6b55a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.328339 Jul 30 21:17:00.825525 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2068/4053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:00 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:01.201988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1ead810c-a25b-466d-a1ea-a6e830615593 req-895f7bb5-8ee5-41c6-a79f-690f66678ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584f4217-ab9f-4d64-bc00-11fccb7aebb2", "name": "network-vif-plugged", "status": "completed", "tag": "447a1f2d-ccdf-4ec5-a940-c6d7a523e97a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:01.223704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ead810c-a25b-466d-a1ea-a6e830615593 req-895f7bb5-8ee5-41c6-a79f-690f66678ed8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.224190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1ead810c-a25b-466d-a1ea-a6e830615593 req-895f7bb5-8ee5-41c6-a79f-690f66678ed8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.231536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:01.265484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-938c06f5-41cb-444a-9414-a560ed84e421 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.776189 Jul 30 21:17:01.284500 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1986/4054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:00 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:01.293232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:01.293730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:17:01.294258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 30 21:17:01.305485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1ead810c-a25b-466d-a1ea-a6e830615593 req-895f7bb5-8ee5-41c6-a79f-690f66678ed8 service nova] Creating event network-vif-plugged:447a1f2d-ccdf-4ec5-a940-c6d7a523e97a for instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 on nch2-master-1 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 9223372036854775808 could not be found. Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '9223372036854775808'} Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:01.308593 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:01.316583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:01.321729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e038d478-50b7-4b24-88f7-1de163141078 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024094 Jul 30 21:17:01.322386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1987/4055] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Jul 30 21:17:01 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:17:01.332148 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1ead810c-a25b-466d-a1ea-a6e830615593 req-895f7bb5-8ee5-41c6-a79f-690f66678ed8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135501 Jul 30 21:17:01.342615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2069/4056] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:17:01.345031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:01.346247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:01.355419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.356177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.357175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.357790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.425778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:01.426635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:01.446762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.452190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.453242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.454552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.740970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:01.782925 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-508fd7d3-13cc-4d9a-ac14-3a5691b08245 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.445738 Jul 30 21:17:01.789261 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1988/4057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:01 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:01.816853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:01.817456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:01.838487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.842181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:01.845272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:01.845960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.001377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:02.029003 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc114076-8016-4012-b812-462cff00d35e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.608327 Jul 30 21:17:02.029623 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2070/4058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:01 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:02.055072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:02.055735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:02.073709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.074188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.074994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.075477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.307831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:02.322499 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-54e5cc9f-ce69-4adb-9e67-efbf5444fb9f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.507123 Jul 30 21:17:02.322499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1989/4059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:01 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:02.340887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:02.341811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Failed to fetch instance by id -1 {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 30 21:17:02.342417 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance -1 could not be found. Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance -1 could not be found. Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '-1'} Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:02.344485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c39c837a-a3fe-4a57-9d67-d6f12208f9cd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012071 Jul 30 21:17:02.355456 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1990/4060] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Jul 30 21:17:02 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:17:02.361879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:02.374445 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0636a8bd-cb05-403a-a11a-c533cd267951 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.322226 Jul 30 21:17:02.385089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:02.385634 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2071/4061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:02 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:02.385763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:02.390901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.390901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.390901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.390901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.758666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:02.769771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29c33d3e-b618-4ced-a0b8-e2bbe134413f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.413458 Jul 30 21:17:02.772147 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1991/4062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:02 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:02.796536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:02.797455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:02.805762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.806294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.815928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:02.816588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:02.993440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:03.016309 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a477dcf7-17f8-46a4-873e-c8b716a18f9c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.222649 Jul 30 21:17:03.018996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2072/4063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:02 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:03.038349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:03.039038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 25d14f55-5b2a-4bd1-80e5-f3a251c8611d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.050335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:03.051309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.061131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. Jul 30 21:17:03.064977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.065706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/25d14f55-5b2a-4bd1-80e5-f3a251c8611d/action HTTP/1.1 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 19 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: {"forceDelete": {}} Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '25d14f55-5b2a-4bd1-80e5-f3a251c8611d', 'body': {'forceDelete': {}}} Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:03.068202 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 25d14f55-5b2a-4bd1-80e5-f3a251c8611d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be7c0007-a2b3-4af9-82e2-448d0943d6c3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/25d14f55-5b2a-4bd1-80e5-f3a251c8611d/action" status: 404 len: 111 microversion: 2.1 time: 0.035826 Jul 30 21:17:03.073182 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1992/4064] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:03 2022] POST /compute/v2.1/servers/25d14f55-5b2a-4bd1-80e5-f3a251c8611d/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:03.074255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.074789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.085421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:03.088228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.096102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.096806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.098393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.099041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.317059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:03.328276 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5842325-4e5f-49bd-93e6-6e266eff6119 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1329 microversion: 2.1 time: 0.282690 Jul 30 21:17:03.329609 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2073/4065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:03 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1329 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:03.404373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:03.405437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.416598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.419980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.421124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.423504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.592797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:03.604030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:03.605635 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-914c70c3-960c-4051-82f1-3e0077aaa80a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.526800 Jul 30 21:17:03.611655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-09865c05-582f-49cc-9602-406142c80dc7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.212756 Jul 30 21:17:03.612602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2074/4066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:03 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:03.623721 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1993/4067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:03 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:03.631515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-74dd2917-7c66-4dd6-9493-02565b9d1d00 req-0d425cfa-02fb-4c09-9847-083615bff673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd3e202-8266-42c4-8975-424915d555a7", "name": "network-vif-plugged", "status": "completed", "tag": "031665cd-454e-4012-b4a6-077c834ae3a6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:03.638421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:03.640778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.644831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-74dd2917-7c66-4dd6-9493-02565b9d1d00 req-0d425cfa-02fb-4c09-9847-083615bff673 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.645668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-74dd2917-7c66-4dd6-9493-02565b9d1d00 req-0d425cfa-02fb-4c09-9847-083615bff673 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.656211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.656684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.657498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:03.657946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:03.664854 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-74dd2917-7c66-4dd6-9493-02565b9d1d00 req-0d425cfa-02fb-4c09-9847-083615bff673 service nova] Creating event network-vif-plugged:031665cd-454e-4012-b4a6-077c834ae3a6 for instance 0cd3e202-8266-42c4-8975-424915d555a7 on nch1-master-1 Jul 30 21:17:03.686775 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-74dd2917-7c66-4dd6-9493-02565b9d1d00 req-0d425cfa-02fb-4c09-9847-083615bff673 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064242 Jul 30 21:17:03.688066 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1994/4068] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:03.917006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:03.927192 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a27eb8c6-f691-487c-b039-35524331fb1a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.294480 Jul 30 21:17:03.929984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2075/4069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:03 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:03.952962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:03.955853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 1c0b415c-6820-487e-b72d-2cfb54a41a3a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:03.962215 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/1c0b415c-6820-487e-b72d-2cfb54a41a3a/action HTTP/1.1 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 39 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: {"os-getConsoleOutput": {"length": 10}} Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1c0b415c-6820-487e-b72d-2cfb54a41a3a', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.971566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. Jul 30 21:17:03.976591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:03.979055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 1c0b415c-6820-487e-b72d-2cfb54a41a3a could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:03.980186 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e849a2c1-f4db-4e7f-a756-511eb1ecf13f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/1c0b415c-6820-487e-b72d-2cfb54a41a3a/action" status: 404 len: 111 microversion: 2.1 time: 0.033370 Jul 30 21:17:03.981258 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1995/4070] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:03 2022] POST /compute/v2.1/servers/1c0b415c-6820-487e-b72d-2cfb54a41a3a/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:03.989109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:03.989741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.003184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.004245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.004999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.006924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.226712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:04.236033 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b085df18-58f7-4333-a61c-d72b2fbb41d1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.250414 Jul 30 21:17:04.245303 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2076/4071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:03 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:04.264928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.266148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.281666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.285549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.287452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.288043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.352538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.354389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.361739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.362588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.363819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.364421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.483854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:04.495709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-46723325-0016-4e36-a7b6-90e3bb1d0211 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.233786 Jul 30 21:17:04.496341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1996/4072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:04.518358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.519200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 6a2c6465-6da6-4502-9eaa-96eb5555f53d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.529851 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/6a2c6465-6da6-4502-9eaa-96eb5555f53d HTTP/1.1 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '6a2c6465-6da6-4502-9eaa-96eb5555f53d'} Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:04.532374 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 6a2c6465-6da6-4502-9eaa-96eb5555f53d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9229772e-e8f0-4b6a-b659-40ce7bcc5ab4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/6a2c6465-6da6-4502-9eaa-96eb5555f53d" status: 404 len: 111 microversion: 2.1 time: 0.021433 Jul 30 21:17:04.542211 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1997/4073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/6a2c6465-6da6-4502-9eaa-96eb5555f53d => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:04.545701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.546759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.555833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.558099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.559149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.559967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.597321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:04.607968 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17db24cc-e342-4457-b54c-b08809c1a7db tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1510 microversion: 2.1 time: 0.261486 Jul 30 21:17:04.609196 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2077/4074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:04.637359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.638451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.657232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.657729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.658520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.661227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.827706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:04.840298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0e0a5540-dfd5-4ddf-b0a6-d9de183bdc02 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.299551 Jul 30 21:17:04.840893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1998/4075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:04.855559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.856197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.867548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.868023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.869004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.869474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.929409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:04.940327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fcfce54d-9d9e-49d7-ae3a-fc75782c7b16 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1510 microversion: 2.1 time: 0.314889 Jul 30 21:17:04.941033 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2078/4076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:04.945798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:04.946420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:04.953725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.954191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:04.955026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:04.955547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.153249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:05.164088 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9ca9b5be-204f-4a2d-9bd5-68e24d47a7d0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.221978 Jul 30 21:17:05.165687 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2079/4077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:05.171093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:05.171782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:05.186908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.187509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.188701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.189221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.190563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:05.207079 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e79c609b-ce78-46e2-809f-2de2651a0f5d tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1319 microversion: 2.1 time: 0.355524 Jul 30 21:17:05.207712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 1999/4078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:04 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:05.247671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:05.367190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-622f5694-8389-4dfc-a716-a490d5c73686 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-25125899", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-622f5694-8389-4dfc-a716-a490d5c73686 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 236 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-25125899", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-25125899', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.388571 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 30 21:17:05.393834 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:05.398540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-622f5694-8389-4dfc-a716-a490d5c73686 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:05.399021 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-622f5694-8389-4dfc-a716-a490d5c73686 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035626 Jul 30 21:17:05.400049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2000/4079] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:17:05.409465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:05.412661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:05.420925 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37cf827d-f169-45bf-9970-6a5e52d44948 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 204 len: 0 microversion: 2.1 time: 0.252853 Jul 30 21:17:05.421541 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2080/4080] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:05 2022] DELETE /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:05.431776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:05.432773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:05.436865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.437657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.438702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.441326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.444692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.450940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.452051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.452652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.478542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:05.489075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:05.789597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:05.804683 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d3986583-f4a3-41a9-b3cb-90e9188dea27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.400022 Jul 30 21:17:05.822826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2001/4081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:05 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:05.838814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:05.847677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:05.873589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.877227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.879748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:05.880251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:05.952882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:05.961485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc2599c4-3468-4456-a5be-1ff5b99f1eaf tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1516 microversion: 2.1 time: 0.534971 Jul 30 21:17:05.964957 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2081/4082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:05 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:06.153796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:06.162944 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11856903-5853-404d-a5f9-6894afbef68d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.333311 Jul 30 21:17:06.167131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2002/4083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:05 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:06.229117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:06.229732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:06.246433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.246936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.249816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.250301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.383176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4acd41d-2575-445b-9894-2dd15f74350c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-628279749", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4acd41d-2575-445b-9894-2dd15f74350c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 234 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-628279749", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-628279749', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.391986 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:06.397629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4acd41d-2575-445b-9894-2dd15f74350c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:06.400685 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4acd41d-2575-445b-9894-2dd15f74350c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.019354 Jul 30 21:17:06.401139 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2003/4084] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:06 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:17:06.416258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:06.416977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:06.446290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.447938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.448772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.449278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.628968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:06.638161 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2db5269c-75f4-44f9-9e10-a04582cb1527 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 200 len: 1506 microversion: 2.1 time: 0.413879 Jul 30 21:17:06.642839 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2082/4085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:06 2022] GET /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:06.664728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:06.665803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 9b8986e8-b65c-480a-b3b1-91028574ac01] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:06.678417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.679468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.681851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.683743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.812529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:06.825655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5124076a-2af0-454e-b7b5-5a8a2561380c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.415386 Jul 30 21:17:06.827360 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2004/4086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:06 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:06.848505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:06.849238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:06.857950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.858422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:06.859432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:06.860439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.135428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:07.151954 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a590676f-43de-4afb-ac37-b980ca6e049f tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/9b8986e8-b65c-480a-b3b1-91028574ac01" status: 200 len: 1506 microversion: 2.1 time: 0.492517 Jul 30 21:17:07.152499 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2083/4087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:06 2022] GET /compute/v2.1/servers/9b8986e8-b65c-480a-b3b1-91028574ac01 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:07.169478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:07.172098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:07.196169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:07.199871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.202071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.203592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.207157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.207726 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-583b3af3-a6e0-4046-825a-cf137a080d12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.363292 Jul 30 21:17:07.209018 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2005/4088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:06 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:07.217355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:07.218130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 9b8986e8-b65c-480a-b3b1-91028574ac01] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:07.227472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.232713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.233831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.237606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.299325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 9b8986e8-b65c-480a-b3b1-91028574ac01] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:07.502402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67a463b6-33b5-481e-85ab-d0f1a591c272 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9b8986e8-b65c-480a-b3b1-91028574ac01" status: 204 len: 0 microversion: 2.1 time: 0.289289 Jul 30 21:17:07.504169 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2006/4089] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:07 2022] DELETE /compute/v2.1/servers/9b8986e8-b65c-480a-b3b1-91028574ac01 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:07.518619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:07.529951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: a67cb8a8-b046-4271-b029-cbba02ba1c56] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:07.544322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/a67cb8a8-b046-4271-b029-cbba02ba1c56/action HTTP/1.1 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 13 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: {"pause": {}} Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a67cb8a8-b046-4271-b029-cbba02ba1c56', 'body': {'pause': {}}} Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:07.553169 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:07.558613 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:07.558613 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:07.558613 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. Jul 30 21:17:07.558613 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:07.560233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance a67cb8a8-b046-4271-b029-cbba02ba1c56 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:07.561332 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b660dd48-0dc0-4bc1-8900-dbe69249e07c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/a67cb8a8-b046-4271-b029-cbba02ba1c56/action" status: 404 len: 111 microversion: 2.1 time: 0.050517 Jul 30 21:17:07.566066 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2007/4090] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:07 2022] POST /compute/v2.1/servers/a67cb8a8-b046-4271-b029-cbba02ba1c56/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:07.578353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:07.586264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:07.616127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.619622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.620579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.622714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.674844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 0cd3e202-8266-42c4-8975-424915d555a7] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:07.857992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7234ae2c-d561-4380-a6a7-f12d97bfd6cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7" status: 204 len: 0 microversion: 2.1 time: 0.289424 Jul 30 21:17:07.860634 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2008/4091] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:07 2022] DELETE /compute/v2.1/servers/0cd3e202-8266-42c4-8975-424915d555a7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:07.870563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:07.871366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:07.887777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.888309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:07.890188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:07.890776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:08.346105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:08.359609 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1f170e2d-0449-4d01-9b45-6456ddf1e7f4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.496836 Jul 30 21:17:08.360472 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2009/4092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:07 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:08.389463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-689046916", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b5b0f743-61c1-406f-a3c3-3949a45fee5e"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:08.487928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] validate_networks() for [('b5b0f743-61c1-406f-a3c3-3949a45fee5e', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:17:08.842102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:08.869605 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d80e3471-e401-4aec-9d0f-718889135064 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1516 microversion: 2.1 time: 1.705291 Jul 30 21:17:08.894436 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2084/4093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:07 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1516 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:08.916874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:08.919747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:08.945252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:08.947246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:08.951948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:08.952855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:09.568682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:17:09.569315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:17:09.569993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:17:09.571251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:17:09.572871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:17:09.606983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:09.608569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:09.622377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:09.625946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:09.686065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Getting quotas for project 90a8a347af0e497dbd65c1b79f4cde22. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:09.694056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Getting quotas for user 5f6545058c3d465992b5761677dc5261 and project 90a8a347af0e497dbd65c1b79f4cde22. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:09.711051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Going to run 2 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:17:09.714680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:09.785015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=3c9aee76-9e0a-44e6-b39b-d2215a57497d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:09.929532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a50220b-09e4-458c-b12d-8f0a5f7bc928 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.546658 Jul 30 21:17:09.933006 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2010/4094] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1572 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 30 21:17:09.948767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1a407bde-380b-4865-b1fc-d7c4c26c1af4 req-51a48566-144c-4261-b7fe-398c7cc84e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584f4217-ab9f-4d64-bc00-11fccb7aebb2", "name": "network-vif-deleted", "tag": "447a1f2d-ccdf-4ec5-a940-c6d7a523e97a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:09.977681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1a407bde-380b-4865-b1fc-d7c4c26c1af4 req-51a48566-144c-4261-b7fe-398c7cc84e03 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:09.979765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1a407bde-380b-4865-b1fc-d7c4c26c1af4 req-51a48566-144c-4261-b7fe-398c7cc84e03 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.021022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1a407bde-380b-4865-b1fc-d7c4c26c1af4 req-51a48566-144c-4261-b7fe-398c7cc84e03 service nova] Creating event network-vif-deleted:447a1f2d-ccdf-4ec5-a940-c6d7a523e97a for instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 on nch2-master-1 Jul 30 21:17:10.045388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1a407bde-380b-4865-b1fc-d7c4c26c1af4 req-51a48566-144c-4261-b7fe-398c7cc84e03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108561 Jul 30 21:17:10.048264 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2011/4095] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:10.053130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:10.053855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:10.078579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.079072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.083072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.083734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.185419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.186959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.187811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lazy-loading 'fault' on Instance uuid 584f4217-ab9f-4d64-bc00-11fccb7aebb2 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:17:10.453026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:10.467966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9df9b7c5-3cc3-43e9-b0e9-e85e60506f08 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 1.570086 Jul 30 21:17:10.470875 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2085/4096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:08 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:10.499414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:10.510525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:10.520876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:10.524326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Searching by: {'deleted': False, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:17:10.538616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b525a0ae-7270-4e2b-b5e8-7043dd55d6bb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 200 len: 1319 microversion: 2.1 time: 0.487498 Jul 30 21:17:10.543094 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2012/4097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:10 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:10.572585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.573356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.576120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.576809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.578508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:10.580148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:10.601731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.602702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.604426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.605109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.656344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:17:10.751489 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5eb43f55-b443-4264-be4d-85b239eedb89 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.272526 Jul 30 21:17:10.752443 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2086/4098] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:17:10 2022] GET /compute/v2.1/servers => generated 1333 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:10.773058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8edf988e-21e6-4862-b9c2-b71edf075f79 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:10.778668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8edf988e-21e6-4862-b9c2-b71edf075f79 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:10.785838 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-256f6bc9-f6c0-4844-ae0a-55b4b048df07 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.240530 Jul 30 21:17:10.811528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2013/4099] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:10 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:17:10.839414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:10.841379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:10.866094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.870006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:10.872415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:10.874450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:11.129819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8edf988e-21e6-4862-b9c2-b71edf075f79 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:11.140461 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8edf988e-21e6-4862-b9c2-b71edf075f79 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1217 microversion: 2.1 time: 0.375654 Jul 30 21:17:11.153050 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2087/4100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:10 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1217 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:11.176607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cbd785db-e428-49f8-a0fa-b0d4c0c80a4a req-d92b6967-e644-4f69-b6cf-060ebbc63828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8986e8-b65c-480a-b3b1-91028574ac01", "name": "network-vif-deleted", "tag": "b3874acb-19f0-489c-9e27-ae907983cd55"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:11.215045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cbd785db-e428-49f8-a0fa-b0d4c0c80a4a req-d92b6967-e644-4f69-b6cf-060ebbc63828 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:11.225052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cbd785db-e428-49f8-a0fa-b0d4c0c80a4a req-d92b6967-e644-4f69-b6cf-060ebbc63828 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:11.256282 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cbd785db-e428-49f8-a0fa-b0d4c0c80a4a req-d92b6967-e644-4f69-b6cf-060ebbc63828 service nova] Creating event network-vif-deleted:b3874acb-19f0-489c-9e27-ae907983cd55 for instance 9b8986e8-b65c-480a-b3b1-91028574ac01 on nch2-master-1 Jul 30 21:17:11.287334 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cbd785db-e428-49f8-a0fa-b0d4c0c80a4a req-d92b6967-e644-4f69-b6cf-060ebbc63828 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122688 Jul 30 21:17:11.288147 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2088/4101] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:11.562272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:11.563741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:11.580216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:11.580689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:11.581548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:11.581930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:11.635820 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 HTTP/1.1 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '584f4217-ab9f-4d64-bc00-11fccb7aebb2'} Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:11.637692 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:17:11.643397 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:11.648383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:11.650404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3806abb-eef8-40cf-bb52-d6daea5096c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 404 len: 111 microversion: 2.1 time: 0.092353 Jul 30 21:17:11.652619 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2089/4102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:11 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:11.662573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2169887c-ab55-4d64-9f9b-12eefc587279 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '.version_select at 0x7fbb5d0b34c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:11.734514 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2169887c-ab55-4d64-9f9b-12eefc587279 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-key-1835301806" status: 202 len: 0 microversion: 2.1 time: 0.075634 Jul 30 21:17:11.737066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2090/4103] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Jul 30 21:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1835301806 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:17:11.746447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:11.756361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3efa0128-57c3-47eb-8a24-6d01ec1533d8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1510 microversion: 2.1 time: 0.943441 Jul 30 21:17:11.756926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2014/4104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:10 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1510 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:12.075233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1576281123", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:12.172611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:12.173243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:12.195332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:17:12.204068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:12.204558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:12.205378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:12.205894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:12.407862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:12.429713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-afa63ede-ce1a-4a2b-bc89-a61cdd551e07 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1213 microversion: 2.1 time: 0.261233 Jul 30 21:17:12.430694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2015/4105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:12 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1213 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:12.781693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:12.782512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:12.795648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:12.796223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:12.796950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:12.797410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.254404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:14.258109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:14.270198 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f6a1c6f1-ce35-4d61-a218-55bb6483d035 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1490 microversion: 2.1 time: 1.492113 Jul 30 21:17:14.284669 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2016/4106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:12 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1490 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:14.303608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-429786ae-9d3a-4b7d-9859-790e0c36b09e req-eb6da9bb-cfc6-4767-b2a3-a35a9a8229dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd3e202-8266-42c4-8975-424915d555a7", "name": "network-vif-deleted", "tag": "031665cd-454e-4012-b4a6-077c834ae3a6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:14.318183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-429786ae-9d3a-4b7d-9859-790e0c36b09e req-eb6da9bb-cfc6-4767-b2a3-a35a9a8229dd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.318940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-429786ae-9d3a-4b7d-9859-790e0c36b09e req-eb6da9bb-cfc6-4767-b2a3-a35a9a8229dd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.335559 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-429786ae-9d3a-4b7d-9859-790e0c36b09e req-eb6da9bb-cfc6-4767-b2a3-a35a9a8229dd service nova] Creating event network-vif-deleted:031665cd-454e-4012-b4a6-077c834ae3a6 for instance 0cd3e202-8266-42c4-8975-424915d555a7 on nch1-master-1 Jul 30 21:17:14.342891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-429786ae-9d3a-4b7d-9859-790e0c36b09e req-eb6da9bb-cfc6-4767-b2a3-a35a9a8229dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Jul 30 21:17:14.344601 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2017/4107] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:14.351255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:14.352267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:14.360990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.361751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.362742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.363480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.545744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:14.548179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:17:14.548674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:17:14.549155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:17:14.549683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:17:14.550436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:17:14.562172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81839b10-32db-4f17-b602-01830cd617b4 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1275 microversion: 2.1 time: 0.212758 Jul 30 21:17:14.563073 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2018/4108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:14 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:14.570201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.572594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.574664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3c92149c-60b2-498a-a26d-1f0d779d4647 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Action: 'create', calling method: .version_select at 0x7fbb629dc280>, body: {"keypair": {"name": "tempest-keypair-595636488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6gwkC/f+0PBulzZ4HI3WkleRw3uL0kROhof7KVfwmJ+24BIHfehXmVXHMZ7f7sSTmUOVgTZ5UxDltr1AKXCN9CExPR/zQbN8Rs5HuROnZgx8wkZ8py2uyTm78DfbZXWg=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:14.576035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.576541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.608244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:14.616618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3c92149c-60b2-498a-a26d-1f0d779d4647 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Getting quotas for project 8696e08b027f4d259759dff57403f900. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:14.625978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:14.627243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3c92149c-60b2-498a-a26d-1f0d779d4647 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Getting quotas for user 7369e2a4c5b24e85b94816e6404b300f and project 8696e08b027f4d259759dff57403f900. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:14.645262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:14.669719 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3c92149c-60b2-498a-a26d-1f0d779d4647 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.103458 Jul 30 21:17:14.671936 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2019/4109] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Jul 30 21:17:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 21:17:14.680310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:17:14.680484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:14.680935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:14.682707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:14.691917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.698067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.699197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.700366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.739596 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'pause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state paused Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 13 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: {"pause": {}} Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'pause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state paused Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'pause': {}}} Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state paused. Cannot pause while the instance is in this state. Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state paused Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:14.741926 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state paused Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:14.747889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'pause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state paused {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:14.749322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:14.749489 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-142bbaa0-59ea-4f79-bbbe-d42b92aeede2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 143 microversion: 2.1 time: 0.072944 Jul 30 21:17:14.758176 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2020/4110] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:14 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 143 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:17:14.769127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:14.770084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:14.779352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.780122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.786490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e3391da-bc07-4707-b32a-8e426bdca603 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.718088 Jul 30 21:17:14.794581 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2091/4111] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:17:14.795444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:14.797254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:14.801911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71aabf5d-5417-4e2c-8a8d-843ccb30716c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:14.802815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71aabf5d-5417-4e2c-8a8d-843ccb30716c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:14.987431 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7aa1a536-21f5-4646-8d8a-c4f9f7594957 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.206444 Jul 30 21:17:14.989623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2021/4112] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:14 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:17:15.018288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:15.019499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:15.029445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:15.030781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:15.031849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:15.034690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:15.159961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71aabf5d-5417-4e2c-8a8d-843ccb30716c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:15.176329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71aabf5d-5417-4e2c-8a8d-843ccb30716c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1209 microversion: 2.1 time: 0.380473 Jul 30 21:17:15.179095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2092/4113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:14 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1209 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:15.530028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:15.543506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c561bef-6c62-4a40-b891-2f62989faa35 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1497 microversion: 2.1 time: 0.530180 Jul 30 21:17:15.544775 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2022/4114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:15 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1497 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:15.590309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:15.591586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:15.604561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:15.605336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:15.607063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:15.607802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:16.203528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:16.205153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:16.220476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:16.222337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:16.225327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:16.226274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:16.346032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:16.360487 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db21919f-e018-42d6-b7fd-fbd7403c56b7 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1275 microversion: 2.1 time: 0.776403 Jul 30 21:17:16.361904 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2093/4115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:15 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1275 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:16.463234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:16.475033 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75545378-3c83-44b3-b5a0-89620f8f010e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1261 microversion: 2.1 time: 0.278480 Jul 30 21:17:16.476772 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2023/4116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:16 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1261 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:16.569015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:16.570155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:16.587354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:16.589848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:16.592595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:16.595080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.150036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:17.161052 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95536334-b769-4453-92ea-09572a2550a4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.598894 Jul 30 21:17:17.164036 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2094/4117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:16 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:17.186599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:17.187734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:17.194000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.194463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.195325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.196312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.383583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:17.384496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:17.396557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.398864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.401188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.403000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.669773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:17.680731 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04dc97bf-9a59-437f-86ff-991a7b9e5a4c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.498034 Jul 30 21:17:17.681237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2024/4118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:17 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:17.691201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:17.691856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:17.708840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.709308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.714226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:17.714226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:17.942551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:17.958420 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8c02eaee-f71b-4992-81e9-39d584cc29fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1267 microversion: 2.1 time: 0.273988 Jul 30 21:17:17.958420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2025/4119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:17 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:17.979334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:17.989067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:18.009828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.017626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.018921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.020385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.065661 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action HTTP/1.1 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 28 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: {"reboot": {"type": "SOFT"}} Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '481f91ad-cd2f-4aeb-b953-c2a19e6413fa', 'body': {'reboot': {'type': 'SOFT'}}} Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:18.067476 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b98c0384-3286-4687-ab45-85fb05456ad9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action" status: 404 len: 111 microversion: 2.1 time: 0.109218 Jul 30 21:17:18.081884 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2026/4120] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:17 2022] POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:18.085385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:18.086196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:18.086196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:18.091960 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec864ed6-0b46-4d78-9f4f-c0491e7b1428 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.713787 Jul 30 21:17:18.105083 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2095/4121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:17 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:18.139855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.140339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.144397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.145137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.641284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:18.653497 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cbfa6449-95ad-408d-8480-45aa1724d5fd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.572842 Jul 30 21:17:18.657158 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2027/4122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:18 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:18.679135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:18.680039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:18.696184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.699123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.700621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.703698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.778461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4947dda1-dd72-4e35-8569-18d8d9b66626 req-cd2f881a-ae71-4f9c-9689-c6ff8788ba5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9aee76-9e0a-44e6-b39b-d2215a57497d", "tag": "2c3f7e84-2a54-40dd-9b8b-88544d1757dd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:18.822351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4947dda1-dd72-4e35-8569-18d8d9b66626 req-cd2f881a-ae71-4f9c-9689-c6ff8788ba5d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:18.822885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4947dda1-dd72-4e35-8569-18d8d9b66626 req-cd2f881a-ae71-4f9c-9689-c6ff8788ba5d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:18.848453 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4947dda1-dd72-4e35-8569-18d8d9b66626 req-cd2f881a-ae71-4f9c-9689-c6ff8788ba5d service nova] Creating event network-changed:2c3f7e84-2a54-40dd-9b8b-88544d1757dd for instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d on nch1-master-1 Jul 30 21:17:18.863802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4947dda1-dd72-4e35-8569-18d8d9b66626 req-cd2f881a-ae71-4f9c-9689-c6ff8788ba5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089787 Jul 30 21:17:18.864870 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2028/4123] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:18.987231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:18.989926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:19.007917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.008723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.011135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.020371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.390867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:19.399801 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3293058-b7a2-4b6e-8528-6dcddacf941e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.725186 Jul 30 21:17:19.402319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2096/4124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:18 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:19.407465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:19.408673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:19.430249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.433546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.434608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.436527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.527534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:19.558934 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4293415e-5c6e-4343-be63-f11b3a47320e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.576813 Jul 30 21:17:19.566037 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2029/4125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:18 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:19.571575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:19.591365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 5948afb4-3256-40e8-bea4-ec6c688c7b2d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/5948afb4-3256-40e8-bea4-ec6c688c7b2d/action HTTP/1.1 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 28 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: {"reboot": {"type": "SOFT"}} Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '5948afb4-3256-40e8-bea4-ec6c688c7b2d', 'body': {'reboot': {'type': 'SOFT'}}} Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:19.621685 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 5948afb4-3256-40e8-bea4-ec6c688c7b2d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49ebaaf1-5e5f-420b-90f4-e352c0fcf3e6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/5948afb4-3256-40e8-bea4-ec6c688c7b2d/action" status: 404 len: 111 microversion: 2.1 time: 0.053654 Jul 30 21:17:19.627885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2030/4126] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:19 2022] POST /compute/v2.1/servers/5948afb4-3256-40e8-bea4-ec6c688c7b2d/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:19.634463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:19.635119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:19.661576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.662241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.665692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:19.666205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:19.680560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:20.218637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:20.226582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d902f552-0ed1-429b-b432-141354bb26e2 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.822793 Jul 30 21:17:20.245252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2097/4127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:19 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:20.543389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:20.576585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-870765d7-9ecc-4347-a54f-01ba50c42c27 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.947548 Jul 30 21:17:20.584400 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2031/4128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:19 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:20.589524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:20.590978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:20.605965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:20.607146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:20.609820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:20.611385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:20.617355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:20.619039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:20.639149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:20.641815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:20.642736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:20.646421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:20.971964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:20.986501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51c12a69-8ed0-49d3-aa3e-b691955bf7ff tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.380971 Jul 30 21:17:20.987692 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2032/4129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:20 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:21.003182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-748981695", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c71de298-808c-446c-9bdf-2400c76e826f"}, {"port": "a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f", "tag": "port-1"}, {"port": "6dc0f246-08ce-4e10-9c66-6bc474965f2f", "tag": "port-2"}, {"uuid": "74fa3432-b50f-4ef9-9131-7be2e23f4947", "tag": "net-1"}, {"uuid": "74fa3432-b50f-4ef9-9131-7be2e23f4947"}, {"uuid": "eb30b639-8ea3-4019-a63a-a92b900aa50b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "eb30b639-8ea3-4019-a63a-a92b900aa50b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1a378643-26a9-4022-b012-defa76e4082f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0e3e52bb-c8b5-4e24-ada0-08f0ff72f891", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "35b2a01c-5c18-4761-974d-a4089f62e4a3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--11946310"}], "key_name": "tempest-keypair-595636488", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:21.292674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] validate_networks() for [('c71de298-808c-446c-9bdf-2400c76e826f', None, None, None, None, None), (None, None, 'a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f', None, None, None), (None, None, '6dc0f246-08ce-4e10-9c66-6bc474965f2f', None, None, None), ('74fa3432-b50f-4ef9-9131-7be2e23f4947', None, None, None, None, None), ('74fa3432-b50f-4ef9-9131-7be2e23f4947', None, None, None, None, None), ('eb30b639-8ea3-4019-a63a-a92b900aa50b', '10.2.2.100', None, None, None, None), ('eb30b639-8ea3-4019-a63a-a92b900aa50b', '10.2.2.200', None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:17:21.669474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:21.680180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc57ef3b-9c3b-47fa-ab33-aecb1cded676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 1.096110 Jul 30 21:17:21.686235 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2098/4130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:20 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:21.705006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:21.733297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:21.779203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:21.785878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:21.789853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:21.792816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:21.847469 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action HTTP/1.1 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 65 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '481f91ad-cd2f-4aeb-b953-c2a19e6413fa', 'body': {'rebuild': {'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd'}}} Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 30 21:17:21.849024 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:21.857355 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1e42b303-5eaa-40bc-9a84-bba3fe78b79e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action" status: 404 len: 111 microversion: 2.1 time: 0.161981 Jul 30 21:17:21.869032 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2099/4131] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:21 2022] POST /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa/action => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:21.887493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:21.888566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:21.904591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:21.905745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:21.906856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:21.907784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:22.665858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:22.674653 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0f353f7e-d5df-41ea-92a7-3810278e915e tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.804357 Jul 30 21:17:22.695461 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2100/4132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:21 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:22.714882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:22.717793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:22.735875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:22.737251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:22.738446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:22.739303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:23.804409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:23.814667 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49cbd029-a8f4-49f8-ad41-005ff8e6d978 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 1.117710 Jul 30 21:17:23.817650 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2101/4133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:22 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:23.846377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0b27bc3c-29c3-4eac-91c0-65c316585c97 req-a5d09d31-8c4e-4124-98b1-cfb00cf39cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ceec6b-0c6f-4f95-a3ff-be99b7597c96", "tag": "ab1819c1-a10b-4b56-b1a7-8ea0926a2799"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:23.872143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0b27bc3c-29c3-4eac-91c0-65c316585c97 req-a5d09d31-8c4e-4124-98b1-cfb00cf39cb5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:23.872826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0b27bc3c-29c3-4eac-91c0-65c316585c97 req-a5d09d31-8c4e-4124-98b1-cfb00cf39cb5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:23.894113 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0b27bc3c-29c3-4eac-91c0-65c316585c97 req-a5d09d31-8c4e-4124-98b1-cfb00cf39cb5 service nova] Creating event network-changed:ab1819c1-a10b-4b56-b1a7-8ea0926a2799 for instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 on nch1-master-1 Jul 30 21:17:23.907283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0b27bc3c-29c3-4eac-91c0-65c316585c97 req-a5d09d31-8c4e-4124-98b1-cfb00cf39cb5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068224 Jul 30 21:17:23.908005 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2102/4134] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:23.945325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:23.946212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:23.962545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:23.966156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:23.967509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:23.970228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:24.594441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:24.600768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:24.605897 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27dd681f-bbbd-46d3-b653-d13d90d6a331 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.696617 Jul 30 21:17:24.606625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2103/4135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:23 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:24.617456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:24.618751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:24.629921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:24.630691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:24.633362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:24.634622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:24.639590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:24.640474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:25.135801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:25.146354 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-907daddd-506a-4b7e-94f8-abaac20cced0 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.537925 Jul 30 21:17:25.147857 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2104/4136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:24 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:25.156742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:25.157534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:25.165848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:25.166362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:25.167541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:25.167992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:25.168890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:25.205913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:17:25.207367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:17:25.208274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:17:25.208979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:17:25.209784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:17:25.231694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:25.232552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:25.233858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:25.235152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:25.261407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Getting quotas for project 8696e08b027f4d259759dff57403f900. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:25.268935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Getting quotas for user 7369e2a4c5b24e85b94816e6404b300f and project 8696e08b027f4d259759dff57403f900. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:25.460824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:17:25.463848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1a378643-26a9-4022-b012-defa76e4082f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0e3e52bb-c8b5-4e24-ada0-08f0ff72f891',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35b2a01c-5c18-4761-974d-a4089f62e4a3',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:25.954350 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 4.965127 Jul 30 21:17:25.955497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2033/4137] 10.222.0.17 () {62 vars in 1189 bytes} [Sat Jul 30 21:17:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 4967 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:17:25.960982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-199b755f-da99-4b98-8e8a-5f078a193b10 req-7a91fd6d-550b-4a13-aa98-f9c7e38421a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9aee76-9e0a-44e6-b39b-d2215a57497d", "name": "network-vif-plugged", "status": "completed", "tag": "2c3f7e84-2a54-40dd-9b8b-88544d1757dd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:25.973838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-199b755f-da99-4b98-8e8a-5f078a193b10 req-7a91fd6d-550b-4a13-aa98-f9c7e38421a3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:25.974450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-199b755f-da99-4b98-8e8a-5f078a193b10 req-7a91fd6d-550b-4a13-aa98-f9c7e38421a3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.001713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-199b755f-da99-4b98-8e8a-5f078a193b10 req-7a91fd6d-550b-4a13-aa98-f9c7e38421a3 service nova] Creating event network-vif-plugged:2c3f7e84-2a54-40dd-9b8b-88544d1757dd for instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d on nch1-master-1 Jul 30 21:17:26.018177 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-199b755f-da99-4b98-8e8a-5f078a193b10 req-7a91fd6d-550b-4a13-aa98-f9c7e38421a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061164 Jul 30 21:17:26.019766 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2034/4138] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:26.044744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:26.045503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.066784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.069094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.070659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.071163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.132088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.147438 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1656a470-a33f-4575-9895-edaa0323f051 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.998199 Jul 30 21:17:26.148365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2105/4139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:25 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:26.153367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:26.153996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.259611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.268506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.273815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.276381 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9913596f-4daa-4130-9344-5ce2f9e5ba89 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1284 microversion: 2.42 time: 0.126902 Jul 30 21:17:26.296379 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2106/4140] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:26 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:26.302666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b1fc1349-620d-42c3-b511-89222b7b1a54 req-be494f4a-1745-4bc1-bf8c-d3f9a9c9923b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a27d5c-d518-476d-be57-e24b191c17eb", "tag": "873c110a-0116-4229-958e-6712ce023b98"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:26.318153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b1fc1349-620d-42c3-b511-89222b7b1a54 req-be494f4a-1745-4bc1-bf8c-d3f9a9c9923b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.318867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b1fc1349-620d-42c3-b511-89222b7b1a54 req-be494f4a-1745-4bc1-bf8c-d3f9a9c9923b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.333512 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b1fc1349-620d-42c3-b511-89222b7b1a54 req-be494f4a-1745-4bc1-bf8c-d3f9a9c9923b service nova] Creating event network-changed:873c110a-0116-4229-958e-6712ce023b98 for instance 75a27d5c-d518-476d-be57-e24b191c17eb on nch2-master-1 Jul 30 21:17:26.340033 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b1fc1349-620d-42c3-b511-89222b7b1a54 req-be494f4a-1745-4bc1-bf8c-d3f9a9c9923b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042061 Jul 30 21:17:26.341048 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2107/4141] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:26.346804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:26.351401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.358959 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff/action HTTP/1.1 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 65 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff', 'body': {'rebuild': {'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd'}}} Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 30 21:17:26.361029 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. Jul 30 21:17:26.365706 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:26.370335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:26.371128 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3da4e76e-3732-4a8d-a8a3-d55aa23d64b7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff/action" status: 404 len: 111 microversion: 2.1 time: 0.028728 Jul 30 21:17:26.375002 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2108/4142] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:26 2022] POST /compute/v2.1/servers/96d1275f-783c-4ed1-8ce6-8aaa6b3f2bff/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:26.376449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:26.377065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.377539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.389842 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f8e3e419-69c5-4cf2-a010-101dc8660a20 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.366425 Jul 30 21:17:26.390444 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2035/4143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:26 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:26.394108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.394532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.395353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.395979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.407741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:26.408382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.423481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.423985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.424782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.425460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.669902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:26.678628 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04c34c5c-a457-4256-89ac-fb7f2547c647 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.280282 Jul 30 21:17:26.679849 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2036/4144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:26 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:26.701493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:26.702672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:26.714170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.715965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:26.717125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:26.717920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.016890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.033642 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46f0cdcc-e5e4-4bd9-9e6a-4e732a187d39 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.659594 Jul 30 21:17:27.035694 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2109/4145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:26 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:27.166846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.176409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f79f5ac9-3059-4e59-a31d-f509bb84b306 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.477981 Jul 30 21:17:27.183660 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2037/4146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:26 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:27.204390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:27.205156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 563799dd-bf68-4c99-8c31-225a4cb0056d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:27.217106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/563799dd-bf68-4c99-8c31-225a4cb0056d/action HTTP/1.1 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: {"restore": {}} Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '563799dd-bf68-4c99-8c31-225a4cb0056d', 'body': {'restore': {}}} Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:27.221540 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 563799dd-bf68-4c99-8c31-225a4cb0056d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bdb270f8-b65e-44d6-a705-830fc8bb55d3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/563799dd-bf68-4c99-8c31-225a4cb0056d/action" status: 404 len: 111 microversion: 2.1 time: 0.024322 Jul 30 21:17:27.230280 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2038/4147] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:27 2022] POST /compute/v2.1/servers/563799dd-bf68-4c99-8c31-225a4cb0056d/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:27.239804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:27.241963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:27.264859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.265350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.269132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.269640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.273267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1835060714", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "46246038-f618-432a-b948-e9cf352cc27d"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:27.278243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:27.432369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] validate_networks() for [('46246038-f618-432a-b948-e9cf352cc27d', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:17:27.599459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.632811 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8d7281c-31c9-4809-991e-75823a070a0c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.400802 Jul 30 21:17:27.637342 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2039/4148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:27 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:27.658200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:27.664653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:27.683182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.684545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.685930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.688975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.845921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.860659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.864535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:27.866350 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6a39566c-3baf-42cd-b30b-e9c0a4283018 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1518 microversion: 2.42 time: 0.227741 Jul 30 21:17:27.867621 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2040/4149] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:27 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:27.873027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:27.873950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:27.881900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.882951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:27.884101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:27.884813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:28.369939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:28.391560 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bffd415e-4132-4dcd-bacc-f02395792111 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.518623 Jul 30 21:17:28.394529 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2041/4150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:27 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:28.424859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:28.425517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:28.450679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:28.453453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:28.456087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:28.459928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:28.749893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:17:28.750917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:17:28.751645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:17:28.752351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:17:28.753206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:17:28.769515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:28.773875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:28.775380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:28.778038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:28.821687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Getting quotas for project 995094f55a1a4d51bba197347e510968. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:28.836647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Getting quotas for user 86e4e88cd2154fa09d15bffe4e644a8b and project 995094f55a1a4d51bba197347e510968. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:28.875789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Going to run 3 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:17:28.885069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:28.951469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=35719d6b-22ea-47e1-901b-2c54ccdecc14,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:29.032425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=0a92e2bb-f4df-417a-b035-188d02d773c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:29.069525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:29.084154 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-af93695e-31fc-44d4-a739-1c050e093b13 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.687335 Jul 30 21:17:29.101469 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2042/4151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:28 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:29.119210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:29.122673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:29.145884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.146787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.150981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.151776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.215315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1b820e67-a72f-4170-9270-8194a1393860 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163041 Jul 30 21:17:29.218175 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2110/4152] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:17:29.282580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:29.286334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:29.313743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.314793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.315743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.316492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.521790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:29.547666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:29.549199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:29.550386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4871b2e8-afcc-4eec-b079-8ac61cb26ede tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1592 microversion: 2.42 time: 0.330927 Jul 30 21:17:29.550946 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2111/4153] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:29 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1592 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:29.572164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:29.579190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:29.607851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.608325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.610237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.610237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.674026 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'restore' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 15 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: {"restore": {}} Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'restore' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'restore': {}}} Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state active. Cannot restore while the instance is in this state. Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:29.676093 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:29.681690 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:29.681690 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:29.681690 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:29.681690 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:29.681690 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:29.684430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'restore' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:29.685638 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa3020df-f6a5-4348-8557-48fae5be5b67 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 145 microversion: 2.1 time: 0.118923 Jul 30 21:17:29.690678 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2112/4154] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:29 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:17:29.697063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:29.705561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:29.706853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:17:29.736172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.737033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.738028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.741105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.782677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7b2ca59-b0df-4931-86a2-07438e2a8e65 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.090563 Jul 30 21:17:29.784493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2113/4155] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:17:29 2022] GET /compute/v2.1/servers => generated 1018 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:29.826757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:29.827479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:29.849648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.851555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:29.852524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:29.853003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.337679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:30.351479 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1770b65e-3b96-418d-8783-915f7bb6a3be tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 1.246282 Jul 30 21:17:30.364810 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2043/4156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:29 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:30.375811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:30.380088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:30.393012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:30.397739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.400625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:30.402513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:30.403194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.417108 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d58597f3-3706-4a5c-b565-d99d593429b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.630616 Jul 30 21:17:30.417884 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2114/4157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:29 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:30.457460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8efedb3d-3e4f-4720-a14d-bcfebfb1f43b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:30.466681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8efedb3d-3e4f-4720-a14d-bcfebfb1f43b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:30.620363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8efedb3d-3e4f-4720-a14d-bcfebfb1f43b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:30.631262 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8efedb3d-3e4f-4720-a14d-bcfebfb1f43b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1223 microversion: 2.1 time: 0.212154 Jul 30 21:17:30.634427 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2115/4158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:30 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1223 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:30.652737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-452c8ddb-405b-4de7-8c8e-f82b42790273 req-64ff3797-7c12-4330-8e87-f9c0b25ced0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ceec6b-0c6f-4f95-a3ff-be99b7597c96", "name": "network-vif-plugged", "status": "completed", "tag": "ab1819c1-a10b-4b56-b1a7-8ea0926a2799"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:30.671484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-452c8ddb-405b-4de7-8c8e-f82b42790273 req-64ff3797-7c12-4330-8e87-f9c0b25ced0b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:30.671945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-452c8ddb-405b-4de7-8c8e-f82b42790273 req-64ff3797-7c12-4330-8e87-f9c0b25ced0b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.710083 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-452c8ddb-405b-4de7-8c8e-f82b42790273 req-64ff3797-7c12-4330-8e87-f9c0b25ced0b service nova] Creating event network-vif-plugged:ab1819c1-a10b-4b56-b1a7-8ea0926a2799 for instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 on nch1-master-1 Jul 30 21:17:30.716355 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-452c8ddb-405b-4de7-8c8e-f82b42790273 req-64ff3797-7c12-4330-8e87-f9c0b25ced0b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080583 Jul 30 21:17:30.718395 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2116/4159] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:30.729054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:30.730834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:30.747002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:30.748775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.750058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:30.750874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:30.947813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:30.963176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa49ddb2-ab96-483d-8de3-1ceb3edf3e81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.591492 Jul 30 21:17:30.963986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2044/4160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:30 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:30.992099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:31.001240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:31.027710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.029836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.033395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.034130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.093366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:31.118432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:31.124702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:31.133128 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d09891b-f3a1-4d07-b43c-d5ec17484d79 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1592 microversion: 2.42 time: 0.409374 Jul 30 21:17:31.133994 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2117/4161] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:30 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1592 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:31.368834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:31.384644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c34460e4-4941-49d2-b4a1-1a3eaea68a30 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.398170 Jul 30 21:17:31.394589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:31.395654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:31.407151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2045/4162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:30 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:31.426260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.427345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.428773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.429590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.440144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:31.440767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: d06e68ee-7602-4d86-9b47-e51f036d2dc4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:31.454287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/d06e68ee-7602-4d86-9b47-e51f036d2dc4/action HTTP/1.1 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 14 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: {"resume": {}} Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd06e68ee-7602-4d86-9b47-e51f036d2dc4', 'body': {'resume': {}}} Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:31.471068 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance d06e68ee-7602-4d86-9b47-e51f036d2dc4 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1187211b-4629-4b06-8362-9d73dacf504c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/d06e68ee-7602-4d86-9b47-e51f036d2dc4/action" status: 404 len: 111 microversion: 2.1 time: 0.045880 Jul 30 21:17:31.476261 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2046/4163] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:31 2022] POST /compute/v2.1/servers/d06e68ee-7602-4d86-9b47-e51f036d2dc4/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:17:31.482175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:31.485666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:31.530603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.532074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.532197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.532564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.724964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:31.750930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05ae78f9-ef7e-4a68-b662-93d442340ab8 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1317 microversion: 2.1 time: 0.355968 Jul 30 21:17:31.753580 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2118/4164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:31 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:31.764240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:31.765537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:31.780393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.781069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:31.782237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:31.783018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.035940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.054968 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d91609dc-44ca-4228-83cf-66b6807a3c54 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.295242 Jul 30 21:17:32.056512 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2119/4165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:31 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:32.065636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:32.066540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.081880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.083719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.084854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.085466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.200637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.212374 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72ae0f5e-1772-41c8-bc95-f82b1e1b013b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1227 microversion: 2.1 time: 0.151944 Jul 30 21:17:32.213594 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2120/4166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:32 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:32.222561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:32.223422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.231015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.231879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.232915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.233513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.259584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.270623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2d82f82-a54e-4683-8f6e-67003e9722e1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.795832 Jul 30 21:17:32.278420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2047/4167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:31 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:32.295956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:32.308237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.325419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.327913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.328920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.338405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.528649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.540617 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-803e2615-44ab-403f-91da-7f581f6f7017 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.324719 Jul 30 21:17:32.555823 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2121/4168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:32 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:32.585547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:32.598716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.634041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.657513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.661224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.663769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.763901 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'resume' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 14 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: {"resume": {}} Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'resume' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'resume': {}}} Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state active. Cannot resume while the instance is in this state. Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:32.765934 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'resume' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8433dc7-9940-47e9-a65b-29930b59992b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 144 microversion: 2.1 time: 0.201547 Jul 30 21:17:32.776873 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2122/4169] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:32 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 144 bytes in 204 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:17:32.779798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:32.780613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.802517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.803761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.807079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.809144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.824260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.841337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.844130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:32.851054 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e5887b3-c50e-4a51-ab15-7433c26d3df4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1658 microversion: 2.42 time: 0.569748 Jul 30 21:17:32.853348 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2048/4170] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:32 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1658 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:32.867509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:32.867509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:32.885665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.886351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:32.887406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:32.888048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.309598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:33.321465 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b682aba-1067-49de-8ce5-05da853563aa tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 200 len: 1504 microversion: 2.1 time: 0.547138 Jul 30 21:17:33.324767 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2123/4171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:32 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:33.340101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-320b1e31-0e31-4f68-9733-d959eea0bb11 req-4ac38338-73b5-47f4-80f4-cf42e3e84ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a27d5c-d518-476d-be57-e24b191c17eb", "name": "network-vif-plugged", "status": "completed", "tag": "873c110a-0116-4229-958e-6712ce023b98"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:33.380266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-320b1e31-0e31-4f68-9733-d959eea0bb11 req-4ac38338-73b5-47f4-80f4-cf42e3e84ae0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.382374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-320b1e31-0e31-4f68-9733-d959eea0bb11 req-4ac38338-73b5-47f4-80f4-cf42e3e84ae0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.414364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-320b1e31-0e31-4f68-9733-d959eea0bb11 req-4ac38338-73b5-47f4-80f4-cf42e3e84ae0 service nova] Creating event network-vif-plugged:873c110a-0116-4229-958e-6712ce023b98 for instance 75a27d5c-d518-476d-be57-e24b191c17eb on nch2-master-1 Jul 30 21:17:33.427864 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-320b1e31-0e31-4f68-9733-d959eea0bb11 req-4ac38338-73b5-47f4-80f4-cf42e3e84ae0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099994 Jul 30 21:17:33.430124 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2124/4172] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:33.446335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:33.451027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:33.466577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.468441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.471686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.472894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.535892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:33.556510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d202536-9924-4bb5-8b63-f433bdcd422d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.701396 Jul 30 21:17:33.560447 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2049/4173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:32 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:33.576865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:33.577817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:33.592469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.593715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.594779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.595741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.901415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:33.918145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7a953009-996d-4d18-8068-8d4a7bfc12b6 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1283 microversion: 2.1 time: 0.480928 Jul 30 21:17:33.938943 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2125/4174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:33 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1283 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:33.957040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:33.958937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:33.961133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=88 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:33.975984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.976386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:33.977294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:33.980189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.012597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.022498 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9890f4ff-4212-4ee2-a81b-e1f0c3a9c726 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1309 microversion: 2.1 time: 0.460622 Jul 30 21:17:34.023106 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2050/4175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:33 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1309 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:34.031749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:34.031749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:34.036047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.038704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.038704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.038704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.312394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.322284 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-737adf70-f112-4a61-aadc-5fa052ab0704 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.298065 Jul 30 21:17:34.324831 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2051/4176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:34 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:34.330327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:34.330961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:34.345374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.346441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.347474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.348089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.635067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.648166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.666282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.668939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:34.672866 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1600e199-cf4a-4545-bfad-08aa6e67a00d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1658 microversion: 2.42 time: 0.346265 Jul 30 21:17:34.673878 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37b1f5f1-cf63-477b-8f6a-85e6c9600c59 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 200 len: 1503 microversion: 2.1 time: 0.732766 Jul 30 21:17:34.677619 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2052/4177] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:34 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1658 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:34.687876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a44f78d4-dd01-4ab7-b878-9cbcec3e4b8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:34.692170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2126/4178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:33 2022] GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 1503 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a44f78d4-dd01-4ab7-b878-9cbcec3e4b8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 160 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2e0fd2fc-6829-4cec-b5ca-c934eab0b307"}]}} Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'body': {'server': {'name': '', 'imageRef': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'flavorRef': '452', 'networks': [{'uuid': '2e0fd2fc-6829-4cec-b5ca-c934eab0b307'}]}}} Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '' Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:17:34.698815 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:17:34.704608 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:34.706033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:34.706033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:34.707582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a44f78d4-dd01-4ab7-b878-9cbcec3e4b8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:34.710863 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a44f78d4-dd01-4ab7-b878-9cbcec3e4b8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.032053 Jul 30 21:17:34.712147 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2053/4179] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:34 2022] POST /compute/v2.1/servers => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:17:34.722435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:34.724497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.725177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:34.726455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.728974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.729453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.740920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.742109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.747523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:34.749237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:34.784934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:34.791500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:35.074817 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c98a88b2-09d1-4110-87dd-396701b56332 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 204 len: 0 microversion: 2.1 time: 0.377137 Jul 30 21:17:35.078584 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2127/4180] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:34 2022] DELETE /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:35.087656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:35.100619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:35.113734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.114348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.115272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.116169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.247408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:35.279430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:35.327080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:35.341477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-97a065ba-5476-4d12-b903-15d69f42d83f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.624404 Jul 30 21:17:35.342571 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2054/4181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:34 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:35.361359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:35.362556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:35.380166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.380644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.381457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.381908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.736148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:35.750048 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9b37bb6-fd56-41bc-a866-effe2fedfc01 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1489 microversion: 2.1 time: 0.405794 Jul 30 21:17:35.754311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2055/4182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:35 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1489 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:35.768637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:35.769276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:35.787097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.788765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.790922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:35.791579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:35.856740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:35.953926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:35.962065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:35.988957 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c578739e-34f4-4363-92d2-d25088192831 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1281 microversion: 2.1 time: 0.906055 Jul 30 21:17:35.998645 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2128/4183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:35 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1281 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:36.031355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:36.031355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:36.051790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.053096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:36.054107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.054726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:36.137879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:36.156772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f94ec57e-c872-4ffd-939a-0ebdf82482e9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 204 len: 0 microversion: 2.1 time: 0.401040 Jul 30 21:17:36.170891 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2056/4184] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:35 2022] DELETE /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:36.186189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:36.187011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:36.207583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.209376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:36.213766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.215758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:36.377165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:36.392049 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-09700f7c-209c-4290-b816-68008b0b61ce tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.391531 Jul 30 21:17:36.407476 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2129/4185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:35 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:36.407476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1576281123", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:36.519326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:17:36.614149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:36.631647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:36.636740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:36.639342 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49441798-5f5c-4d21-a64f-c28dacbc1aa3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1736 microversion: 2.42 time: 0.466227 Jul 30 21:17:36.640640 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2057/4186] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:36 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1736 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:36.647873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:36.649607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:36.659051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.660662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:36.662124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:36.662878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.079560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:37.091870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7dd696bc-202a-4ce2-95fe-0415f4a0736a tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 200 len: 1509 microversion: 2.1 time: 0.446015 Jul 30 21:17:37.092709 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2058/4187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:36 2022] GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:37.111436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:37.112315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: c57e1834-c2b9-4115-a9b0-960e4f587630] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:37.119229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/c57e1834-c2b9-4115-a9b0-960e4f587630/action HTTP/1.1 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 14 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: {"shelve": {}} Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c57e1834-c2b9-4115-a9b0-960e4f587630', 'body': {'shelve': {}}} Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:37.128659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:37.132423 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:37.132423 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:37.132423 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. Jul 30 21:17:37.132423 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:37.133997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance c57e1834-c2b9-4115-a9b0-960e4f587630 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:37.135380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1165cf08-4dfb-4eb2-8a91-678e6f894594 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/c57e1834-c2b9-4115-a9b0-960e4f587630/action" status: 404 len: 111 microversion: 2.1 time: 0.041310 Jul 30 21:17:37.136347 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2059/4188] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:37 2022] POST /compute/v2.1/servers/c57e1834-c2b9-4115-a9b0-960e4f587630/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:37.142427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:37.148481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:37.162392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.162858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.172495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.173060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.283994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:37.293238 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6659b47c-8166-4c16-b1d7-ecf9f9ea0d9f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1281 microversion: 2.1 time: 0.155727 Jul 30 21:17:37.293835 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2060/4189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:37 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:37.312164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:37.312799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:37.336006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.336652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.337501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.338020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.829355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:37.846177 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3eff432c-7ea1-4dc8-8e46-6b2674811dcc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.537627 Jul 30 21:17:37.849127 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2061/4190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:37 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:37.868851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:17:37.869371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:17:37.869766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:17:37.870191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:17:37.870620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:17:37.870781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:37.871601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:37.888156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.891097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.892229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.893667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.894258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.895135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:37.895596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.895897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:37.948751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:17:37.961647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:17:37.997328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:17:38.000280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:17:38.080036 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-104a1fff-d674-4430-a26a-35cbe773144e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681329 Jul 30 21:17:38.085518 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2130/4191] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:17:38.096609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:38.098588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:38.119827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.120301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.121091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.122139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.303193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.313683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.316988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.319109 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5843747a-0705-43cd-9e21-e7e2e97d6592 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1736 microversion: 2.42 time: 0.466645 Jul 30 21:17:38.344448 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2062/4192] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:37 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1736 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:38.352568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-382224d0-2fbb-4fd9-855a-58bbe96de0df tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:38.353994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-382224d0-2fbb-4fd9-855a-58bbe96de0df tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:38.584135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-382224d0-2fbb-4fd9-855a-58bbe96de0df tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.592235 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-382224d0-2fbb-4fd9-855a-58bbe96de0df tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1209 microversion: 2.1 time: 0.244713 Jul 30 21:17:38.608754 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2063/4193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:38 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:38.614455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:38.615428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:38.634435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.635751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.636773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.637414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.795719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.811998 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86f0bef7-8f96-41dc-8079-c833ed033073 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.719410 Jul 30 21:17:38.812870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2131/4194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:38 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:38.818676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:38.819913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:38.836846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.839279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.840392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:38.841851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:38.952466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:38.981958 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47d510f3-6ebe-4d64-9c2e-3bee40a639fd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 200 len: 1467 microversion: 2.1 time: 0.368860 Jul 30 21:17:38.985061 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2064/4195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:38 2022] GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:39.005542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6b1567c0-834e-4a0f-8aa3-0aca915454b0 req-3e21b830-a499-4c8e-a584-c65d0faa5261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ceec6b-0c6f-4f95-a3ff-be99b7597c96", "name": "network-vif-deleted", "tag": "ab1819c1-a10b-4b56-b1a7-8ea0926a2799"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:39.045003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6b1567c0-834e-4a0f-8aa3-0aca915454b0 req-3e21b830-a499-4c8e-a584-c65d0faa5261 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.045369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6b1567c0-834e-4a0f-8aa3-0aca915454b0 req-3e21b830-a499-4c8e-a584-c65d0faa5261 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.058566 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6b1567c0-834e-4a0f-8aa3-0aca915454b0 req-3e21b830-a499-4c8e-a584-c65d0faa5261 service nova] Creating event network-vif-deleted:ab1819c1-a10b-4b56-b1a7-8ea0926a2799 for instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 on nch1-master-1 Jul 30 21:17:39.069452 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6b1567c0-834e-4a0f-8aa3-0aca915454b0 req-3e21b830-a499-4c8e-a584-c65d0faa5261 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077097 Jul 30 21:17:39.070972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2065/4196] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:39.076842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:39.077715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:39.087364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.088080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.089027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.089618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.127695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lazy-loading 'flavor' on Instance uuid e0e21266-f697-4bd9-be1f-25ea0305e00c {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:17:39.533439 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d40caf8-6b94-40e8-871b-f45485557249 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.460775 Jul 30 21:17:39.534095 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2066/4197] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:17:39 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:17:39.545380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:39.550239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:39.568718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.571167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.572188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.574311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.658726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:39.674193 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-782aa23c-3477-4242-be9b-9f2ced67914f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1281 microversion: 2.1 time: 0.860048 Jul 30 21:17:39.674835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2132/4198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:38 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1281 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:39.699460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-196e6881-e8e8-4ed1-a646-80fbd37ee155 req-71a266ab-adde-4229-838a-b468fefbb1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9aee76-9e0a-44e6-b39b-d2215a57497d", "name": "network-vif-deleted", "tag": "2c3f7e84-2a54-40dd-9b8b-88544d1757dd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:39.715270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-196e6881-e8e8-4ed1-a646-80fbd37ee155 req-71a266ab-adde-4229-838a-b468fefbb1a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.716227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-196e6881-e8e8-4ed1-a646-80fbd37ee155 req-71a266ab-adde-4229-838a-b468fefbb1a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.759017 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-196e6881-e8e8-4ed1-a646-80fbd37ee155 req-71a266ab-adde-4229-838a-b468fefbb1a5 service nova] Creating event network-vif-deleted:2c3f7e84-2a54-40dd-9b8b-88544d1757dd for instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d on nch1-master-1 Jul 30 21:17:39.770836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-196e6881-e8e8-4ed1-a646-80fbd37ee155 req-71a266ab-adde-4229-838a-b468fefbb1a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079270 Jul 30 21:17:39.777615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2133/4199] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:39.793432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:39.795008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:39.822524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.823431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.824343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.826078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.910715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:39.923264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:39.925089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:39.926386 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d5b9ee2c-cf4f-424f-9a20-b564e62973c7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1781 microversion: 2.42 time: 0.390480 Jul 30 21:17:39.927401 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2067/4200] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:39 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1781 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:39.933676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:39.934330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:39.947757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.948269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:39.949122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:39.949590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.059138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:40.070834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2e37af96-903f-4665-9ed1-3335666138d1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1269 microversion: 2.1 time: 0.142066 Jul 30 21:17:40.071604 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2068/4201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:39 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:40.076990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:40.077623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:40.084069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.084537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.085333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.085787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.130443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.131141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.131649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lazy-loading 'fault' on Instance uuid 3c9aee76-9e0a-44e6-b39b-d2215a57497d {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:17:40.339114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6545058c3d465992b5761677dc5261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a8a347af0e497dbd65c1b79f4cde22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:40.360485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8a318c3-7a11-4c80-a520-b838b8b49dfb tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 200 len: 1307 microversion: 2.1 time: 0.287461 Jul 30 21:17:40.362312 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2069/4202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:40 2022] GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:40.467733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:40.480204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a361e85d-b107-4e39-b9bf-62d07a19db14 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.701017 Jul 30 21:17:40.481019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2134/4203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:39 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:40.696411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:40.697175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:40.710119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.710775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.713641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.715331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.957130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:40.959661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:40.974985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.976201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:40.977748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:40.978573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.272779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:41.297215 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6525275b-ce2f-4821-845f-b98632bf2636 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.604954 Jul 30 21:17:41.298414 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2070/4204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:40 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:41.310913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:41.311718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:41.318830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.319575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.321275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.323522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.451641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:41.494029 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-59c14e48-2b52-4fae-aecb-3c2c42bbddd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1267 microversion: 2.1 time: 0.190807 Jul 30 21:17:41.495519 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2071/4205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:41 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:41.505297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:41.506534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 3c9aee76-9e0a-44e6-b39b-d2215a57497d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:41.517019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.517840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.519531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.520209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.540451 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] HTTP exception thrown: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Request method failure captured: Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d HTTP/1.1 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-24Ldq8Jhew1UNXZLjSMCdV6RNz8Hn-F9by8NwqbnqH0hgNovc-LOSj4ekXkuHPFyWf-x5F-KjNrykOsogfKpmWWc9n73dhR3xYyISxsgAsx_VC7SuuxMQGvrmmWnlHB5wJuYqW1rMNNN7-DtWDObuiD9Z4eZhKG7_Y-w5deWp8Bk Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 90a8a347af0e497dbd65c1b79f4cde22 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90a8a347af0e497dbd65c1b79f4cde22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "tempest-type-543585391", "name": "tempest-service-1848915140", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "tempest-type-1129187534", "name": "tempest-service-1754374416", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "tempest-type-58381257", "name": "tempest-service-34714840", "endpoints": []}] Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 90a8a347af0e497dbd65c1b79f4cde22 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-MultipleCreateTestJSON-614420397-project Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5f6545058c3d465992b5761677dc5261 Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-MultipleCreateTestJSON-614420397-project Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '3c9aee76-9e0a-44e6-b39b-d2215a57497d'} Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:41.542664 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. Jul 30 21:17:41.546421 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:41.548536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Returning 404 to user: Instance 3c9aee76-9e0a-44e6-b39b-d2215a57497d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:41.549716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-acde70d1-1023-44a7-be54-bd1cf86228b9 tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d" status: 404 len: 111 microversion: 2.1 time: 0.049930 Jul 30 21:17:41.554448 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2072/4206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:41 2022] GET /compute/v2.1/servers/3c9aee76-9e0a-44e6-b39b-d2215a57497d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:41.561298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:41.562263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:41.570419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.571183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.572297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:41.573051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:41.997120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:42.008784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:42.020970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d126d3a-82e7-4bb6-a003-72444302436d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.462802 Jul 30 21:17:42.024292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2073/4207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:41 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:42.032690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:42.033458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] [instance: 42ceec6b-0c6f-4f95-a3ff-be99b7597c96] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:42.044759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.045407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.046307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.047129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.050640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:42.066220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] HTTP exception thrown: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Request method failure captured: Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 HTTP/1.1 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-24Ldq8Jhew1UNXZLjSMCdV6RNz8Hn-F9by8NwqbnqH0hgNovc-LOSj4ekXkuHPFyWf-x5F-KjNrykOsogfKpmWWc9n73dhR3xYyISxsgAsx_VC7SuuxMQGvrmmWnlHB5wJuYqW1rMNNN7-DtWDObuiD9Z4eZhKG7_Y-w5deWp8Bk Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 90a8a347af0e497dbd65c1b79f4cde22 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90a8a347af0e497dbd65c1b79f4cde22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "tempest-type-543585391", "name": "tempest-service-1848915140", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90a8a347af0e497dbd65c1b79f4cde22"}]}, {"type": "tempest-type-1129187534", "name": "tempest-service-1754374416", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "tempest-type-58381257", "name": "tempest-service-34714840", "endpoints": []}] Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 90a8a347af0e497dbd65c1b79f4cde22 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-MultipleCreateTestJSON-614420397 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-MultipleCreateTestJSON-614420397-project Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5f6545058c3d465992b5761677dc5261 Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-MultipleCreateTestJSON-614420397-project Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '42ceec6b-0c6f-4f95-a3ff-be99b7597c96'} Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:17:42.068041 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] Returning 404 to user: Instance 42ceec6b-0c6f-4f95-a3ff-be99b7597c96 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:17:42.071108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1672a837-697a-4ee9-b2fb-7c2d862f13cd tempest-MultipleCreateTestJSON-614420397 tempest-MultipleCreateTestJSON-614420397-project] 10.222.0.17 "GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96" status: 404 len: 111 microversion: 2.1 time: 0.044278 Jul 30 21:17:42.074032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:42.074204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2074/4208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:42 2022] GET /compute/v2.1/servers/42ceec6b-0c6f-4f95-a3ff-be99b7597c96 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:17:42.074323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:42.074323 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-341f7bef-e882-4574-ad10-3ddf652b6625 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1826 microversion: 2.42 time: 1.125390 Jul 30 21:17:42.074323 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2135/4209] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:40 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1826 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:42.080380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bd3c63c7-55be-4d8a-b2fc-796a6e159027 req-8a338da9-4be4-4d91-a410-da969c528a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35719d6b-22ea-47e1-901b-2c54ccdecc14", "tag": "adf5a405-5742-4d9f-aab8-367ac8c8371c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:42.093633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd3c63c7-55be-4d8a-b2fc-796a6e159027 req-8a338da9-4be4-4d91-a410-da969c528a35 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.094431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd3c63c7-55be-4d8a-b2fc-796a6e159027 req-8a338da9-4be4-4d91-a410-da969c528a35 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.108544 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bd3c63c7-55be-4d8a-b2fc-796a6e159027 req-8a338da9-4be4-4d91-a410-da969c528a35 service nova] Creating event network-changed:adf5a405-5742-4d9f-aab8-367ac8c8371c for instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 on nch2-master-1 Jul 30 21:17:42.115333 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bd3c63c7-55be-4d8a-b2fc-796a6e159027 req-8a338da9-4be4-4d91-a410-da969c528a35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 Jul 30 21:17:42.116557 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2075/4210] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:42.323106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:42.323775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:42.336856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.337332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.339369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.340647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.537245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:42.538736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:42.587534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.589308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.590509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:42.591262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:42.998697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:43.016930 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-200812e5-0101-4501-bf6f-a4b7ee872b3d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.503832 Jul 30 21:17:43.019152 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2076/4211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:42 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:43.049311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:43.051207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:43.071199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:43.073730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:43.078468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:43.082959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:43.273441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:43.291582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc791f87-7d26-4fbc-93f9-ca46b7055d53 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.967721 Jul 30 21:17:43.294769 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2136/4212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:42 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:43.316260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:43.316920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:43.339115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:43.343943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:43.344919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:43.345390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:43.766189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:43.778741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68870560-4fdd-4240-894e-06e86737d01a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.735413 Jul 30 21:17:43.780253 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2077/4213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:43 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:43.786514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-00fd0ca3-4f5d-4cd3-8831-89bdecf85d3b req-d2a0793f-304c-4242-ae0e-701ff5519caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "ebb280be-9aa4-4c83-8b08-5bb73d1e6a07"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:43.799193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-00fd0ca3-4f5d-4cd3-8831-89bdecf85d3b req-d2a0793f-304c-4242-ae0e-701ff5519caa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:43.799776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-00fd0ca3-4f5d-4cd3-8831-89bdecf85d3b req-d2a0793f-304c-4242-ae0e-701ff5519caa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:43.892693 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-00fd0ca3-4f5d-4cd3-8831-89bdecf85d3b req-d2a0793f-304c-4242-ae0e-701ff5519caa service nova] Creating event network-changed:ebb280be-9aa4-4c83-8b08-5bb73d1e6a07 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:43.908599 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-00fd0ca3-4f5d-4cd3-8831-89bdecf85d3b req-d2a0793f-304c-4242-ae0e-701ff5519caa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126680 Jul 30 21:17:43.911323 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2078/4214] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:44.032348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:44.042736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:44.043500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:44.057328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:44.059167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.059804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.060956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.061080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.065101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:44.066554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d615aefe-1c92-452b-b708-944e9ed251b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1826 microversion: 2.42 time: 0.765740 Jul 30 21:17:44.067380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2137/4215] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:43 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1826 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:44.178858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a92e2bb-f4df-417a-b035-188d02d773c4", "tag": "b13a039e-0d0b-48d2-ab55-4c79c8475524"}, {"name": "network-changed", "server_uuid": "f808bb9e-14d6-46b2-9bbf-97f88f4eebbf", "tag": "2f4631cd-75c1-4e31-a15b-b26adb8b374d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:44.210864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.212131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.239506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] Creating event network-changed:b13a039e-0d0b-48d2-ab55-4c79c8475524 for instance 0a92e2bb-f4df-417a-b035-188d02d773c4 on nch1-master-1 Jul 30 21:17:44.240466 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] Creating event network-changed:2f4631cd-75c1-4e31-a15b-b26adb8b374d for instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf on nch2-master-1 Jul 30 21:17:44.268537 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-32734078-c322-45aa-beb7-ad531eb9ff7e req-423438a0-7887-4083-8f86-6d2b1c86081f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094284 Jul 30 21:17:44.271071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2138/4216] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:17:44.318911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:44.320539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:44.330709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.332937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.333956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.339176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.601467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:44.612732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-308b6e5e-e920-426b-9f10-86aa7a59563f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.576162 Jul 30 21:17:44.613321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2079/4217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:44 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:44.740511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:44.749973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce3b25b0-ef65-4cd9-acb6-9c102fa9456a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.437366 Jul 30 21:17:44.751526 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2139/4218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:44 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:44.806796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:44.807501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:44.822507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.822977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:44.823804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:44.824515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:45.090460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:45.090870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:45.108784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:45.109372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:45.110155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:45.110610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:45.299062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:45.309912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70269275-c1ce-478c-bb9f-56c3ac01219d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.506975 Jul 30 21:17:45.313310 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2080/4219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:44 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:45.636746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:45.637682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:45.649864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:45.651117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:45.652713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:45.653424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.224872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:46.245763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:46.248044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:46.255481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:46.257276 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-562f567b-4098-4552-adf0-4ca13eeb2003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1847 microversion: 2.42 time: 1.168420 Jul 30 21:17:46.259771 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2140/4220] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:45 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1847 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:17:46.279680 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d6d15e56-c57c-4254-872d-ad52a45667c7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.641182 Jul 30 21:17:46.282223 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2081/4221] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:45 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:46.288259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:46.292233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:46.300883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf83c78-a95b-43c5-b133-8197374c3c71", "tag": "c26ee60d-b568-41c4-acf9-190d6587fed2"}, {"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:46.313564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:46.315909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.318641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:46.321794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.324869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:46.325636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.358127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] Creating event network-changed:c26ee60d-b568-41c4-acf9-190d6587fed2 for instance 2cf83c78-a95b-43c5-b133-8197374c3c71 on nch1-master-1 Jul 30 21:17:46.359611 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] Creating event network-changed:a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:46.386351 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-597a5f60-5463-4596-b8b5-da6b2d15b8bf req-bf76207c-b488-42dd-b82d-1be21d266507 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097986 Jul 30 21:17:46.388434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2082/4222] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:46.395814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:46.397319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:46.408699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:46.410977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.412909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:46.413559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:46.979728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:46.988123 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0adf714-ccf4-40bc-b82c-6b30af128f1b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.724452 Jul 30 21:17:47.002481 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2141/4223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:46 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:47.221548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:47.233955 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-96b6d94c-91d9-494b-9d8a-255cc3142ccd tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.844116 Jul 30 21:17:47.234897 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2083/4224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:46 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:47.282699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:47.284130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:47.291570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:47.292396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:47.293443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:47.294248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:47.307051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:47.309196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:47.325614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:47.326563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:47.336910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:47.337787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:47.698361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:47.708761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05114d28-b8fc-4392-91fc-79e3a67ab33a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.409854 Jul 30 21:17:47.720839 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2084/4225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:47 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:47.792413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:47.809992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:47.811581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:47.826319 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-815bab69-9e6f-4ec8-95fd-9bd0f4739791 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.546428 Jul 30 21:17:47.827741 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2142/4226] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:47 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:48.011083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:48.011921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:48.026716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.029218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.030363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.031830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.253596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:48.255838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:48.256768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:48.259015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:48.259834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:48.264539 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0521daa-f369-4a4a-8403-f9e99c2c7b37 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.257595 Jul 30 21:17:48.273239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.275062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.280286 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2085/4227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:48 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:48.285057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.285593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.422563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-90af3c65-8795-45bd-81cb-3609adb48a6a req-fce74649-3d19-42bc-a351-6ff2b6ad5707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "6dc0f246-08ce-4e10-9c66-6bc474965f2f"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:48.440180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90af3c65-8795-45bd-81cb-3609adb48a6a req-fce74649-3d19-42bc-a351-6ff2b6ad5707 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.440860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90af3c65-8795-45bd-81cb-3609adb48a6a req-fce74649-3d19-42bc-a351-6ff2b6ad5707 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.458349 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-90af3c65-8795-45bd-81cb-3609adb48a6a req-fce74649-3d19-42bc-a351-6ff2b6ad5707 service nova] Creating event network-changed:6dc0f246-08ce-4e10-9c66-6bc474965f2f for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:48.466089 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-90af3c65-8795-45bd-81cb-3609adb48a6a req-fce74649-3d19-42bc-a351-6ff2b6ad5707 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057765 Jul 30 21:17:48.467647 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2086/4228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:17:48.740897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:48.742755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:48.746020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:48.758964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.759939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:48.761738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:48.762397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.089711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:49.103582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bf110f0-b49a-4bda-982d-1e5a7e5f19ce tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.372767 Jul 30 21:17:49.121132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2087/4229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:48 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:49.126538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:49.127436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:49.134337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:49.135026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.136070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:49.136670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.215276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:49.224093 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21d0cc30-45bb-45bd-9b51-94153f36ab37 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.972574 Jul 30 21:17:49.235301 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2143/4230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:48 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:49.286600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:49.288116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:49.297340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:49.300854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.301923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:49.305373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.389121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:49.400091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:49.402799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:49.404348 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f818f883-1277-4341-b38b-c39251384ceb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.281747 Jul 30 21:17:49.405223 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2088/4231] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:49 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:49.518001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d1ee6470-26aa-4fe8-b341-95df379795d7 req-1019c097-140c-4ef8-947b-eb38155244f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35719d6b-22ea-47e1-901b-2c54ccdecc14", "name": "network-vif-plugged", "status": "completed", "tag": "adf5a405-5742-4d9f-aab8-367ac8c8371c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:49.546566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d1ee6470-26aa-4fe8-b341-95df379795d7 req-1019c097-140c-4ef8-947b-eb38155244f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:49.547233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d1ee6470-26aa-4fe8-b341-95df379795d7 req-1019c097-140c-4ef8-947b-eb38155244f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:49.595433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d1ee6470-26aa-4fe8-b341-95df379795d7 req-1019c097-140c-4ef8-947b-eb38155244f8 service nova] Creating event network-vif-plugged:adf5a405-5742-4d9f-aab8-367ac8c8371c for instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 on nch2-master-1 Jul 30 21:17:49.601050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d1ee6470-26aa-4fe8-b341-95df379795d7 req-1019c097-140c-4ef8-947b-eb38155244f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088575 Jul 30 21:17:49.602759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2089/4232] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:50.131476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:50.132365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:50.140689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.146650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.147653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.148117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.300596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:50.314157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:50.326380 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abf7b45f-28e1-48b3-8021-cebcd44ad62f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 1.042012 Jul 30 21:17:50.344245 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2144/4233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:49 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:50.360456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:50.362549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:50.387245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.390514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.395376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.401580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.511543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:50.525907 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b68d2f9f-5a9b-48b1-9559-474b0a0be676 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.397288 Jul 30 21:17:50.527682 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2090/4234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:50 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:50.538934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:50.545693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:50.569667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.572653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.574377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:50.576565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:50.845154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:50.858092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:50.861022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:50.862811 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b1041eb-7ae6-4bb6-9ab2-e3a22c957914 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.327839 Jul 30 21:17:50.876831 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2091/4235] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:50 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:50.998474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:51.007399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77843205-ed9c-4e84-85db-53f342853552 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.660829 Jul 30 21:17:51.008974 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2145/4236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:50 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:51.302693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-cce5718c-9d31-4882-9d86-7fc9dc32811a req-3e2b8707-fbf6-4579-a1f2-e86de56e0cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "51517a60-c982-4096-a107-b749686187d7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:51.329096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cce5718c-9d31-4882-9d86-7fc9dc32811a req-3e2b8707-fbf6-4579-a1f2-e86de56e0cad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:51.329716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-cce5718c-9d31-4882-9d86-7fc9dc32811a req-3e2b8707-fbf6-4579-a1f2-e86de56e0cad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:51.349902 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-cce5718c-9d31-4882-9d86-7fc9dc32811a req-3e2b8707-fbf6-4579-a1f2-e86de56e0cad service nova] Creating event network-changed:51517a60-c982-4096-a107-b749686187d7 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:51.357196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:51.357732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-cce5718c-9d31-4882-9d86-7fc9dc32811a req-3e2b8707-fbf6-4579-a1f2-e86de56e0cad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059613 Jul 30 21:17:51.358841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:51.360056 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2092/4237] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:51.366549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:51.367100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:51.368418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:51.368879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:51.553899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:51.556482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:51.594105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:51.597154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:51.603100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:51.603905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.075094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.084772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a57587a5-c03f-4463-b951-b1925d4b2a22 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.536015 Jul 30 21:17:52.086738 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2093/4238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:51 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:52.097287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7166a9f8-cf7b-44dc-ae44-c2b044de1197 req-6495f000-3fd4-4b2c-ac70-43e0963b69c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a92e2bb-f4df-417a-b035-188d02d773c4", "name": "network-vif-plugged", "status": "completed", "tag": "b13a039e-0d0b-48d2-ab55-4c79c8475524"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:52.121437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7166a9f8-cf7b-44dc-ae44-c2b044de1197 req-6495f000-3fd4-4b2c-ac70-43e0963b69c1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:52.123179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7166a9f8-cf7b-44dc-ae44-c2b044de1197 req-6495f000-3fd4-4b2c-ac70-43e0963b69c1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.140091 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7166a9f8-cf7b-44dc-ae44-c2b044de1197 req-6495f000-3fd4-4b2c-ac70-43e0963b69c1 service nova] Creating event network-vif-plugged:b13a039e-0d0b-48d2-ab55-4c79c8475524 for instance 0a92e2bb-f4df-417a-b035-188d02d773c4 on nch1-master-1 Jul 30 21:17:52.154916 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7166a9f8-cf7b-44dc-ae44-c2b044de1197 req-6495f000-3fd4-4b2c-ac70-43e0963b69c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065375 Jul 30 21:17:52.155569 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2094/4239] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:52.174021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.182505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:52.185183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:52.196935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:52.197399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.202262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:52.207403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.213287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d0819867-1761-4dc8-b24c-d769515561e7 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.861241 Jul 30 21:17:52.214986 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2146/4240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:51 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:52.225001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:52.226196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:52.240498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:52.241484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.242661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:52.243187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:52.503852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.508379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:52.520011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.521416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.522604 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94f258c3-97a0-4972-b1cb-01cad94a2428 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.363216 Jul 30 21:17:52.523195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2095/4241] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:52 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:52.714866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:52.744777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9389dd0b-d5f7-4e45-a9f4-4abd46cfa38d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.524423 Jul 30 21:17:52.747505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2147/4242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:52 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:53.109606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:53.110992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:53.146473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.148292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.151861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.155724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.239847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:53.240760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:53.255059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.255573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.258671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.260459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.491791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:53.517709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e78bb1eb-5e0c-40b3-b0ed-dc223726d7d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.412857 Jul 30 21:17:53.520879 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2096/4243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:53 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:53.550972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:53.551798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:53.569856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.570868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.571737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.572203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.735970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:53.793706 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c52d40ab-9c0e-4ab2-9028-44815782b83d tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.557170 Jul 30 21:17:53.796534 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2148/4244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:53 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:53.804811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-36e11073-e9f7-4bfc-990c-33d88953a570 req-9e00ae8f-0999-4fed-8ae9-9506e13c5f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "d0477c94-c4f8-4008-b836-6bb759f343b9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:53.824485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-36e11073-e9f7-4bfc-990c-33d88953a570 req-9e00ae8f-0999-4fed-8ae9-9506e13c5f36 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.825268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-36e11073-e9f7-4bfc-990c-33d88953a570 req-9e00ae8f-0999-4fed-8ae9-9506e13c5f36 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.850469 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-36e11073-e9f7-4bfc-990c-33d88953a570 req-9e00ae8f-0999-4fed-8ae9-9506e13c5f36 service nova] Creating event network-changed:d0477c94-c4f8-4008-b836-6bb759f343b9 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:53.859813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-36e11073-e9f7-4bfc-990c-33d88953a570 req-9e00ae8f-0999-4fed-8ae9-9506e13c5f36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061722 Jul 30 21:17:53.865651 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2149/4245] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:53.892995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:53.895019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:53.905189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.905848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.907361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:53.907973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:53.967886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:53.986685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:53.988743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:53.991640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3af3b98a-6bd8-4c1a-a6ec-e125aa2ee883 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.443843 Jul 30 21:17:54.001233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2097/4246] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:53 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:54.251396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf83c78-a95b-43c5-b133-8197374c3c71", "name": "network-vif-plugged", "status": "completed", "tag": "c26ee60d-b568-41c4-acf9-190d6587fed2"}, {"server_uuid": "f808bb9e-14d6-46b2-9bbf-97f88f4eebbf", "name": "network-vif-plugged", "status": "completed", "tag": "2f4631cd-75c1-4e31-a15b-b26adb8b374d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:54.266381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:54.267217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:54.281408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] Creating event network-vif-plugged:c26ee60d-b568-41c4-acf9-190d6587fed2 for instance 2cf83c78-a95b-43c5-b133-8197374c3c71 on nch1-master-1 Jul 30 21:17:54.282271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] Creating event network-vif-plugged:2f4631cd-75c1-4e31-a15b-b26adb8b374d for instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf on nch2-master-1 Jul 30 21:17:54.293787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f6e46377-4256-4f6d-8a44-2eb278e6b960 req-f7e49ed1-a07c-4f7c-89ed-92877ef63133 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049933 Jul 30 21:17:54.295075 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2098/4247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:17:54.357616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:54.372935 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7489358-0f9c-473a-87a6-155fd75cb4b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.504895 Jul 30 21:17:54.373618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2150/4248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:53 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:54.543711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:54.544771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:54.563439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:54.564110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:54.566226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:54.568372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:54.817068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:54.817698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:54.833196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:54.833705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:54.834519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:54.834979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:54.931900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:54.940364 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72397368-7ae8-4222-8aff-46260274f498 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1309 microversion: 2.1 time: 0.403219 Jul 30 21:17:54.940961 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2099/4249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:54 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:55.016258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:55.016894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:55.035686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.036449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:55.037957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.038572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:55.087154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:55.101626 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11d5451f-5ea4-4dd2-a50b-1819ce786d8b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 0.288197 Jul 30 21:17:55.102597 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2151/4250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:54 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:55.305608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:55.316417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:55.318387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:55.321898 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1040d973-5c13-47d5-8cb6-b7b2317496b0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.309234 Jul 30 21:17:55.323183 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2100/4251] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:55 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:17:55.394474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:55.395424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:55.402761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.403726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:55.405209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.405842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:55.646568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:55.656131 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ea02e1d-cf6f-4082-9028-430390f1eefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.265897 Jul 30 21:17:55.657051 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2152/4252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:55 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:55.959104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8c69c75a-01f3-455a-ab41-1d017879fd66 req-6c22a3f5-f434-486f-8945-185f1668bedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:55.967557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:55.969482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:55.986423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.986889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:55.989248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:55.989713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:56.001556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8c69c75a-01f3-455a-ab41-1d017879fd66 req-6c22a3f5-f434-486f-8945-185f1668bedc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:56.001694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8c69c75a-01f3-455a-ab41-1d017879fd66 req-6c22a3f5-f434-486f-8945-185f1668bedc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:56.036911 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8c69c75a-01f3-455a-ab41-1d017879fd66 req-6c22a3f5-f434-486f-8945-185f1668bedc service nova] Creating event network-changed:8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:56.044913 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8c69c75a-01f3-455a-ab41-1d017879fd66 req-6c22a3f5-f434-486f-8945-185f1668bedc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091195 Jul 30 21:17:56.045751 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2101/4253] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:17:56.136964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:56.137779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:56.160026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:56.160848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:56.162451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:56.167186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:56.557279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:56.569016 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1ffcdc2-6731-4269-b056-dbaf1ec67362 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1489 microversion: 2.1 time: 0.608500 Jul 30 21:17:56.573210 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2153/4254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:55 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1489 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:56.588104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:56.588890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:56.608254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:56.609019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:56.610676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:56.611378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.040771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.056747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.058530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.059932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0582abd-e369-45df-aa5a-c6c1d895e3b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.485421 Jul 30 21:17:57.060967 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2154/4255] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:56 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:57.065928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:57.066584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:57.075199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.075958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.076994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.077668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.135416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.145425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eec140e1-3408-4154-becc-32affa08e8e8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1323 microversion: 2.1 time: 1.025878 Jul 30 21:17:57.160432 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2102/4256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:56 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1323 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:57.167730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:57.168579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:57.171468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:57.177389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.178068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.179030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.180613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.460287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.478389 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f9f4f89-3ec9-48c0-a5d2-069575025341 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1489 microversion: 2.1 time: 0.416073 Jul 30 21:17:57.480531 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2155/4257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:57 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1489 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:57.502060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:57.502721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:57.510280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.511174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.512108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.513418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.652667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.661091 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f6c1ea93-97b2-472c-b469-f4c25caff282 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.499319 Jul 30 21:17:57.661958 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2103/4258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:57 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:57.725026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:57.735112 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad5268ab-d4c9-4468-9597-622052557bf9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1489 microversion: 2.1 time: 0.238275 Jul 30 21:17:57.735976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2156/4259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:57 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1489 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:57.756620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:57.757143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:57.763619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.764189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.764953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.765376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.793288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:57.887524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e25162e2-8a18-40e4-9f01-e52746d2b06d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 204 len: 0 microversion: 2.1 time: 0.134655 Jul 30 21:17:57.889279 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2104/4260] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:57 2022] DELETE /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:57.899435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:57.900355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:57.907651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.908403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:57.909567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:57.910249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.073201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4a379922-6a0b-4eba-8b9e-d3787fd86e29 req-5df94120-808c-4193-aac1-665d608a4e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "778ee310-a269-432b-b3e4-d817f4ae4ecd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:17:58.073592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:58.086387 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21f8ea5c-181c-4c65-a9ac-60d082e88b8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1495 microversion: 2.1 time: 0.192128 Jul 30 21:17:58.087066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2157/4261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:57 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1495 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:58.102968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:58.103680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:58.112475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.112961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.113852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.114364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.121762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4a379922-6a0b-4eba-8b9e-d3787fd86e29 req-5df94120-808c-4193-aac1-665d608a4e3b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.122451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4a379922-6a0b-4eba-8b9e-d3787fd86e29 req-5df94120-808c-4193-aac1-665d608a4e3b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.138440 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4a379922-6a0b-4eba-8b9e-d3787fd86e29 req-5df94120-808c-4193-aac1-665d608a4e3b service nova] Creating event network-changed:778ee310-a269-432b-b3e4-d817f4ae4ecd for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:17:58.149192 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4a379922-6a0b-4eba-8b9e-d3787fd86e29 req-5df94120-808c-4193-aac1-665d608a4e3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080839 Jul 30 21:17:58.150498 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2105/4262] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:17:58.172413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:58.173428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:58.181703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.182819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.183908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.184464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.389115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:58.402343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:58.404500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:58.407527 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15d5d620-d94e-4244-9c64-4b5e8a0c80eb tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.317753 Jul 30 21:17:58.408118 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2158/4263] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:58 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:17:58.597688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:58.612789 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9714655-1fd1-489b-9a23-b69e1cf1e604 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 200 len: 1517 microversion: 2.1 time: 0.444280 Jul 30 21:17:58.630445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2106/4264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:58 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 1517 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:58.638623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:58.639704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:58.646695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.647172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.648031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.648484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.691927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:58.691927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:58.697487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.698037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:58.698895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:58.699379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.051172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:59.068008 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e454f6f3-206a-4ee5-8625-3d8971185ea7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.386189 Jul 30 21:17:59.068620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:59.081826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2107/4265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:58 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:59.082316 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-07748482-a798-402c-9016-30193be3bd6e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 200 len: 1517 microversion: 2.1 time: 0.443637 Jul 30 21:17:59.082316 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2159/4266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:58 2022] GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 1517 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:59.106234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:59.109936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:59.110566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:59.111651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:59.123460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.123941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.124751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.125199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.131626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.131815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.132948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.133450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.529697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:59.544959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-521753a3-b367-4b41-878c-3b1fe7c67804 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 200 len: 1517 microversion: 2.1 time: 0.442670 Jul 30 21:17:59.545580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2108/4267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:59 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:17:59.550516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:59.563466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:59.571776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.572579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.584747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.585497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.694810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:17:59.712057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b90a5f7b-1a5c-49fa-a8b0-4335381084aa tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1495 microversion: 2.1 time: 0.606538 Jul 30 21:17:59.713000 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2160/4268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:59 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1495 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:17:59.717936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:59.718629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:59.736785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.737250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.738046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.738494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.791197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:17:59.829070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:59.945244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3eaf968-ea4c-46e3-8e91-0b93a36305ab tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "DELETE /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 204 len: 0 microversion: 2.1 time: 0.230638 Jul 30 21:17:59.945854 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2161/4269] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:17:59 2022] DELETE /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:17:59.957877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:17:59.965297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:17:59.972587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.973279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.974250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:17:59.975004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:17:59.987065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.008039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.009763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.011017 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7a991ae-b91e-46c5-a1d9-953cb11450e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.464472 Jul 30 21:18:00.023767 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2109/4270] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:17:59 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:00.095699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:00.096498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:00.121613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:00.122237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:00.123173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:00.123958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:00.329174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.342923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e6e88455-a446-4beb-978d-312f11b4ff5a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1532 microversion: 2.1 time: 0.250902 Jul 30 21:18:00.344421 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2110/4271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:00 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1532 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:00.734726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:00.736590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:00.763526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:00.764308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:00.766737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:00.767200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:00.836856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.851912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3cf6091-138a-47aa-aced-d20796a19ab8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 200 len: 1523 microversion: 2.1 time: 0.898768 Jul 30 21:18:00.867151 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2162/4272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:17:59 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 1523 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:00.982223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:00.995916 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4a131dad-c87d-4262-b1d7-61a80623ba3e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1495 microversion: 2.1 time: 0.265754 Jul 30 21:18:01.008754 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2111/4273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:00 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1495 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:01.039669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:01.040536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:01.042763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:01.056640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.058164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.058988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.059642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.370184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:01.370835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:01.382105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.382648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.399197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.400044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.736649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:01.741230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:01.752327 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31649d8e-1c25-4606-9437-a6f19fabab57 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1532 microversion: 2.1 time: 0.390708 Jul 30 21:18:01.754069 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2112/4274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:01 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1532 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:01.773511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a8826607-d292-4a25-afad-5b1df70515d5 req-cd0e1495-d156-4822-a3a9-47c5b318ef74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf83c78-a95b-43c5-b133-8197374c3c71", "name": "network-vif-deleted", "tag": "c26ee60d-b568-41c4-acf9-190d6587fed2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:01.807502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a8826607-d292-4a25-afad-5b1df70515d5 req-cd0e1495-d156-4822-a3a9-47c5b318ef74 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.808022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a8826607-d292-4a25-afad-5b1df70515d5 req-cd0e1495-d156-4822-a3a9-47c5b318ef74 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.827760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:01.842744 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a8826607-d292-4a25-afad-5b1df70515d5 req-cd0e1495-d156-4822-a3a9-47c5b318ef74 service nova] Creating event network-vif-deleted:c26ee60d-b568-41c4-acf9-190d6587fed2 for instance 2cf83c78-a95b-43c5-b133-8197374c3c71 on nch1-master-1 Jul 30 21:18:01.850139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:01.853953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:01.856897 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e96eb484-9286-4877-9058-d868a8382d78 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.822931 Jul 30 21:18:01.860535 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2163/4275] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:01 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:01.872361 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a8826607-d292-4a25-afad-5b1df70515d5 req-cd0e1495-d156-4822-a3a9-47c5b318ef74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097710 Jul 30 21:18:01.873065 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2113/4276] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:01.875171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:01.877614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:01.893906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.896017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:01.900926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:01.902935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.019265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:02.020014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:02.034920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.036549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.037421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.037897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.107304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.108020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.108572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lazy-loading 'fault' on Instance uuid 2cf83c78-a95b-43c5-b133-8197374c3c71 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:02.396004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:02.408141 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4005a500-316e-416a-8766-3659529c0c0b tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 200 len: 1523 microversion: 2.1 time: 0.538234 Jul 30 21:18:02.409340 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2164/4277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:01 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:02.434246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:02.449366 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef902c39-f762-4341-b9a6-06c08a78de14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 200 len: 1299 microversion: 2.1 time: 0.434497 Jul 30 21:18:02.450357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2114/4278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:02 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 1299 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:02.777400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:02.778219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:02.787596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.798185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.799041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.799521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.885695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:02.886429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:02.893083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.893583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:02.894465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:02.894951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.219315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:03.248930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6c78df1e-772d-4f0e-95de-23870e7ba165 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1532 microversion: 2.1 time: 0.475479 Jul 30 21:18:03.249830 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2165/4279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:02 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1532 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:03.256094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8d6a79f6-4769-4fbf-b053-f272e0059b7d req-50f54dd7-b359-463f-9b0e-b115d0f23f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "name": "network-vif-plugged", "status": "completed", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:03.305651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d6a79f6-4769-4fbf-b053-f272e0059b7d req-50f54dd7-b359-463f-9b0e-b115d0f23f2d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.306372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d6a79f6-4769-4fbf-b053-f272e0059b7d req-50f54dd7-b359-463f-9b0e-b115d0f23f2d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.334483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8d6a79f6-4769-4fbf-b053-f272e0059b7d req-50f54dd7-b359-463f-9b0e-b115d0f23f2d service nova] Creating event network-vif-plugged:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch2-master-1 Jul 30 21:18:03.367689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8d6a79f6-4769-4fbf-b053-f272e0059b7d req-50f54dd7-b359-463f-9b0e-b115d0f23f2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116548 Jul 30 21:18:03.368796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2166/4280] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:03.430895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:03.431986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:03.444107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.448533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.449680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.450435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.534021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.534766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.535452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lazy-loading 'fault' on Instance uuid 35719d6b-22ea-47e1-901b-2c54ccdecc14 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:03.652742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:03.660724 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3243e718-352f-4cb1-a035-e35ecd003374 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 200 len: 1313 microversion: 2.1 time: 0.234600 Jul 30 21:18:03.677787 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2167/4281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:03 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:03.688933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:03.691990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:03.713814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.716130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.717263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.718355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.741937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:03.753500 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:18:03.753810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:03.755752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:03.758287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37c33b4c-236b-463a-a40f-1b8174c01591 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.876880 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 HTTP/1.1 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '2cf83c78-a95b-43c5-b133-8197374c3c71'} Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:03.759066 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73b2d58f-8cb8-49eb-bb73-65357924afa3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 404 len: 111 microversion: 2.1 time: 0.079206 Jul 30 21:18:03.767451 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2168/4282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:03 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:03.772426 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2115/4283] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:02 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:18:03.775917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:03.776440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:03.791794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.792320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.793272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:03.796223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:03.869167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:18:03.969113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a6113541-dd5c-40d8-870d-85867af5ab42 req-d957246a-e7b7-4891-94f9-696f3530132a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35719d6b-22ea-47e1-901b-2c54ccdecc14", "name": "network-vif-deleted", "tag": "adf5a405-5742-4d9f-aab8-367ac8c8371c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:03.973222 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-007e4227-205f-4f71-b635-4407511b82b3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 204 len: 0 microversion: 2.1 time: 0.204468 Jul 30 21:18:03.975548 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2169/4284] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:18:03 2022] DELETE /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:18:03.990620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:03.992174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:04.025424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a6113541-dd5c-40d8-870d-85867af5ab42 req-d957246a-e7b7-4891-94f9-696f3530132a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.025935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a6113541-dd5c-40d8-870d-85867af5ab42 req-d957246a-e7b7-4891-94f9-696f3530132a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.027451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.027963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.028791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.029252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.060622 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a6113541-dd5c-40d8-870d-85867af5ab42 req-d957246a-e7b7-4891-94f9-696f3530132a service nova] Creating event network-vif-deleted:adf5a405-5742-4d9f-aab8-367ac8c8371c for instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 on nch2-master-1 Jul 30 21:18:04.071569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a6113541-dd5c-40d8-870d-85867af5ab42 req-d957246a-e7b7-4891-94f9-696f3530132a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111374 Jul 30 21:18:04.074138 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2116/4285] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:04.276525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:04.277380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:04.301480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.303647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.306844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.307959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.374311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:04.384602 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0735a52e-6632-4871-ac34-6be22b4cc913 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1495 microversion: 2.1 time: 0.402069 Jul 30 21:18:04.387632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2170/4286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:03 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1495 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:04.619237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:04.632298 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8c7c11a4-8a88-4d32-a83a-0ba05ea23652 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.359959 Jul 30 21:18:04.647033 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2117/4287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:04.681854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:04.682484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:04.697298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.697797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.698651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.699102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.784030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:04.791332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:04.794856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.797344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.798603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lazy-loading 'fault' on Instance uuid 35719d6b-22ea-47e1-901b-2c54ccdecc14 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:04.826309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.827594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:04.829085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:04.832516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:05.296879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:05.311421 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d6d62fbe-f2f8-4542-b977-b7fdd61db072 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 200 len: 1313 microversion: 2.1 time: 0.633377 Jul 30 21:18:05.325476 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2171/4288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:04 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:05.408477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:05.409133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:05.423302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:05.423715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:05.425462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:05.430113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:05.520788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:05.544503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:05.548451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:05.574079 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-160b9e54-1eff-4acf-a2fe-8fa94eee4ec7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.792702 Jul 30 21:18:05.575801 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2118/4289] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:04 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:05.663234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:05.665096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:05.674373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:05.675559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:05.677345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:05.678089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.195709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:06.207358 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-212137d2-8b2b-4413-9710-1a774442ad2c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.550985 Jul 30 21:18:06.221798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2119/4290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:05 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:06.333029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.333930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:06.343893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.348440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.349478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.350094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.383190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] HTTP exception thrown: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 HTTP/1.1 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '35719d6b-22ea-47e1-901b-2c54ccdecc14'} Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:06.389446 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 404 to user: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:06.393532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3404ff8c-a644-46bf-95df-cd7cfb550932 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 404 len: 111 microversion: 2.1 time: 0.062131 Jul 30 21:18:06.399546 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2120/4291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:06.409551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.426825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:06.427875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:06.439686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.444275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.445160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.445621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.592999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:06.608735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aab4e363-d443-4ba2-8c94-79c5b74a1145 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1495 microversion: 2.1 time: 1.206308 Jul 30 21:18:06.609357 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2172/4292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:05 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1495 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:06.642329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.643097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:06.669753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.677103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.678185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.683905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.713731 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64cf681f-d897-4813-9f80-b5a39a02503e tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.312931 Jul 30 21:18:06.722720 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2121/4293] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:18:06.733076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-744621e7-0445-40d3-801e-7bda4861ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-744621e7-0445-40d3-801e-7bda4861ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 30 21:18:06.741339 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 30 21:18:06.745601 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:06.749286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-744621e7-0445-40d3-801e-7bda4861ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:06.750344 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-744621e7-0445-40d3-801e-7bda4861ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026216 Jul 30 21:18:06.761596 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2122/4294] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:18:06.766475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.776661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:06.788936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:06.801983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.802461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.803326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:06.803784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:06.879267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:18:06.948475 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72844a09-28f7-4005-959a-93517876afdb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.183930 Jul 30 21:18:06.950670 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2123/4295] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:06.966696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:06.989444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:06.990308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.servers [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Removing options 'limit' from query {{(pid=130983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 30 21:18:06.991203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:07.005338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.006579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.008572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.012030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.075142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:18:07.142619 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bffc64d0-f6f0-4edc-8954-4f14cf786713 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.182748 Jul 30 21:18:07.151772 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2124/4296] 10.222.0.17 () {58 vars in 1144 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:07.176094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64194940-c2ff-46c0-971c-7ae6250e25b0 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64194940-c2ff-46c0-971c-7ae6250e25b0 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '-1' Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 30 21:18:07.183437 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 30 21:18:07.187526 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.195927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-64194940-c2ff-46c0-971c-7ae6250e25b0 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:07.196856 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-64194940-c2ff-46c0-971c-7ae6250e25b0 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.043733 Jul 30 21:18:07.201789 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2125/4297] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:18:07.237108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1701851f-8b65-48c2-98d2-94e0a3bc7c0f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1701851f-8b65-48c2-98d2-94e0a3bc7c0f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: action_args: {} Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi 'testing' Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 30 21:18:07.259127 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1701851f-8b65-48c2-98d2-94e0a3bc7c0f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1701851f-8b65-48c2-98d2-94e0a3bc7c0f tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.057370 Jul 30 21:18:07.267542 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2126/4298] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:18:07.279179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:07.283366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:07.311525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.317558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.318424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.319062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.769753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:07.790171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:07.792377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:07.794036 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-496cc53f-a25f-4fb7-ab1a-1454da8accad tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.165768 Jul 30 21:18:07.795543 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2173/4299] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:06 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:07.809271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:07.813794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2937012e-cffd-4ffc-bd82-15f2fcffa291 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:07.818273 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-256b3536-14e7-4d26-92e2-f5a7fab72b16 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.555710 Jul 30 21:18:07.820841 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2127/4300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:07.827953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e557488c-222b-4f6f-b45c-6915101e63f5 req-46c63be3-e525-440a-8607-eb94c6dc8322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a27d5c-d518-476d-be57-e24b191c17eb", "name": "network-vif-deleted", "tag": "873c110a-0116-4229-958e-6712ce023b98"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:07.858205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2937012e-cffd-4ffc-bd82-15f2fcffa291 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:07.859624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2937012e-cffd-4ffc-bd82-15f2fcffa291 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:07.861682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e557488c-222b-4f6f-b45c-6915101e63f5 req-46c63be3-e525-440a-8607-eb94c6dc8322 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.862244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e557488c-222b-4f6f-b45c-6915101e63f5 req-46c63be3-e525-440a-8607-eb94c6dc8322 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.870513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.compute.servers [None req-2937012e-cffd-4ffc-bd82-15f2fcffa291 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Flavor 'non_existing_flavor' could not be found {{(pid=130984) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 30 21:18:07.871946 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2937012e-cffd-4ffc-bd82-15f2fcffa291 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.075330 Jul 30 21:18:07.873061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2174/4301] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:18:07.888108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:07.889004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:07.898382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.899197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.900291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:07.900991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:07.924149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e557488c-222b-4f6f-b45c-6915101e63f5 req-46c63be3-e525-440a-8607-eb94c6dc8322 service nova] Creating event network-vif-deleted:873c110a-0116-4229-958e-6712ce023b98 for instance 75a27d5c-d518-476d-be57-e24b191c17eb on nch2-master-1 Jul 30 21:18:07.946031 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e557488c-222b-4f6f-b45c-6915101e63f5 req-46c63be3-e525-440a-8607-eb94c6dc8322 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122561 Jul 30 21:18:07.946661 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2128/4302] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:07.971121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:08.018004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:08.023789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:08.045433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.045907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.046718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.052574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.257493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:08.267264 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c680c006-e24a-4d9e-bf97-b3884b14b77b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 200 len: 1453 microversion: 2.1 time: 0.383580 Jul 30 21:18:08.278947 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2175/4303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 1453 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:08.394268 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-507e1e6b-4247-4a7a-9185-aed4fa540db8 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.446293 Jul 30 21:18:08.400201 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2129/4304] 10.222.0.17 () {58 vars in 1174 bytes} [Sat Jul 30 21:18:07 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:18:08.415227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:08.426849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:08.427487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:08.434689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.435161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.436021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.436480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.718126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0966dbab-b74d-47f5-a4d0-b3b52370cdeb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.309524 Jul 30 21:18:08.745453 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2176/4305] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 30 21:18:08 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:18:08.746698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:08.759856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:08.763972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:08.773310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.777965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.781161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.781638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.821489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:08.822801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:08.841256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.842212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.844159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.852511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:08.869160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:18:08.943641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:08.953057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:08.953542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.292622 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3424e419-769c-4f73-9b97-b39dc8a684c4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.552559 Jul 30 21:18:09.293750 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2130/4306] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:18:08 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:09.301182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:09.302158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:09.311214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.312166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.313467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.314614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.547538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.562295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:09.573881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.581259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.582948 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0cbccf4c-84a7-4977-ad6d-a1d8b832f7f7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.767075 Jul 30 21:18:09.588188 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2177/4307] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:08 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:18:09.602843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:09.611238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:09.639461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.642443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.648226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.648978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.667802 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb HTTP/1.1 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '75a27d5c-d518-476d-be57-e24b191c17eb'} Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:09.669699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:18:09.674462 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:09.678374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:09.680116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af46d7b7-ba04-47a1-99cf-d494cd102db3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 404 len: 111 microversion: 2.1 time: 0.089217 Jul 30 21:18:09.680902 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2178/4308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:09 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:09.704410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e7c7c08-5c1b-4169-bcf0-1208ad09ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:09.713090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7e7c7c08-5c1b-4169-bcf0-1208ad09ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.721028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e7c7c08-5c1b-4169-bcf0-1208ad09ff77 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.034615 Jul 30 21:18:09.721984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2179/4309] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Jul 30 21:18:09 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:18:09.740557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:09.748638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.749345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Searching by: {'deleted': False, 'project_id': '995094f55a1a4d51bba197347e510968'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:18:09.760104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.760569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.761374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:09.761820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:09.802183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:09.815002 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5eb184a4-bdbc-4eb7-9778-eff0f3f0b8fc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.519230 Jul 30 21:18:09.820797 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2131/4310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:09 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:09.856319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:18:09.967417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1248871167", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:10.006126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d8a54ab-c3aa-41ea-af86-863533c83c0c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.274961 Jul 30 21:18:10.018089 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2180/4311] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:18:09 2022] GET /compute/v2.1/servers => generated 683 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:10.024622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:10.046227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:10.076314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.079361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.082556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.086096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.113805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:18:10.114948 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] HTTP exception thrown: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 HTTP/1.1 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '35719d6b-22ea-47e1-901b-2c54ccdecc14'} Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:10.117854 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:10.121088 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:10.127426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 404 to user: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:10.131685 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb5ee0f1-7d0a-4c1e-8bdf-43dd38154584 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "DELETE /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 404 len: 111 microversion: 2.1 time: 0.110356 Jul 30 21:18:10.134215 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2181/4312] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:18:10 2022] DELETE /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:10.160410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:10.160930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:10.197652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.204290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.205474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.206133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.261715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:18:10.475175 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f45df6b8-e223-4ff3-8c68-264fc48ea5bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 204 len: 0 microversion: 2.1 time: 0.331620 Jul 30 21:18:10.476091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2182/4313] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:18:10 2022] DELETE /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:18:10.487535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:10.488386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:10.501245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.502023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.506132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.508050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.565721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:18:10.734102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb4cd52e-cfc5-4570-92c5-f10bda82821c tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 204 len: 0 microversion: 2.1 time: 0.253321 Jul 30 21:18:10.743420 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2183/4314] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:18:10 2022] DELETE /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:18:10.751840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:10.751840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:10.767382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.773531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:10.774557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:10.775781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.470385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:18:11.471343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:18:11.471977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:18:11.472513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:18:11.473014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:18:11.502502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.505644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.508914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.509539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.541289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:11.551797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:11.559482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:11.564362 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb240223-1e3c-41fd-8410-e173d7f6ef6d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.819470 Jul 30 21:18:11.567000 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2184/4315] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:10 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:11.575127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:11.578422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 35719d6b-22ea-47e1-901b-2c54ccdecc14] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:11.596943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.598306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.599757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.601695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.604497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:11.613084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:11.636630 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] HTTP exception thrown: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 HTTP/1.1 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '35719d6b-22ea-47e1-901b-2c54ccdecc14'} Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:11.638737 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. Jul 30 21:18:11.642016 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:11.648527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 404 to user: Instance 35719d6b-22ea-47e1-901b-2c54ccdecc14 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:11.654040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e201a616-992a-4ba7-b9fc-7e3050795782 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14" status: 404 len: 111 microversion: 2.1 time: 0.084118 Jul 30 21:18:11.655397 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2185/4316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:11 2022] GET /compute/v2.1/servers/35719d6b-22ea-47e1-901b-2c54ccdecc14 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:11.663075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:11.666020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:11.687440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.688214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.689234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.689875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.711531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:18:11.718159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:18:11.844565 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1852d92e-2f4b-4518-b679-20f89b2c861f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883211 Jul 30 21:18:11.851993 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2132/4317] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:18:11.861738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:11.865627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:11.885112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.886330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:11.886666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:11.887143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:12.268253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:12.278475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86c620aa-d2ba-4dc8-a97f-0ff6bfbbfc3d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.621722 Jul 30 21:18:12.279067 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2186/4318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:11 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:12.307733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa5e4ceb-a484-4343-8453-3a5736843233 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:12.308369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa5e4ceb-a484-4343-8453-3a5736843233 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:12.362124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:12.385519 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-daa96c64-9c4c-4625-8aa0-422f555dc0bf tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 200 len: 1523 microversion: 2.1 time: 0.532097 Jul 30 21:18:12.386123 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2133/4319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:11 2022] GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:12.616492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa5e4ceb-a484-4343-8453-3a5736843233 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:12.624621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa5e4ceb-a484-4343-8453-3a5736843233 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1209 microversion: 2.1 time: 0.344484 Jul 30 21:18:12.633648 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2187/4320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:12 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1209 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:12.648446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:12.654420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:12.683823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:12.686478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:12.691609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:12.695528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:12.764027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-656edf6b-b1ea-4cf7-9911-49d6362471a3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: .version_select at 0x7fbb5ced5280>, body: {"keypair": {"name": "tempest-keypair-958307668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvWmM2TQF9a0K+JZTNmryGuyDkCYP4m0XgC8echmtEDqZE+7YfGtEuWitkC75WFOjOVyse8CezSJ9TmKWTncYjUhZsSIScc/Y+cLPioH0xBF3jV1lHpH+jAKaf8sZOg5g=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:12.799709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-656edf6b-b1ea-4cf7-9911-49d6362471a3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:12.813829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-656edf6b-b1ea-4cf7-9911-49d6362471a3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:12.880562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-656edf6b-b1ea-4cf7-9911-49d6362471a3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.462670 Jul 30 21:18:12.881652 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2134/4321] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:18:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:18:13.302060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:13.310059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:13.331270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:13.335760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:13.336864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:13.338486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:13.621791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:13.643147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:13.646814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:13.649287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8340d20b-d936-4ba4-9de0-3beec032222c tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.013388 Jul 30 21:18:13.653677 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2188/4322] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:12 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:13.665618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:13.666793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:13.680747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:13.687240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:13.688385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:13.689068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:14.407573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:14.418130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cae0728c-7cdc-4b1b-a619-685eae0852b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 1.122015 Jul 30 21:18:14.423163 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2135/4323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:13 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:14.443347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:14.444172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:14.462447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:14.463355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:14.464409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:14.465063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:14.527938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:15.020308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:15.074884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-66bd0ba1-1a07-4eca-bb57-dad62a15a781 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1267 microversion: 2.1 time: 0.650171 Jul 30 21:18:15.079970 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2136/4324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:14 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1267 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:15.090645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:15.099239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:15.127134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:15.128296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:15.131529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:15.132922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:15.371828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:15.390759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce2b4a17-39eb-420d-bb10-f434fe323adb tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 200 len: 1523 microversion: 2.1 time: 1.735600 Jul 30 21:18:15.403326 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2189/4325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:13 2022] GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 1523 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:15.447826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:15.450188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:15.474132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:15.475562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:15.477255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:15.478014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:16.471358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:16.480986 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2bc46c63-082f-4adc-a6a2-68530325eaaa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 1.040700 Jul 30 21:18:16.485200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2190/4326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:15 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:16.843187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:16.884061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:16.885404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:16.899425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:16.912138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:16.919245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:16.921402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03877f3b-5459-4839-af3b-3f1eeb7474e3 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.840024 Jul 30 21:18:16.926345 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2137/4327] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:15 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:16.927563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:16.928447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:16.928923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:16.943745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:16.945185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:16.953148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:16.961056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:16.962222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:16.962871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:17.080048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:18:17.338063 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8ebee52-a005-4b41-9332-c91e8a1a858c tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 204 len: 0 microversion: 2.32 time: 0.851320 Jul 30 21:18:17.339378 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2191/4328] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:18:16 2022] DELETE /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:18:17.346407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:17.348733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:17.378387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:17.382801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:17.386182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:17.386832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:17.508490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:17.509890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:17.510522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lazy-loading 'fault' on Instance uuid 0a92e2bb-f4df-417a-b035-188d02d773c4 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:17.756454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e4e88cd2154fa09d15bffe4e644a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995094f55a1a4d51bba197347e510968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:17.759062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:17.770268 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-da2d7535-436b-425a-8870-50a51b19bf04 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 200 len: 1313 microversion: 2.1 time: 0.429454 Jul 30 21:18:17.773580 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2192/4329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:17 2022] GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:17.798994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b235c5da-859e-42ed-bad8-84dbead2644e req-d723edfb-5409-4505-9b24-fbde6674532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f808bb9e-14d6-46b2-9bbf-97f88f4eebbf", "name": "network-vif-deleted", "tag": "2f4631cd-75c1-4e31-a15b-b26adb8b374d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:17.835182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b235c5da-859e-42ed-bad8-84dbead2644e req-d723edfb-5409-4505-9b24-fbde6674532c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:17.835691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b235c5da-859e-42ed-bad8-84dbead2644e req-d723edfb-5409-4505-9b24-fbde6674532c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:17.923501 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b235c5da-859e-42ed-bad8-84dbead2644e req-d723edfb-5409-4505-9b24-fbde6674532c service nova] Creating event network-vif-deleted:2f4631cd-75c1-4e31-a15b-b26adb8b374d for instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf on nch2-master-1 Jul 30 21:18:17.939529 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b235c5da-859e-42ed-bad8-84dbead2644e req-d723edfb-5409-4505-9b24-fbde6674532c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164042 Jul 30 21:18:17.949044 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2193/4330] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:17.955611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:17.955611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:18.004041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:18.004553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:18.005408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:18.005859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:18.838167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:18.854284 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-482e7171-7447-42bd-8412-125ebf532159 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 1.922336 Jul 30 21:18:18.855340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2138/4331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:16 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:18.866363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:18.867010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:18.869034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:18.901169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:18.902734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:18.904815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:18.907187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:18.952805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:18.982628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:18.991545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:18.992191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3871af99-1126-44c4-8a91-ef3085397fe3 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2955 microversion: 2.32 time: 1.041802 Jul 30 21:18:19.000857 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2194/4332] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:17 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2955 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:19.018149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:19.031092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:19.044441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.044866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.045681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.055076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.608892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:19.628488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e1e2e1fb-5fcc-4f9d-9a0a-364689bdc449 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.762594 Jul 30 21:18:19.642040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:19.642428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2139/4333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:18 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:19.651624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:19.656477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:19.657140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:19.657842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: 0a92e2bb-f4df-417a-b035-188d02d773c4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:19.663533 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-376463d6-dd57-4411-a436-35b6fc61e3f9 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.652223 Jul 30 21:18:19.663533 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2195/4334] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:19 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:19.679759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.688639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.693204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.697663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.764505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] HTTP exception thrown: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 HTTP/1.1 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0a92e2bb-f4df-417a-b035-188d02d773c4'} Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:19.776099 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 404 to user: Instance 0a92e2bb-f4df-417a-b035-188d02d773c4 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:19.782410 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2173309-faed-4eba-9cb7-fe4d32be3cb4 tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4" status: 404 len: 111 microversion: 2.1 time: 0.142745 Jul 30 21:18:19.785748 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2140/4335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:19 2022] GET /compute/v2.1/servers/0a92e2bb-f4df-417a-b035-188d02d773c4 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:19.796922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:19.797925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] [instance: f808bb9e-14d6-46b2-9bbf-97f88f4eebbf] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:19.808650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:19.812994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.813464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.814602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.819966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.860069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] HTTP exception thrown: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Request method failure captured: Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf HTTP/1.1 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z_mEns9X-V-E0CNPn02wLMRc5XPuFjRgLhRpFDNEU_q_AqhuytG0dyw5TlGkBZvk6btWxRLRRlyzLuL8flfDS4cfhf8bexzyJIANFvk3_WIl_f4V3Bd5D8eJCP_HPvTyYwZRJL0O0dvxQErGHozCfXxjO10FA0fUJhYkO4YZruCcJg Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995094f55a1a4d51bba197347e510968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995094f55a1a4d51bba197347e510968", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995094f55a1a4d51bba197347e510968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 995094f55a1a4d51bba197347e510968 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-53417016 Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 86e4e88cd2154fa09d15bffe4e644a8b Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ListServersNegativeTestJSON-53417016-project Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'f808bb9e-14d6-46b2-9bbf-97f88f4eebbf'} Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:19.861693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. Jul 30 21:18:19.865071 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:19.870336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] Returning 404 to user: Instance f808bb9e-14d6-46b2-9bbf-97f88f4eebbf could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:19.871508 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d43f5897-e064-4c7e-b98a-59ee25e3662a tempest-ListServersNegativeTestJSON-53417016 tempest-ListServersNegativeTestJSON-53417016-project] 10.222.0.17 "GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf" status: 404 len: 111 microversion: 2.1 time: 0.080647 Jul 30 21:18:19.875055 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2196/4336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:19 2022] GET /compute/v2.1/servers/f808bb9e-14d6-46b2-9bbf-97f88f4eebbf => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:19.880022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:19.880781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:19.903819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.904638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:19.908399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:19.911379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:20.033803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:20.034752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:20.044197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:20.047134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:20.049994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:20.050580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:21.005885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:21.051167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:21.061881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:21.073680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a1f6d5c-125f-495d-a7f1-8f23a6fbf0a6 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2955 microversion: 2.32 time: 1.041016 Jul 30 21:18:21.074681 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2197/4337] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:20 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2955 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:21.096475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3d56da84-d62d-4fb8-85ea-65dace14982d req-74f045fe-8473-4d22-9369-4405af70a668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a92e2bb-f4df-417a-b035-188d02d773c4", "name": "network-vif-deleted", "tag": "b13a039e-0d0b-48d2-ab55-4c79c8475524"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:21.125367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:21.162053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3d56da84-d62d-4fb8-85ea-65dace14982d req-74f045fe-8473-4d22-9369-4405af70a668 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:21.170524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3d56da84-d62d-4fb8-85ea-65dace14982d req-74f045fe-8473-4d22-9369-4405af70a668 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:21.210647 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3d56da84-d62d-4fb8-85ea-65dace14982d req-74f045fe-8473-4d22-9369-4405af70a668 service nova] Creating event network-vif-deleted:b13a039e-0d0b-48d2-ab55-4c79c8475524 for instance 0a92e2bb-f4df-417a-b035-188d02d773c4 on nch1-master-1 Jul 30 21:18:21.223315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3d56da84-d62d-4fb8-85ea-65dace14982d req-74f045fe-8473-4d22-9369-4405af70a668 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144471 Jul 30 21:18:21.224841 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2198/4338] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:21.240622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:21.243492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:21.259177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:21.260652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:21.263559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:21.264275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:21.509932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:21.537345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47285393-50db-4582-b7a1-d26f8e5832d0 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 1.658467 Jul 30 21:18:21.539072 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2141/4339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:19 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:21.550403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:21.555278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:21.561482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:21.574844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:21.576213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:21.578244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:21.580880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:22.113355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:22.142720 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c95a179-5f33-43b1-93a7-631c3524284f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.914425 Jul 30 21:18:22.145298 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2199/4340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:21 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:22.153192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:22.154154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:22.162518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:22.163755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:22.164805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:22.165801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:22.629671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:22.837026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:23.128451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:23.151546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:23.158580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:23.184728 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4360dc43-42ff-4899-8e5b-e95020f5d518 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.619579 Jul 30 21:18:23.185633 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2142/4341] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:21 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:23.198004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:23.203201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:23.221606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:23.225154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:23.226828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:23.228174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.212688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:24.224043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4851d83-cef0-4be8-aca7-c5e4768a2ede tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 1.035144 Jul 30 21:18:24.240408 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2143/4342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:23 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:24.255057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:24.260347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:24.276807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:24.277242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.278235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:24.280216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.334551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:24.346237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:24.360865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:24.362744 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-531f9ae3-fbac-4445-983b-16077315dbec tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2955 microversion: 2.32 time: 2.215834 Jul 30 21:18:24.363365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2200/4343] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:22 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2955 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:24.396227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-319c60a1-0630-4c1d-93b4-ce4cf3d9bd27 req-fd5ea5a0-00d4-4468-9616-6a7cec5b3856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b557a2-3be4-4f7a-bf6f-169e16b515db", "tag": "c620cbd0-1168-4f98-bc2b-db0922f436ac"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:24.471716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-319c60a1-0630-4c1d-93b4-ce4cf3d9bd27 req-fd5ea5a0-00d4-4468-9616-6a7cec5b3856 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:24.472494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-319c60a1-0630-4c1d-93b4-ce4cf3d9bd27 req-fd5ea5a0-00d4-4468-9616-6a7cec5b3856 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.511821 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-319c60a1-0630-4c1d-93b4-ce4cf3d9bd27 req-fd5ea5a0-00d4-4468-9616-6a7cec5b3856 service nova] Creating event network-changed:c620cbd0-1168-4f98-bc2b-db0922f436ac for instance 13b557a2-3be4-4f7a-bf6f-169e16b515db on nch1-master-1 Jul 30 21:18:24.541657 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-319c60a1-0630-4c1d-93b4-ce4cf3d9bd27 req-fd5ea5a0-00d4-4468-9616-6a7cec5b3856 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148978 Jul 30 21:18:24.544354 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2201/4344] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:24.575769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:24.576786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:24.601375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:24.608962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:24.609605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.610466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:24.610923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:24.623893 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9bfac58-f820-4711-8ab8-0133fcf60e7d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.378238 Jul 30 21:18:24.627400 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2144/4345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:24 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:24.714503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-735533990", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa7ed307-3fdf-4329-9a4b-db68b093ba0f"}], "security_groups": [{"name": "tempest-securitygroup--176810834"}], "key_name": "tempest-keypair-958307668", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:25.041652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] validate_networks() for [('aa7ed307-3fdf-4329-9a4b-db68b093ba0f', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:18:25.404828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:25.422112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:25.429798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:25.431684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff84e91a-54ba-4c47-9131-07a35c7bb7e5 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.884365 Jul 30 21:18:25.433975 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2202/4346] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:24 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:25.446612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:25.447742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:25.465062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:25.470493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:25.473685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:25.475052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.046824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:18:26.047372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:18:26.047927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:18:26.048349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:18:26.048786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:18:26.077233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.077705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.081384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.081857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.102543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:26.114799 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a8d5f10-d807-4b66-8545-dae63a5ac715 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 0.677135 Jul 30 21:18:26.115361 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2203/4347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:25 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:26.127907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:26.129492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:26.146752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.148114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.153617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.154422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.166568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:26.192467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:26.246869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:18:26.249190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:18:26.374885 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1696c74d-9b11-4ff8-9bdf-d64518bbb6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.667631 Jul 30 21:18:26.387969 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2145/4348] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:18:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:18:26.397610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:26.400511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:26.427138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.429129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.435193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.435474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:26.898421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:26.912698 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c95860f5-8a77-4a52-9ecb-6f7b7bd86e86 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.523362 Jul 30 21:18:26.925185 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2146/4349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:26 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:26.937871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-997405bb-2951-42a6-bb81-295e39cf6b33 req-132b2172-adfb-4f84-9a3f-6a15efd998c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-unplugged", "status": "completed", "tag": "ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:26.968420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-997405bb-2951-42a6-bb81-295e39cf6b33 req-132b2172-adfb-4f84-9a3f-6a15efd998c0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:26.973945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-997405bb-2951-42a6-bb81-295e39cf6b33 req-132b2172-adfb-4f84-9a3f-6a15efd998c0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:27.030881 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-997405bb-2951-42a6-bb81-295e39cf6b33 req-132b2172-adfb-4f84-9a3f-6a15efd998c0 service nova] Creating event network-vif-unplugged:ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:27.045301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-997405bb-2951-42a6-bb81-295e39cf6b33 req-132b2172-adfb-4f84-9a3f-6a15efd998c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118575 Jul 30 21:18:27.049625 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2147/4350] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:27.058747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ef24dcb-b9f7-4dce-8540-efb704bb778e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:27.062972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ef24dcb-b9f7-4dce-8540-efb704bb778e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:27.201614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2ef24dcb-b9f7-4dce-8540-efb704bb778e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:27.212987 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ef24dcb-b9f7-4dce-8540-efb704bb778e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1237 microversion: 2.1 time: 0.161170 Jul 30 21:18:27.221693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2148/4351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:27 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:27.240917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:27.241542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:27.267979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:27.268444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:27.269243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:27.276648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:28.024883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:28.051852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:28.057986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:28.063953 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0be1f4d-b426-43fd-8e8a-310fc4c0f07d tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2934 microversion: 2.32 time: 1.943534 Jul 30 21:18:28.064587 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2204/4352] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:26 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2934 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:28.113600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:28.114300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:28.148172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:28.155955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:28.158579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:28.165172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.165849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:29.196573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:29.219011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:29.226306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-008f44ce-a2fb-4e9d-8cb9-7538685692bc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.989199 Jul 30 21:18:29.248702 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2149/4353] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:27 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:29.264914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:29.271780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:29.282542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:29.303586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a79f40ba-1105-4250-b3ee-faf217bfafa7 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 1.209160 Jul 30 21:18:29.304372 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2205/4354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:28 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:29.313046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:29.313917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:29.320617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.320721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.321534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.322361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.329551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.333823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.334888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.338203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.771548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:29.790076 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09f56bee-e542-40e4-a15d-547be523b1a0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.535027 Jul 30 21:18:29.790901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2150/4355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:29 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:29.810779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:29.812295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:29.821381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.822019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:29.823003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:29.823660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:30.016624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:30.032962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3931ed02-4162-4998-87bc-34b2aacd70bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1295 microversion: 2.1 time: 0.724943 Jul 30 21:18:30.034584 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2206/4356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:29 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1295 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:30.055091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "ebb280be-9aa4-4c83-8b08-5bb73d1e6a07"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-unplugged", "status": "completed", "tag": "503e2e21-98ad-4fe8-9233-11811cd01426"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-unplugged", "status": "completed", "tag": "32311821-607a-46ad-9d0a-cdee0d878cac"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-unplugged", "status": "completed", "tag": "40231132-6acc-42a8-bb4d-8ed3653ce2d5"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:30.068225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:30.069788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:30.085341 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Creating event network-vif-plugged:ebb280be-9aa4-4c83-8b08-5bb73d1e6a07 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:30.086267 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Creating event network-vif-unplugged:503e2e21-98ad-4fe8-9233-11811cd01426 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:30.086996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Creating event network-vif-unplugged:32311821-607a-46ad-9d0a-cdee0d878cac for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:30.088300 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] Creating event network-vif-unplugged:40231132-6acc-42a8-bb4d-8ed3653ce2d5 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:30.105019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7862739d-655d-4d4c-a4c4-788f470a2ab7 req-6899e248-5159-456f-ab2b-e61c8a8a99fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.054283 Jul 30 21:18:30.107833 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2207/4357] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:30.280416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:30.281546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:30.296397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:30.297676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:30.298709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:30.299818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:30.655794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:30.686492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:30.691838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:30.693176 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0e25aada-3f00-4aae-ac38-068eae656229 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2934 microversion: 2.32 time: 0.887589 Jul 30 21:18:30.697583 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2151/4358] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:29 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2934 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:30.711053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:30.712180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:30.728689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:30.731057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:30.733520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:30.734175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:31.251405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:31.273945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:31.275605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:31.276804 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6018f70c-51d9-43f2-83b8-f650414887cd tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.000766 Jul 30 21:18:31.277541 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2208/4359] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:30 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:18:31.282717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:31.288425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:31.315483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:31.316658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:31.319125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:31.319874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:31.533098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:31.558657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e79f590-2f26-441e-840f-156e712cb324 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 0.859132 Jul 30 21:18:31.576030 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2152/4360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:30 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:31.589752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:31.592169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:31.605698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:31.606388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:31.607843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:31.618349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:32.101822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:32.123018 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1d8a902-3d2d-4394-bc48-c4443ccfa1af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1527 microversion: 2.1 time: 0.843529 Jul 30 21:18:32.124713 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2209/4361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:31 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1527 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:32.130320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:32.131195 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:32.138983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:32.139687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:32.140716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:32.141318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:32.260522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:32.280518 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3963b305-c4f3-4ee2-8903-6513731953e9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.703083 Jul 30 21:18:32.291514 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2153/4362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:31 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:32.291701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "6dc0f246-08ce-4e10-9c66-6bc474965f2f"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "51517a60-c982-4096-a107-b749686187d7"}, {"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-unplugged", "status": "completed", "tag": "746ec4d9-67d7-4e13-9f5b-d70bfab012ca"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "778ee310-a269-432b-b3e4-d817f4ae4ecd"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:32.308060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:32.308753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:32.343589 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Creating event network-vif-plugged:6dc0f246-08ce-4e10-9c66-6bc474965f2f for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:32.344294 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Creating event network-vif-plugged:51517a60-c982-4096-a107-b749686187d7 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:32.345985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Creating event network-vif-unplugged:746ec4d9-67d7-4e13-9f5b-d70bfab012ca for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:32.346750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] Creating event network-vif-plugged:778ee310-a269-432b-b3e4-d817f4ae4ecd for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:32.360003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-db5eb091-3541-44a8-956c-7957a02577cc req-050550d6-848e-4088-893a-fcaff390f884 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.076143 Jul 30 21:18:32.361242 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2154/4363] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:32.369090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:32.370080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:32.378629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:32.379594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:32.380639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:32.381372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:33.445302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.469655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.474475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.476509 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39f5a120-6377-4966-92e9-e3e66331c020 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.113768 Jul 30 21:18:33.477767 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2155/4364] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:32 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:33.516940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:33.519086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:33.545026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:33.545700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:33.547192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:33.549213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:33.930702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.932483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.956505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.958799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:33.961211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b6c93105-9455-4db5-b671-d4a879784217 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2913 microversion: 2.32 time: 1.835074 Jul 30 21:18:33.964962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:33.973077 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a621b41b-472d-471c-af92-9ff8c8a244a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 0.481454 Jul 30 21:18:33.974476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2156/4365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:33 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:33.981770 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2210/4366] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:32 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2913 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:33.984832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:33.985689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:33.990121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:33.991991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:33.999440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.000882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.001895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.002925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.003713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.003991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.005695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.006773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.398764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:34.418489 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9284adea-ec62-4333-80d9-4cdb89997598 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1509 microversion: 2.1 time: 0.442204 Jul 30 21:18:34.419953 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2157/4367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:33 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:34.426121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c9588a21-afa2-4b1f-9d5f-52c8a83e265a req-972a3ff1-2945-42bd-a380-6510f35074b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-deleted", "tag": "746ec4d9-67d7-4e13-9f5b-d70bfab012ca"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:34.440277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c9588a21-afa2-4b1f-9d5f-52c8a83e265a req-972a3ff1-2945-42bd-a380-6510f35074b2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.440911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c9588a21-afa2-4b1f-9d5f-52c8a83e265a req-972a3ff1-2945-42bd-a380-6510f35074b2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.494912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c9588a21-afa2-4b1f-9d5f-52c8a83e265a req-972a3ff1-2945-42bd-a380-6510f35074b2 service nova] Creating event network-vif-deleted:746ec4d9-67d7-4e13-9f5b-d70bfab012ca for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:34.511877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c9588a21-afa2-4b1f-9d5f-52c8a83e265a req-972a3ff1-2945-42bd-a380-6510f35074b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088148 Jul 30 21:18:34.514047 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2158/4368] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:34.528417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b557a2-3be4-4f7a-bf6f-169e16b515db", "name": "network-vif-plugged", "status": "completed", "tag": "c620cbd0-1168-4f98-bc2b-db0922f436ac"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-plugged", "status": "completed", "tag": "d0477c94-c4f8-4008-b836-6bb759f343b9"}, {"server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "name": "network-vif-unplugged", "status": "completed", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:34.561716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.562241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.600714 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Creating event network-vif-plugged:c620cbd0-1168-4f98-bc2b-db0922f436ac for instance 13b557a2-3be4-4f7a-bf6f-169e16b515db on nch1-master-1 Jul 30 21:18:34.604299 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Creating event network-vif-plugged:8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:34.604964 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Creating event network-vif-plugged:a06801b0-e2d3-418d-b9f5-9e44a4b0bf6f for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:34.605749 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Creating event network-vif-plugged:d0477c94-c4f8-4008-b836-6bb759f343b9 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:34.607351 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] Creating event network-vif-unplugged:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch2-master-1 Jul 30 21:18:34.632045 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1496e9ac-f338-4a73-876a-15c2f8ae6fab req-2a174550-e5e1-416f-b975-6c765b286c37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.116349 Jul 30 21:18:34.634743 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2159/4369] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:34.649758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:34.652072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:34.671713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.675148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:34.679248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:34.680437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.014413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.030913 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fcd68e51-acc9-4c94-ac44-51fa1a9d5b1f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 1.045430 Jul 30 21:18:35.050824 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2211/4370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:33 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:35.060415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-16656230-ac13-4442-ad5c-55add9762461 req-55f6ed1f-ad21-4b71-a6c6-789c45eaa101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:35.083568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-16656230-ac13-4442-ad5c-55add9762461 req-55f6ed1f-ad21-4b71-a6c6-789c45eaa101 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.084901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-16656230-ac13-4442-ad5c-55add9762461 req-55f6ed1f-ad21-4b71-a6c6-789c45eaa101 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.108364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-16656230-ac13-4442-ad5c-55add9762461 req-55f6ed1f-ad21-4b71-a6c6-789c45eaa101 service nova] Creating event network-changed:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:18:35.116244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-16656230-ac13-4442-ad5c-55add9762461 req-55f6ed1f-ad21-4b71-a6c6-789c45eaa101 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063798 Jul 30 21:18:35.118671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2212/4371] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:35.127158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:35.130115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:35.142316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.142966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.143958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.145095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.178362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:35.430284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.440964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.443011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.445066 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-684df024-a22f-4117-a147-1bb1275c6bd4 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 0.808352 Jul 30 21:18:35.445865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2160/4372] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:34 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:35.451513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:35.452325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:35.469039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.470978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.472388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.473179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.513739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.523427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.524940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.526511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9e86910-ee67-4d73-b09a-e07152de1ac0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2752 microversion: 2.32 time: 0.406670 Jul 30 21:18:35.527227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2213/4373] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:35 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2752 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:35.531930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:35.532747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:35.540747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.541414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.544954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:35.545616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:35.801217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:35.815060 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e27d7828-be1a-4a73-ab83-dff55587f485 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1309 microversion: 2.1 time: 0.367640 Jul 30 21:18:35.815960 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2161/4374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:35 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:36.064107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:36.065305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:36.074927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:36.100938 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c7f47e7-ac75-4d7a-8e63-be82901f3a79 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1509 microversion: 2.1 time: 0.564721 Jul 30 21:18:36.102072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.103124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.104346 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2214/4375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:35 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1509 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:36.106878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.107857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.121054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:36.448762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:36.463654 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94dca2ee-9b9d-42a1-8bc2-3dc87d9ad79c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.407053 Jul 30 21:18:36.464775 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2162/4376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:36 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:36.472800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:36.474015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:36.500389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.500864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.502730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.503580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.559254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:36.561107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:36.576178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.576815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.577735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.579056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.795897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:36.808441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:36.809922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:36.812175 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-542da308-6bad-4ac6-bab0-57b5e4e36208 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2705 microversion: 2.32 time: 0.260701 Jul 30 21:18:36.812832 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2163/4377] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:36 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2705 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:36.817458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ef6fd14b-c74f-4fbd-91af-a0741620c84e req-a267b792-e7b2-4529-95f0-be4e2e24de3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-deleted", "tag": "40231132-6acc-42a8-bb4d-8ed3653ce2d5"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:36.828911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef6fd14b-c74f-4fbd-91af-a0741620c84e req-a267b792-e7b2-4529-95f0-be4e2e24de3c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.829575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ef6fd14b-c74f-4fbd-91af-a0741620c84e req-a267b792-e7b2-4529-95f0-be4e2e24de3c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.846681 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ef6fd14b-c74f-4fbd-91af-a0741620c84e req-a267b792-e7b2-4529-95f0-be4e2e24de3c service nova] Creating event network-vif-deleted:40231132-6acc-42a8-bb4d-8ed3653ce2d5 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:36.853350 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ef6fd14b-c74f-4fbd-91af-a0741620c84e req-a267b792-e7b2-4529-95f0-be4e2e24de3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Jul 30 21:18:36.854303 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2164/4378] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:36.867202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:36.870292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:36.897364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.899968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:36.901896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:36.902816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.212334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:37.266850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:37.278357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2f2e1ac7-23fa-48b0-a967-03e81704ea4f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1490 microversion: 2.1 time: 0.422654 Jul 30 21:18:37.279374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2165/4379] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:36 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:37.286239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:37.287720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:37.300999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.301752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.303640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.304467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.549483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:37.570257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:37.572345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:37.573796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b297846c-c1ce-4324-8c09-b959bcc81f67 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1868 microversion: 2.42 time: 1.109607 Jul 30 21:18:37.575878 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2215/4380] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:36 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1868 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:18:37.583830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:37.587806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:37.588178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:37.596369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.596933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.598056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.598757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.600467 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b06a0c0a-d98f-4910-a7c9-c66feaacca00 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1512 microversion: 2.1 time: 0.317172 Jul 30 21:18:37.604216 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2166/4381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:37 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:37.614925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:37.615807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:37.629009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.629618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.631251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.632095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.831809 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b5ced73-22c8-49b5-8f96-587a5ab46409 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "PUT /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1085 microversion: 2.1 time: 0.253180 Jul 30 21:18:37.841449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2216/4382] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:18:37 2022] PUT /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1085 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:37.857210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:37.859868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:37.889605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.890403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:37.894908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:37.895901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.295868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:38.305162 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-97896c68-11ac-4b92-8236-436628077c30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.699075 Jul 30 21:18:38.305776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2167/4383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:37 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:38.330031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:38.330673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:38.338962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.339454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.340254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.340712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.724252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:38.742525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:38.746910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:38.751394 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0265d534-b897-404d-8ade-6712ad0221ed tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2819 microversion: 2.32 time: 0.433735 Jul 30 21:18:38.752690 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2168/4384] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:38 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2819 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:38.764725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:38.766562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:38.776497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.777194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.779107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.779776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.907598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:38.918161 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f9e3a4b-903a-443c-9e12-54289f1ba3af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1452 microversion: 2.1 time: 1.075104 Jul 30 21:18:38.919380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2217/4385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:37 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1452 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:38.925013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:38.925865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:38.932978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.933621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:38.934564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:38.936140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.182622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:39.193498 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4853951d-d44c-48f7-b53e-75c36fa0027e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1511 microversion: 2.1 time: 0.437996 Jul 30 21:18:39.194100 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2169/4386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:38 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:39.202269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0e3eb847-bff8-4d00-a371-bf5752859ff8 req-9132757d-f617-48ca-8746-262572070225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-deleted", "tag": "503e2e21-98ad-4fe8-9233-11811cd01426"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:39.232617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0e3eb847-bff8-4d00-a371-bf5752859ff8 req-9132757d-f617-48ca-8746-262572070225 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.233079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0e3eb847-bff8-4d00-a371-bf5752859ff8 req-9132757d-f617-48ca-8746-262572070225 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.249443 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0e3eb847-bff8-4d00-a371-bf5752859ff8 req-9132757d-f617-48ca-8746-262572070225 service nova] Creating event network-vif-deleted:503e2e21-98ad-4fe8-9233-11811cd01426 for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:39.269982 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0e3eb847-bff8-4d00-a371-bf5752859ff8 req-9132757d-f617-48ca-8746-262572070225 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074617 Jul 30 21:18:39.270860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2170/4387] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:39.285905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:39.286881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:39.302736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.304193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.305225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.307877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.371153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lazy-loading 'flavor' on Instance uuid e0e21266-f697-4bd9-be1f-25ea0305e00c {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:39.402490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'shelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state shelved_offloaded Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 14 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: {"shelve": {}} Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'shelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state shelved_offloaded Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'shelve': {}}} Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 30 21:18:39.404619 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state shelved_offloaded Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state shelved_offloaded Jul 30 21:18:39.408043 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:39.410411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'shelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state shelved_offloaded {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:39.411541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c50f37b4-3393-4664-9d99-4d78ddfac5e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 155 microversion: 2.1 time: 0.138792 Jul 30 21:18:39.412400 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2171/4388] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:18:39 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 155 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:18:39.426151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:39.427266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:39.442505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.443314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.445905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.448832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.766590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:39.776984 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ebbc8c7-4e6d-42c2-b648-929d560bc6b1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1511 microversion: 2.1 time: 0.363276 Jul 30 21:18:39.783175 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2172/4389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:39 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:39.796024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:39.797268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:39.812515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.813040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.814017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.814665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.887781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:39.900086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:39.902101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:39.903595 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef963e18-4f5e-4289-9bf5-c5d6dd17762d tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2826 microversion: 2.42 time: 0.983015 Jul 30 21:18:39.904359 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2218/4390] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:38 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2826 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:39.910487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:39.912155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:39.919689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.920943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.922815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:39.924516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:39.976107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130984) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 21:18:40.085512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:40.088124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2111370f-6430-4966-b407-eb1e0446e2c1 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.182116 Jul 30 21:18:40.089225 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2219/4391] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:18:39 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:18:40.096517 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-736c4e9e-a75f-4c44-9a88-7eb461902938 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.311483 Jul 30 21:18:40.097028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:40.097788 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2173/4392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:39 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:40.105040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:40.105957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:40.112739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.113505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.114510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.114796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:40.116588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.123038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.123038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.126770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.127259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.189117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:18:40.286360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:40.372649 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ad767ce-9b51-42b1-b0a6-d70565115270 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 204 len: 0 microversion: 2.1 time: 0.272077 Jul 30 21:18:40.373612 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2174/4393] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:18:40 2022] DELETE /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:18:40.389053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:40.390224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:40.403082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.406261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.407183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.407685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.671641 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41fbccec-b567-4846-9e60-ae2f06879003 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.296707 Jul 30 21:18:40.688660 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2175/4394] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:18:40 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444/os-interface => generated 1831 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:40.698609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:40.699370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:40.717346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.717818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.718619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.719343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.915058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:40.942750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:40.954532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:40.955892 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-efa8a1d8-ea4e-41b6-8a31-5e8893a61edd tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2658 microversion: 2.32 time: 0.865555 Jul 30 21:18:40.956473 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2220/4395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:40 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2658 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:40.968780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:40.975040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:40.987609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.995099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:40.996029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:40.996487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:41.934796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:41.945946 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-33a44904-c539-43d2-b256-47c799a25e5e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1460 microversion: 2.1 time: 1.255039 Jul 30 21:18:41.946641 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2176/4396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:40 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1460 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:41.952525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:41.954492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:41.955160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:41.965782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:41.967565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:41.968031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:41.968557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df89d291-c655-42db-a9e3-fa2d590b8d1a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1517 microversion: 2.1 time: 1.007693 Jul 30 21:18:41.968824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:41.969330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:41.971540 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2221/4397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:40 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1517 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:41.997852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:42.018081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:42.035314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:42.037981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:42.038813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:42.039384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:42.532417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:42.550343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0361559f-bfa5-4b40-b4b3-d44c980ce444 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.601775 Jul 30 21:18:42.554314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2177/4398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:41 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:42.698874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:42.711947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:42.713477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:42.714767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a05f0bb-2e6a-4621-9039-5d321a1e246a tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2658 microversion: 2.32 time: 0.731062 Jul 30 21:18:42.722498 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2222/4399] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:41 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2658 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:42.969387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:42.976246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:42.998034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:43.004379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:43.033055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.033540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:43.034453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.034908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:43.040345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.042488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:43.043506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.048766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:43.694686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:43.703823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ba92689-e85a-4162-8187-32b0964bb1e4 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.738579 Jul 30 21:18:43.716894 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2178/4400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:42 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:43.726766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:43.727741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:43.736183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.737069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:43.738259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:43.738992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.137635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:44.158219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37ecfce1-c1a2-4b4e-8646-885cf9ff1d05 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1517 microversion: 2.1 time: 1.164086 Jul 30 21:18:44.158891 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2223/4401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:42 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1517 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:44.166968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:44.174915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:44.182586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:44.183221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.184380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:44.185042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.248021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:44.257843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-df28fa42-fd83-4645-813d-ce79c396f53b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.535711 Jul 30 21:18:44.272643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2179/4402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:43 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:44.277595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bd3d2735-3f13-4889-a67f-5aa2c38130e1 req-8694d42b-aa00-4525-97f0-dd3cd2a1f02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-deleted", "tag": "ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:44.290934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd3d2735-3f13-4889-a67f-5aa2c38130e1 req-8694d42b-aa00-4525-97f0-dd3cd2a1f02f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:44.292058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bd3d2735-3f13-4889-a67f-5aa2c38130e1 req-8694d42b-aa00-4525-97f0-dd3cd2a1f02f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.307599 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bd3d2735-3f13-4889-a67f-5aa2c38130e1 req-8694d42b-aa00-4525-97f0-dd3cd2a1f02f service nova] Creating event network-vif-deleted:ee8284e6-d1bb-4dc8-8dbb-848d4b30e96c for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:44.313547 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bd3d2735-3f13-4889-a67f-5aa2c38130e1 req-8694d42b-aa00-4525-97f0-dd3cd2a1f02f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039498 Jul 30 21:18:44.314455 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2180/4403] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:44.728299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:44.729263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:44.743411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:44.744144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.753771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:44.754471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:44.856075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:44.875419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:44.877926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:44.879720 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-99bb21d2-18dc-41b8-bc0f-5de03e9beec9 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2611 microversion: 2.32 time: 0.719731 Jul 30 21:18:44.881842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2224/4404] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:44 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2611 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:45.043335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-77a9d450-38ba-4015-912c-b0b49be959a2 req-a2ea2837-ea1c-4e41-add9-d2c73b72dde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "tag": "ebb280be-9aa4-4c83-8b08-5bb73d1e6a07"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:45.065220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-77a9d450-38ba-4015-912c-b0b49be959a2 req-a2ea2837-ea1c-4e41-add9-d2c73b72dde6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.066058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-77a9d450-38ba-4015-912c-b0b49be959a2 req-a2ea2837-ea1c-4e41-add9-d2c73b72dde6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.080280 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-77a9d450-38ba-4015-912c-b0b49be959a2 req-a2ea2837-ea1c-4e41-add9-d2c73b72dde6 service nova] Creating event network-changed:ebb280be-9aa4-4c83-8b08-5bb73d1e6a07 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:18:45.113360 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-77a9d450-38ba-4015-912c-b0b49be959a2 req-a2ea2837-ea1c-4e41-add9-d2c73b72dde6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073644 Jul 30 21:18:45.114447 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2225/4405] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:45.148406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:45.165662 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f597369-55eb-453c-99d6-8f526fdc0519 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.441598 Jul 30 21:18:45.179176 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2181/4406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:44 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:45.181511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:45.182574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:45.196788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.196788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.203167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.203944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.278743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:45.280008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:45.292101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.292918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.294027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.294669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.309246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:45.310048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:45.313219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lazy-loading 'fault' on Instance uuid 13b557a2-3be4-4f7a-bf6f-169e16b515db {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:18:45.933141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:45.942848 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49b65cb0-ff28-4854-a77b-25b314fca11b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 200 len: 1320 microversion: 2.1 time: 0.766233 Jul 30 21:18:45.945623 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2226/4407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:45 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 1320 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:45.957582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-731c4561-a950-41e0-ac81-e8a3f7859484 req-6cb7824f-83f0-4cf9-b92b-77d1f144e89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-plugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:45.960148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:45.972477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f58a29f-ab45-4e76-8184-333e56f859ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.697751 Jul 30 21:18:45.973806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2182/4408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:45 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:45.983047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:45.986225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:46.002465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.003827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.006718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.007604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.014927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-731c4561-a950-41e0-ac81-e8a3f7859484 req-6cb7824f-83f0-4cf9-b92b-77d1f144e89c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.015415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-731c4561-a950-41e0-ac81-e8a3f7859484 req-6cb7824f-83f0-4cf9-b92b-77d1f144e89c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.045682 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-731c4561-a950-41e0-ac81-e8a3f7859484 req-6cb7824f-83f0-4cf9-b92b-77d1f144e89c service nova] Creating event network-vif-plugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:18:46.064644 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-731c4561-a950-41e0-ac81-e8a3f7859484 req-6cb7824f-83f0-4cf9-b92b-77d1f144e89c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115304 Jul 30 21:18:46.082252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2227/4409] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:46.187237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:46.187966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:46.201685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.202147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.203146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.203954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.637608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:46.649357 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9500e8b-3526-496a-a91f-51fc081e60b9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.466242 Jul 30 21:18:46.650745 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2228/4410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:46 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:46.657080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3bfd01b6-ec19-47f3-bddc-072d58d0ba08 req-ac14a568-7b3e-40f4-97b5-9c76f45c01d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b557a2-3be4-4f7a-bf6f-169e16b515db", "name": "network-vif-deleted", "tag": "c620cbd0-1168-4f98-bc2b-db0922f436ac"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:46.667961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3bfd01b6-ec19-47f3-bddc-072d58d0ba08 req-ac14a568-7b3e-40f4-97b5-9c76f45c01d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.668689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3bfd01b6-ec19-47f3-bddc-072d58d0ba08 req-ac14a568-7b3e-40f4-97b5-9c76f45c01d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.681863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3bfd01b6-ec19-47f3-bddc-072d58d0ba08 req-ac14a568-7b3e-40f4-97b5-9c76f45c01d6 service nova] Creating event network-vif-deleted:c620cbd0-1168-4f98-bc2b-db0922f436ac for instance 13b557a2-3be4-4f7a-bf6f-169e16b515db on nch1-master-1 Jul 30 21:18:46.687215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3bfd01b6-ec19-47f3-bddc-072d58d0ba08 req-ac14a568-7b3e-40f4-97b5-9c76f45c01d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Jul 30 21:18:46.689070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2229/4411] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:46.696652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:46.707153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:46.709236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4fc3f756d034b339878ee04f0469df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2471207e4614f369934b1723545d1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:46.713121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-551dec3d-7a01-455b-b489-b07ea15021fc tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 200 len: 2326 microversion: 2.32 time: 0.737782 Jul 30 21:18:46.714478 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2183/4412] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:45 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 2326 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:18:46.966600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:46.967409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:46.980094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.981582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:46.982444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:46.982901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:47.001820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:47.002459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:47.026440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:47.027332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:47.029035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:47.031445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:47.041156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:47.044272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db HTTP/1.1 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '13b557a2-3be4-4f7a-bf6f-169e16b515db'} Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:47.048734 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:18:47.054199 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:47.057906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:47.071896 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3df77a0a-3642-4536-8e80-90de4382fa19 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 404 len: 111 microversion: 2.1 time: 0.097207 Jul 30 21:18:47.075896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2230/4413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:46 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:18:47.289794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-39825561-5967-4cee-888c-2cff2d0f8d86 req-fb58fff9-3af0-435c-991f-a025449e08b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:47.325785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-39825561-5967-4cee-888c-2cff2d0f8d86 req-fb58fff9-3af0-435c-991f-a025449e08b0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:47.327715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-39825561-5967-4cee-888c-2cff2d0f8d86 req-fb58fff9-3af0-435c-991f-a025449e08b0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:47.363677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-39825561-5967-4cee-888c-2cff2d0f8d86 req-fb58fff9-3af0-435c-991f-a025449e08b0 service nova] Creating event network-changed:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch1-master-1 Jul 30 21:18:47.384071 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-39825561-5967-4cee-888c-2cff2d0f8d86 req-fb58fff9-3af0-435c-991f-a025449e08b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097533 Jul 30 21:18:47.386598 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2231/4414] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:47.403073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1806220076", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "ce554685-2f17-4407-82ae-f330f21f82a2"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:47.511471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] validate_networks() for [('ce554685-2f17-4407-82ae-f330f21f82a2', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:18:47.595720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:47.604421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-497973b4-0a96-43bf-9dba-7e140d04db97 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1362 microversion: 2.1 time: 0.612736 Jul 30 21:18:47.619836 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2184/4415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:46 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:47.672273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:47.673264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:47.684767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:47.685473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:47.686521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:47.687828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:48.181584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:48.190745 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e2d7a31-d6ce-4c50-afd5-bb3137b7f520 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.522311 Jul 30 21:18:48.195580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2185/4416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:47 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:48.200587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:48.205415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:48.227057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:48.227915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:48.228934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:48.229588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:48.248781 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] HTTP exception thrown: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Request method failure captured: Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 HTTP/1.1 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z7BledVEZYE2extyTpZ2u-0SJ8j7jXJgsDX6qXBU9tRVWLZw6UX2Gx23pseEz3IdlAR5m2FYYXLzfxuKaV0_6ExjWJ86AvNGIle-sUwFdTmjwLrvQo3KKgCHde1uvHA7tdj_MPrdq9BdLZ2UreropEElGnclSrwp10aLhQuEN5PDcY Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.32 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a2471207e4614f369934b1723545d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a2471207e4614f369934b1723545d1f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4fc3f756d034b339878ee04f0469df0 Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '90701ee7-55f0-4469-8175-0099008dabb2'} Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:48.250896 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:18:48.254718 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:18:48.256767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Returning 404 to user: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:48.257903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41857413-852d-42e5-9590-6395ae26629f tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 404 len: 111 microversion: 2.32 time: 0.061100 Jul 30 21:18:48.259009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2186/4417] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:18:48 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:18:48.267179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1991b129-8811-4852-b898-5f0fdfff2eb0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '.version_select at 0x7fbb5cfe9d30>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:48.293501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1991b129-8811-4852-b898-5f0fdfff2eb0 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595914193" status: 204 len: 0 microversion: 2.32 time: 0.029749 Jul 30 21:18:48.299507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2187/4418] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 30 21:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595914193 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:18:48.633564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:48.634325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:48.650112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:48.650852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:48.651923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:48.652583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:49.803615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:18:49.805205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:18:49.806639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:18:49.808437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:18:49.809065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:18:49.849919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:49.859584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:49.860872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:49.872128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:49.935583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:49.960276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Getting quotas for user 4a01092bfa5a4118a5fe61a6dc9c5460 and project acc6c23a959246638169178d6a5acd4c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:50.033311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:18:50.037733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:18:50.185725 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3f792d3c-2abf-45c8-8264-ef7e4a863d9d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.796838 Jul 30 21:18:50.192573 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2232/4419] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:18:50.209060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e965be90-8157-4a56-b73d-c7b06cb9d061 req-abf64893-abbd-4ea2-a7be-5cbe1a7586e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90701ee7-55f0-4469-8175-0099008dabb2", "name": "network-vif-deleted", "tag": "32311821-607a-46ad-9d0a-cdee0d878cac"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:50.266047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e965be90-8157-4a56-b73d-c7b06cb9d061 req-abf64893-abbd-4ea2-a7be-5cbe1a7586e4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:50.270695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e965be90-8157-4a56-b73d-c7b06cb9d061 req-abf64893-abbd-4ea2-a7be-5cbe1a7586e4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:50.284340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:50.299432 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a291f9a-c50b-431e-ba08-b4ed7436c0dc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1548 microversion: 2.1 time: 1.670376 Jul 30 21:18:50.305342 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2188/4420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:48 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1548 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:50.319947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:50.320797 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e965be90-8157-4a56-b73d-c7b06cb9d061 req-abf64893-abbd-4ea2-a7be-5cbe1a7586e4 service nova] Creating event network-vif-deleted:32311821-607a-46ad-9d0a-cdee0d878cac for instance 90701ee7-55f0-4469-8175-0099008dabb2 on nch1-master-1 Jul 30 21:18:50.324519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:50.328864 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e965be90-8157-4a56-b73d-c7b06cb9d061 req-abf64893-abbd-4ea2-a7be-5cbe1a7586e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134460 Jul 30 21:18:50.333386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2233/4421] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:50.359897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-86e17969-f15b-405a-bca1-79a4be760dd1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:50.361344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-86e17969-f15b-405a-bca1-79a4be760dd1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:50.365320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:50.366080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:50.371461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:50.371907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:50.863636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:50.909696 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be5e631a-f347-47a8-9788-f79cc9e311ea tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.600051 Jul 30 21:18:50.923331 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2189/4422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:50 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:50.933364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:50.936105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:50.946150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-86e17969-f15b-405a-bca1-79a4be760dd1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:50.960102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:50.962048 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-86e17969-f15b-405a-bca1-79a4be760dd1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1209 microversion: 2.1 time: 0.626383 Jul 30 21:18:50.963207 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2234/4423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:50 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1209 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:50.973642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:50.977217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:50.978993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:51.511817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2e3440b6-e2b3-4c7e-8232-f388b25e59e5 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.592567 Jul 30 21:18:51.513051 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2190/4424] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:18:50 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/os-interface => generated 284 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:51.933523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:51.934534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:51.941706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:51.953498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:51.954787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:51.955847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:51.956519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:51.986718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:51.993453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:52.021555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:52.027829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:52.034095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:52.034905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:52.498681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:52.525279 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-034e01a6-1107-4092-b8cb-dd02d99e1a6b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1261 microversion: 2.1 time: 0.542213 Jul 30 21:18:52.555687 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2191/4425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:51 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1261 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:53.556365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:53.558243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:53.558425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:53.573052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:53.576156 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ddaefdb-b650-46ed-81a0-6ee9dd271b47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 1.641743 Jul 30 21:18:53.576567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:53.579804 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2235/4426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:51 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:53.593613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:53.597255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:53.802561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:53.824698 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cab6f814-a5fb-4a94-8abd-685e0a6dd79e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1267 microversion: 2.1 time: 0.275092 Jul 30 21:18:53.840694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2192/4427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:53 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:54.616842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:54.618679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:54.637262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:54.637748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:54.638567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:54.639029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:54.854560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:54.856091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:54.876164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:54.879910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:54.883328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:54.883814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:55.442030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:55.451234 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-835f57fd-3d8b-44ff-b5d4-d32a5ec8ecdc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.849580 Jul 30 21:18:55.470542 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2236/4428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:54 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:55.761264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:55.776660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eb8877a0-25d0-4bc6-99b0-fe5dd49d79ed tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1267 microversion: 2.1 time: 0.927870 Jul 30 21:18:55.791791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2193/4429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:54 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1267 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:56.480799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:56.481445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:56.511560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:56.518115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:56.519814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:56.522103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:56.800018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:56.802670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:56.860804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:56.861292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:56.862142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:56.870703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:56.897922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:57.315867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:57.341554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d593f93c-465c-4ed5-ab63-c533ce2bd522 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.849611 Jul 30 21:18:57.355909 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2237/4430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:56 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:57.486596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Action: 'create', calling method: .version_select at 0x7fbb4fc523a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:57.529905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Getting quotas for project cab0816ccd114c45b178df1c7ede5705. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:57.546230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Getting quotas for user 3c77b6ab96684386ace13eef85513e9f and project cab0816ccd114c45b178df1c7ede5705. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:57.625666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Getting quotas for project cab0816ccd114c45b178df1c7ede5705. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:18:57.637893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Getting quotas for user 3c77b6ab96684386ace13eef85513e9f and project cab0816ccd114c45b178df1c7ede5705. Resources: {'server_groups'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:18:57.659180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bceb8c2a-56fe-4001-915f-5d02929ebf74 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.301242 Jul 30 21:18:57.660534 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2238/4431] 10.222.0.17 () {62 vars in 1214 bytes} [Sat Jul 30 21:18:57 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:18:57.685614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-34896ddb-3f42-4c43-810f-5f6b391323e0 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:57.731352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-34896ddb-3f42-4c43-810f-5f6b391323e0 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.063158 Jul 30 21:18:57.735475 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2239/4432] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 30 21:18:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:18:57.754989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-1d99ce0b-e97e-45ab-9acf-ea3025b7d94d req-7bf4510f-c43e-4893-a5fe-5b7e41abaf1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:57.814634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d99ce0b-e97e-45ab-9acf-ea3025b7d94d req-7bf4510f-c43e-4893-a5fe-5b7e41abaf1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:57.814634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-1d99ce0b-e97e-45ab-9acf-ea3025b7d94d req-7bf4510f-c43e-4893-a5fe-5b7e41abaf1e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:57.877075 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-1d99ce0b-e97e-45ab-9acf-ea3025b7d94d req-7bf4510f-c43e-4893-a5fe-5b7e41abaf1e service nova] Creating event network-changed:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:18:57.897124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-1d99ce0b-e97e-45ab-9acf-ea3025b7d94d req-7bf4510f-c43e-4893-a5fe-5b7e41abaf1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158950 Jul 30 21:18:57.904474 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2240/4433] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:57.929016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17702ac5-74b9-413b-a0ea-911626c851b3 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:57.951356 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17702ac5-74b9-413b-a0ea-911626c851b3 tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be" status: 200 len: 235 microversion: 2.64 time: 0.044667 Jul 30 21:18:57.956213 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2241/4434] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Jul 30 21:18:57 2022] GET /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be => generated 235 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:18:57.978239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8aab22f-3450-4a36-af1e-ef61a1fae20e tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:58.061578 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8aab22f-3450-4a36-af1e-ef61a1fae20e tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be" status: 204 len: 0 microversion: 2.64 time: 0.088185 Jul 30 21:18:58.063722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2242/4435] 10.222.0.17 () {60 vars in 1307 bytes} [Sat Jul 30 21:18:57 2022] DELETE /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 30 21:18:58.081842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b0a128b-d2a3-4899-a9e6-9b0340c19ddf tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:58.113311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4b0a128b-d2a3-4899-a9e6-9b0340c19ddf tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] HTTP exception thrown: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b0a128b-d2a3-4899-a9e6-9b0340c19ddf tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Request method failure captured: Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be HTTP/1.1 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aBBEeqDXYR7w_v11qlN2AFdOprVW8Tj8Ei5iWVD-5JtEaFk4ywebLclxF-KuKhDfHQZquxX71qwXm8D4YRzsYww05WFgdEwRiCejuti08Op7azwIoeQfa1q-m7RB0nv8vlKQp1v5P3inO_aswrs6uaJzLnyIyGB3uPkThBtUJkNyJU Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.64 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cab0816ccd114c45b178df1c7ede5705 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerGroup264TestJSON-1738688062 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cab0816ccd114c45b178df1c7ede5705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cab0816ccd114c45b178df1c7ede5705", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cab0816ccd114c45b178df1c7ede5705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cab0816ccd114c45b178df1c7ede5705"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerGroup264TestJSON-1738688062 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cab0816ccd114c45b178df1c7ede5705 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1738688062 Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerGroup264TestJSON-1738688062-project Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 3c77b6ab96684386ace13eef85513e9f Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerGroup264TestJSON-1738688062-project Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'fa422495-f26e-48f8-be71-e5a0c8aa86be'} Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:58.125215 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. Jul 30 21:18:58.129547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:18:58.133650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b0a128b-d2a3-4899-a9e6-9b0340c19ddf tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] Returning 404 to user: Instance group fa422495-f26e-48f8-be71-e5a0c8aa86be could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:18:58.139330 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b0a128b-d2a3-4899-a9e6-9b0340c19ddf tempest-ServerGroup264TestJSON-1738688062 tempest-ServerGroup264TestJSON-1738688062-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be" status: 404 len: 117 microversion: 2.64 time: 0.068714 Jul 30 21:18:58.142914 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2243/4436] 10.222.0.17 () {60 vars in 1307 bytes} [Sat Jul 30 21:18:58 2022] DELETE /compute/v2.1/os-server-groups/fa422495-f26e-48f8-be71-e5a0c8aa86be => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:18:58.373075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:58.374209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:58.392724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:58.395599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:58.413995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:58.414651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:58.926473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:58.935806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4525622-6891-48f4-90f5-750c92f24cd6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 2.140569 Jul 30 21:18:58.953911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:18:58.961272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2f73317-c9f3-4b41-97d9-0c1a21d9085d tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.596685 Jul 30 21:18:58.975532 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2244/4438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:58 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:18:58.978959 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2194/4438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:56 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:18:59.712352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-455f0573-0c36-42df-b119-899832981e54 req-0ab38dfc-3a11-482f-888c-456b25c497ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0533b6d5-7589-4f50-935b-c764ce6c3138", "tag": "435de4da-174c-4e6c-acda-2230159148e4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:18:59.748688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-455f0573-0c36-42df-b119-899832981e54 req-0ab38dfc-3a11-482f-888c-456b25c497ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:59.749409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-455f0573-0c36-42df-b119-899832981e54 req-0ab38dfc-3a11-482f-888c-456b25c497ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:59.774363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-455f0573-0c36-42df-b119-899832981e54 req-0ab38dfc-3a11-482f-888c-456b25c497ca service nova] Creating event network-changed:435de4da-174c-4e6c-acda-2230159148e4 for instance 0533b6d5-7589-4f50-935b-c764ce6c3138 on nch1-master-1 Jul 30 21:18:59.779548 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-455f0573-0c36-42df-b119-899832981e54 req-0ab38dfc-3a11-482f-888c-456b25c497ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072578 Jul 30 21:18:59.780684 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2245/4439] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:18:59.967282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:59.968216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:59.985448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:59.990923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:18:59.991678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:18:59.993346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:59.993346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:18:59.993346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:18:59.995139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:00.018006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:00.018466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:00.019264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:00.023924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:00.494393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:00.508267 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a842a110-c897-4f98-bd3f-1f635b7c4ba9 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.523757 Jul 30 21:19:00.511724 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2246/4440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:59 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:01.512212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:01.526269 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbe474bb-28df-4118-802d-f18dcbb8947e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 1.563144 Jul 30 21:19:01.533424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:01.544511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:01.547410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2195/4441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:18:59 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:01.574692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:01.575732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:01.576806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:01.577477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:02.234300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:02.256916 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f6218e4-162a-4d96-aa31-314aa88c948c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.727612 Jul 30 21:19:02.261602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2247/4442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:01 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:02.557988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:02.559446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:02.579475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:02.580072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:02.582703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:02.583799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:03.286913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:03.288817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:03.304269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:03.306918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:03.311510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:03.312360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:03.337222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:03.347918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-103eeda3-46d6-4c06-9eba-176d258f523e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 0.799181 Jul 30 21:19:03.352908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2196/4443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:02 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:03.936292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:03.967338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6de74e45-476d-418e-b584-8bc4fccc4e8a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.676063 Jul 30 21:19:03.967338 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2248/4444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:03 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:04.377564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:04.378475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:04.400064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:04.404635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:04.417324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:04.420952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:04.776250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:04.846776 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-54e13a90-dc86-4684-aed4-96144c3c647b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 0.463825 Jul 30 21:19:04.853330 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2197/4445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:04 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:04.987670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:04.988284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:05.038503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:05.041922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:05.044933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:05.045422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:05.744564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:05.759326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e16a8f8-bff5-4067-bf2d-401f04026ffe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.775679 Jul 30 21:19:05.761469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2249/4446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:04 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:05.874541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:05.876301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:05.911752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:05.914877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:05.918938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:05.923074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.027396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:06.028165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:06.041202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.041925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.042992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.043739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.077430 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] HTTP exception thrown: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Request method failure captured: Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 HTTP/1.1 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z7BledVEZYE2extyTpZ2u-0SJ8j7jXJgsDX6qXBU9tRVWLZw6UX2Gx23pseEz3IdlAR5m2FYYXLzfxuKaV0_6ExjWJ86AvNGIle-sUwFdTmjwLrvQo3KKgCHde1uvHA7tdj_MPrdq9BdLZ2UreropEElGnclSrwp10aLhQuEN5PDcY Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.32 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a2471207e4614f369934b1723545d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a2471207e4614f369934b1723545d1f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c4fc3f756d034b339878ee04f0469df0 Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '90701ee7-55f0-4469-8175-0099008dabb2'} Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:06.081513 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.086079 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.088129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Returning 404 to user: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:06.089606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c542bc8a-e2ac-472c-a77d-68fc503a2587 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 404 len: 111 microversion: 2.32 time: 0.066658 Jul 30 21:19:06.090971 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2250/4447] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:19:06 2022] DELETE /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:19:06.099879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:06.100944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] [instance: 90701ee7-55f0-4469-8175-0099008dabb2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:06.108907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.109801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.110983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.111631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.133452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] HTTP exception thrown: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Request method failure captured: Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 HTTP/1.1 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z7BledVEZYE2extyTpZ2u-0SJ8j7jXJgsDX6qXBU9tRVWLZw6UX2Gx23pseEz3IdlAR5m2FYYXLzfxuKaV0_6ExjWJ86AvNGIle-sUwFdTmjwLrvQo3KKgCHde1uvHA7tdj_MPrdq9BdLZ2UreropEElGnclSrwp10aLhQuEN5PDcY Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.32 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a2471207e4614f369934b1723545d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a2471207e4614f369934b1723545d1f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2471207e4614f369934b1723545d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: a2471207e4614f369934b1723545d1f3 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1391871096 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c4fc3f756d034b339878ee04f0469df0 Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TaggedBootDevicesTest-1391871096-project Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '90701ee7-55f0-4469-8175-0099008dabb2'} Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:06.136111 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. Jul 30 21:19:06.141543 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:06.144668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] Returning 404 to user: Instance 90701ee7-55f0-4469-8175-0099008dabb2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:06.145997 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1f54e83-0c92-471f-817f-2e643b7a8539 tempest-TaggedBootDevicesTest-1391871096 tempest-TaggedBootDevicesTest-1391871096-project] 10.222.0.17 "GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2" status: 404 len: 111 microversion: 2.32 time: 0.050550 Jul 30 21:19:06.149848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2251/4448] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:19:06 2022] GET /compute/v2.1/servers/90701ee7-55f0-4469-8175-0099008dabb2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:19:06.566254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:06.575094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7843465d-4f76-427a-878e-ae89e3845132 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 0.707202 Jul 30 21:19:06.578857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2198/4449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:05 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:06.784713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:06.787155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:06.800247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.809483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.811061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:06.817451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:06.974980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-84252c21-832f-4497-8631-0d371286660e req-e30b700f-6f66-4b19-afc3-8619be9b13a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0533b6d5-7589-4f50-935b-c764ce6c3138", "name": "network-vif-plugged", "status": "completed", "tag": "435de4da-174c-4e6c-acda-2230159148e4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:07.010054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-84252c21-832f-4497-8631-0d371286660e req-e30b700f-6f66-4b19-afc3-8619be9b13a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:07.019663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-84252c21-832f-4497-8631-0d371286660e req-e30b700f-6f66-4b19-afc3-8619be9b13a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:07.069389 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-84252c21-832f-4497-8631-0d371286660e req-e30b700f-6f66-4b19-afc3-8619be9b13a2 service nova] Creating event network-vif-plugged:435de4da-174c-4e6c-acda-2230159148e4 for instance 0533b6d5-7589-4f50-935b-c764ce6c3138 on nch1-master-1 Jul 30 21:19:07.078745 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-84252c21-832f-4497-8631-0d371286660e req-e30b700f-6f66-4b19-afc3-8619be9b13a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118017 Jul 30 21:19:07.083683 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2199/4450] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:07.603025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:07.603989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:07.619550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:07.621765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:07.624031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:07.630948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:07.651493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:07.679327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:07.698596 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-557abc99-01f3-4c98-b141-530b1365fefb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.919775 Jul 30 21:19:07.711321 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2252/4451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:06 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:08.030187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:08.050696 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4eaf2c81-7f9a-413c-8ab4-8f2e06576940 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1309 microversion: 2.1 time: 0.453569 Jul 30 21:19:08.072184 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2200/4452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:07 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1309 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:08.733663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:08.735094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:08.746689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:08.747047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:08.750683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:08.751172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.081632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:09.082408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:09.102677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.103424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.105171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.107124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.214183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:09.223241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2c61ce7-5cbb-4189-bf8c-048322107139 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.500471 Jul 30 21:19:09.227934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2253/4453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:08 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:09.236116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d31fdea8-e1b3-4c51-8be4-73bc753e9cd8 req-813e0f5f-1c31-4f8f-a38e-376e79359eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "name": "network-vif-plugged", "status": "completed", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:09.247478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d31fdea8-e1b3-4c51-8be4-73bc753e9cd8 req-813e0f5f-1c31-4f8f-a38e-376e79359eb9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.247992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d31fdea8-e1b3-4c51-8be4-73bc753e9cd8 req-813e0f5f-1c31-4f8f-a38e-376e79359eb9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.283494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d31fdea8-e1b3-4c51-8be4-73bc753e9cd8 req-813e0f5f-1c31-4f8f-a38e-376e79359eb9 service nova] Creating event network-vif-plugged:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch1-master-1 Jul 30 21:19:09.294336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d31fdea8-e1b3-4c51-8be4-73bc753e9cd8 req-813e0f5f-1c31-4f8f-a38e-376e79359eb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061288 Jul 30 21:19:09.295127 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2254/4454] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:09.562376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:09.581761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1beb10ed-5dff-4958-bcb2-db00b88f9682 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1490 microversion: 2.1 time: 0.506783 Jul 30 21:19:09.600918 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2201/4455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:09 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1490 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:09.615175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1093571492"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:09.618159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:09.654788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.656438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.661736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.665162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.783913 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4eab531-938a-4a3b-b347-b390b0fe5f2c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "PUT /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1075 microversion: 2.1 time: 0.181095 Jul 30 21:19:09.795255 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2255/4456] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:19:09 2022] PUT /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1075 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:09.814290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:09.815045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:09.825002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.825767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:09.826660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:09.827272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.142495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:10.155068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-629e4bee-2b61-48ee-aee2-06c21e3123f2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1501 microversion: 2.1 time: 0.345958 Jul 30 21:19:10.155996 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2202/4457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:09 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1501 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:10.175271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:10.175947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:10.194531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:10.195862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.196879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:10.197700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.249974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:10.250581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:10.260518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:10.260996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.262007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:10.262989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.453428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:10.462486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d4227f0-52f0-408b-a02b-17bdf61be9f6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.216958 Jul 30 21:19:10.463093 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2203/4458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:10 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:10.903491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:10.916362 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fce0de25-d606-45b7-988d-a90b4aee4b74 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1501 microversion: 2.1 time: 0.745156 Jul 30 21:19:10.932615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2256/4459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:10 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1501 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:10.940752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef313a91-5fb0-48cd-a075-ce2c0235b2ee tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:10.949092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef313a91-5fb0-48cd-a075-ce2c0235b2ee tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:10.949770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef313a91-5fb0-48cd-a075-ce2c0235b2ee tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:10.985834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef313a91-5fb0-48cd-a075-ce2c0235b2ee tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Going to try to stop instance {{(pid=130984) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:19:11.009434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:11.090991 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef313a91-5fb0-48cd-a075-ce2c0235b2ee tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "POST /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138/action" status: 202 len: 0 microversion: 2.1 time: 0.155254 Jul 30 21:19:11.095642 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2257/4460] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:10 2022] POST /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:19:11.107960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:11.115150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:11.118917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3556ffdd-350f-49a3-ba0f-64f87a8c9107 tempest-ExtensionsTest-454718246 tempest-ExtensionsTest-454718246-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:11.121031 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3556ffdd-350f-49a3-ba0f-64f87a8c9107 tempest-ExtensionsTest-454718246 tempest-ExtensionsTest-454718246-project] 10.222.0.17 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.298185 Jul 30 21:19:11.129079 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2204/4461] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:19:10 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:11.133970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:11.133970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:11.134698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:11.135229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:11.149971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47e47876-5f3f-458a-876f-4e72f3632fe4 tempest-ExtensionsTest-454718246 tempest-ExtensionsTest-454718246-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:11.153421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47e47876-5f3f-458a-876f-4e72f3632fe4 tempest-ExtensionsTest-454718246 tempest-ExtensionsTest-454718246-project] 10.222.0.17 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.022513 Jul 30 21:19:11.154020 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2205/4462] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:19:11 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:19:11.488753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:11.490914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:11.502311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:11.508983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:11.514957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:11.517448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:11.519204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:11.531012 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29e34d0b-b6ab-43a4-9a6b-f0726c2ca2e2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.433834 Jul 30 21:19:11.532038 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2258/4463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:11 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:12.237872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:12.248521 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-42cbca4a-8b1b-4627-a237-a7e9ae12b11e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1518 microversion: 2.1 time: 0.766751 Jul 30 21:19:12.249623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2206/4464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:11 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1518 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:12.564018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:12.567339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:12.586258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:12.588615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:12.590196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:12.590966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:12.776415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:12.785715 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b87657f9-732c-47fb-a9f2-a1c5026f2e08 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.228319 Jul 30 21:19:12.799682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2259/4465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:12 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:13.275634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:13.276615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:13.289934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:13.293614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.294927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:13.296041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.296654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:13.638880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:13.649590 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8933ffe2-bdfb-4c67-8654-1530da965561 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.380707 Jul 30 21:19:13.650922 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2207/4466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:13 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:13.673613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:13.674219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:13.698607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.699054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:13.699990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.700441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:13.810980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:13.811862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:13.818938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.819786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:13.820995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:13.821806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.033472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:14.061406 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f93dbba-ece9-4ec7-b585-6914009eb7ca tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.393050 Jul 30 21:19:14.086035 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2260/4467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:13 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:14.099821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:14.100705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:14.106214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:14.120755 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73a58150-9e07-40b4-a29a-f95bf69ae3ef tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.315042 Jul 30 21:19:14.126232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.126746 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2208/4468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:13 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:14.127500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.128747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.129391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.317516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:14.327265 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-546cac71-0552-48d0-9c11-d6e85f2807a3 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.232515 Jul 30 21:19:14.328482 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2261/4469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:14 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:14.353067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-636b18c0-5453-47cc-aa9d-fadbbe16a991 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:14.365555 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-636b18c0-5453-47cc-aa9d-fadbbe16a991 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-636b18c0-5453-47cc-aa9d-fadbbe16a991 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/e5b9798d-dede-4a2f-bb31-a9764e9f9bae/action HTTP/1.1 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: {"os-stop": {}} Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e5b9798d-dede-4a2f-bb31-a9764e9f9bae', 'body': {'os-stop': {}}} Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:14.380777 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. Jul 30 21:19:14.384319 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:14.389327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-636b18c0-5453-47cc-aa9d-fadbbe16a991 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance e5b9798d-dede-4a2f-bb31-a9764e9f9bae has no mapping to a cell. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:14.390503 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-636b18c0-5453-47cc-aa9d-fadbbe16a991 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e5b9798d-dede-4a2f-bb31-a9764e9f9bae/action" status: 404 len: 117 microversion: 2.1 time: 0.044072 Jul 30 21:19:14.391682 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2209/4470] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:14 2022] POST /compute/v2.1/servers/e5b9798d-dede-4a2f-bb31-a9764e9f9bae/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:14.400468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:14.401759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:14.414507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.416007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.417073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.418297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.762553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:14.776446 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a41fc7d3-daa9-4279-ac9a-96c92a778daa tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.380006 Jul 30 21:19:14.779664 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2262/4471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:14 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:14.800796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:14.802103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:14.813150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.813613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:14.814957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:14.815580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.095685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:15.113346 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-968f8c84-1d3c-43fc-afb2-c7a72ee1d5df tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.314462 Jul 30 21:19:15.128560 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2210/4472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:14 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:15.137188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:15.138518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 3c41e27a-e28d-4a52-ad16-b8d526a5e296] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:15.149439 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/3c41e27a-e28d-4a52-ad16-b8d526a5e296/action HTTP/1.1 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 15 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: {"suspend": {}} Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '3c41e27a-e28d-4a52-ad16-b8d526a5e296', 'body': {'suspend': {}}} Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:15.153233 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:15.156799 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:15.156799 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:15.156799 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. Jul 30 21:19:15.156799 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:15.159122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 3c41e27a-e28d-4a52-ad16-b8d526a5e296 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:15.160035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:15.161313 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1844db40-d179-4317-ba61-a3694479bf3e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/3c41e27a-e28d-4a52-ad16-b8d526a5e296/action" status: 404 len: 111 microversion: 2.1 time: 0.028295 Jul 30 21:19:15.162159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:15.166452 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2263/4473] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:15 2022] POST /compute/v2.1/servers/3c41e27a-e28d-4a52-ad16-b8d526a5e296/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:15.180034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.180355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:15.181138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:15.184852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.185942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.186403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.197620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.198097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.198901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.199391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.505819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:15.521279 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9781451b-4a4c-4912-9e14-6b87e9291cb1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.375326 Jul 30 21:19:15.523900 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2211/4474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:15 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:15.624558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:15.641483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17373d93-3f0d-4d06-b132-c77caea75edf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.470823 Jul 30 21:19:15.642134 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2264/4475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:15 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:15.673185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:15.674358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:15.696915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.697394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:15.698888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:15.699388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.123744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:16.137987 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad6af3e3-4c31-40b9-9aba-d6756862d65e tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.471167 Jul 30 21:19:16.141972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2212/4476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:15 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:16.167595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:16.168949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:16.183433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.184312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.185505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.186331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.265856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lazy-loading 'flavor' on Instance uuid e0e21266-f697-4bd9-be1f-25ea0305e00c {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:19:16.427730 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb393292-1b6f-405f-bc24-f667c14d9b24 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.271070 Jul 30 21:19:16.429711 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2265/4477] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:16 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:19:16.451868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:16.460652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:16.479713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.481491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.482494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.484789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.550747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:16.551880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:16.579818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.588080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:16.588799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:16.589290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:17.058375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:17.081682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f227a832-b8f3-4e87-b994-948c5fcdf613 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1513 microversion: 2.1 time: 0.645851 Jul 30 21:19:17.085502 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2213/4478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:16 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1513 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:17.186704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:17.217939 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27d632e3-0fca-4a77-9c46-ffb540016843 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.675510 Jul 30 21:19:17.219899 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2266/4479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:16 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:18.117667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:18.120133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:18.135134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.136733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.137577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.138734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.208204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:18.241242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:18.242461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:18.252229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.252762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.254421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.255216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.572596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:18.586831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9cbbbd62-5762-4987-9e1c-01da5fae56fe tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1496 microversion: 2.1 time: 0.476893 Jul 30 21:19:18.588541 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2214/4480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:18 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1496 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:18.619364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:18.620206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:18.634438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.637104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.638333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.639004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.701968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lazy-loading 'flavor' on Instance uuid e0e21266-f697-4bd9-be1f-25ea0305e00c {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:19:18.732476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'suspend' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state suspended Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: {"suspend": {}} Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'suspend' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state suspended Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'suspend': {}}} Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state suspended. Cannot suspend while the instance is in this state. Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 30 21:19:18.734138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state suspended Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state suspended Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:18.737878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'suspend' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state suspended {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:18.739766 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69aecbbe-aa99-4895-9130-a1f39073887a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 148 microversion: 2.1 time: 0.127494 Jul 30 21:19:18.740399 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2215/4481] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:18 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 148 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 30 21:19:18.757795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:18.761429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:18.774895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.781414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.782624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:18.783193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:18.854875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:18.865501 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e4320d4-6ec7-4dff-bae3-30d14819c97c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.628917 Jul 30 21:19:18.869190 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2267/4482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:18 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:19.029862 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87e183ff-cd05-4195-a4b4-0d8bc3438485 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 202 len: 0 microversion: 2.1 time: 0.281672 Jul 30 21:19:19.031566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2216/4483] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:18 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:19:19.044253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:19.045765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:19.059344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:19.060060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:19.063608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:19.064267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:19.886564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:19.900735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:19.902141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:19.908191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4e13c6aa-0f0e-4c7f-87ec-ece0f9d8cb05 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1502 microversion: 2.1 time: 0.869000 Jul 30 21:19:19.908804 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2268/4484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:19 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1502 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:19.914162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:19.914959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:19.916107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:19.919957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:20.506104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:20.521929 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fc5921d-d8d2-416e-b7a8-795b6cc845ff tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.632864 Jul 30 21:19:20.523752 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2217/4485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:19 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:20.937421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:20.938751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:20.951119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:20.952882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:20.959735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:20.960797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:20.967595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:21.548840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:21.550163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:21.563110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:21.563633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:21.569334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:21.569796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:21.899185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:21.911562 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e0806c81-8a20-4c4f-93fd-282a1d7c3f81 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1502 microversion: 2.1 time: 0.979456 Jul 30 21:19:21.912164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2269/4486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:20 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1502 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:22.221151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:22.238051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-969f7a7c-09aa-4030-98cd-be939bfb8613 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.695702 Jul 30 21:19:22.245376 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2218/4487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:21 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:22.937648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:22.938297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:22.956717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:22.960023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:22.961238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:22.961848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.275467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:23.276963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:23.289252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.291194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.293248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.294262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.424432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:23.445756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57089fdc-828d-438f-8554-e253734036f2 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.513536 Jul 30 21:19:23.453768 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2270/4488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:22 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:23.479262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:23.480413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:23.502080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.503468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.506733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.507611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.681286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:23.689756 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6d514bb1-1b92-4728-8d7a-4467275ff7c8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.420076 Jul 30 21:19:23.703657 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2219/4489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:23 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:23.799037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:23.808651 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9ca6bb7-aec8-4a9a-93dd-fae2093aa740 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.339510 Jul 30 21:19:23.822027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2271/4490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:23 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:23.832773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:23.833338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 51a4d33a-8817-495a-b6e2-c52da7a50860] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:23.839502 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/51a4d33a-8817-495a-b6e2-c52da7a50860/action HTTP/1.1 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: {"unpause": {}} Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '51a4d33a-8817-495a-b6e2-c52da7a50860', 'body': {'unpause': {}}} Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:23.842083 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:23.845762 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:23.845762 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:23.845762 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. Jul 30 21:19:23.845762 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:23.847641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 51a4d33a-8817-495a-b6e2-c52da7a50860 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:23.849155 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae55496c-8bd4-477a-a037-63dd13b322f0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/51a4d33a-8817-495a-b6e2-c52da7a50860/action" status: 404 len: 111 microversion: 2.1 time: 0.020817 Jul 30 21:19:23.849798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2220/4491] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:23 2022] POST /compute/v2.1/servers/51a4d33a-8817-495a-b6e2-c52da7a50860/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:23.860559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:23.861575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:23.875239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.875910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:23.876801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:23.877303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.466982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:24.486187 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de71fc0f-fa90-4ed8-8e97-07444e875ddc tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.630747 Jul 30 21:19:24.488184 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2272/4492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:23 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:24.513039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:24.513673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:24.538191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.538700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.539781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.541301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.712801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:24.713538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:24.724604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.725953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.736563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.737315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.741920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:24.814833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:24.835695 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebcee295-36e0-4d31-b041-5a89dc0ff0f7 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.326851 Jul 30 21:19:24.837200 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2221/4493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:24 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:24.872203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:24.873443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:24.893312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.894660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.896368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.897006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.950552 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'unpause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 15 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: {"unpause": {}} Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: exception: Cannot 'unpause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'unpause': {}}} Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state active. Cannot unpause while the instance is in this state. Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:24.953129 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'unpause' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:24.960780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-740cc2e0-73e9-4ad8-a50c-76c213de8c0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 145 microversion: 2.1 time: 0.095668 Jul 30 21:19:24.962129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2222/4494] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:24 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:19:24.967785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:24.968432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:24.981395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.983191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:24.984715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:24.986382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:25.174116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:25.207119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33e203c8-c0d3-4d29-83cf-940cb741bea9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.496853 Jul 30 21:19:25.208891 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2273/4495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:24 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:25.408694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:25.423624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f8ec46c-14da-47ce-aa57-93d9c74c389c tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.460247 Jul 30 21:19:25.424226 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2223/4496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:24 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:25.450108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:25.451009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:25.464403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:25.464883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:25.465691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:25.466145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.234213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:26.234842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:26.250783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.253578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.255018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.255507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.370893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:26.386375 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-774c49be-a72e-42cd-9532-6871462bac2f tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.939071 Jul 30 21:19:26.387603 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2274/4497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:25 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:26.409492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:26.410105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:26.424821 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd/action HTTP/1.1 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 18 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: {"unshelve": null} Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd', 'body': {'unshelve': None}} Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:26.429929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. Jul 30 21:19:26.436305 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:26.440592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:26.444556 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5c8518f-5edf-4ed8-9769-eb4940c2ed18 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd/action" status: 404 len: 111 microversion: 2.1 time: 0.036793 Jul 30 21:19:26.447266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2275/4498] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:26 2022] POST /compute/v2.1/servers/ad97d0c2-0dbc-48fc-a81e-5d2924f38fdd/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:26.459039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:26.460303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:26.497531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.498215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.500046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.500840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.798328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:26.815345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f9b2e69-96f6-4e1d-b888-9f6336bfd742 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.589007 Jul 30 21:19:26.834411 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2224/4499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:26 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:26.842097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:26.857918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b1fdb258-e484-48ca-af3b-097886c012f8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.403820 Jul 30 21:19:26.858930 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2276/4500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:26 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:26.886884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:26.889521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:26.897684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.898246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:26.899590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:26.900166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.145521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:27.156354 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d8d75a6-e95a-4e20-8842-92e9e3ea8f12 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.278432 Jul 30 21:19:27.159512 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2225/4501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:26 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:27.181378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:27.182178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:27.196114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.197826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.200050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.200541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.251996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Cannot 'unshelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action HTTP/1.1 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 18 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: {"unshelve": null} Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: exception: Cannot 'unshelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'unshelve': None}} Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c in vm_state active. Cannot unshelve while the instance is in this state. Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 21:19:27.256909 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active Jul 30 21:19:27.261413 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:27.265464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 409 to user: Cannot 'unshelve' instance e0e21266-f697-4bd9-be1f-25ea0305e00c while it is in vm_state active {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:27.266734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3174c147-5146-45da-b137-ca6c65e1ba47 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action" status: 409 len: 146 microversion: 2.1 time: 0.090735 Jul 30 21:19:27.268985 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2277/4502] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:27 2022] POST /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c/action => generated 146 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:19:27.282394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:27.283858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:27.292207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.293273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.295112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.295595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.528386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:27.538891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-57e4b7a7-ae84-4ae4-a08d-59ebe4b2b52b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.264534 Jul 30 21:19:27.540518 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2226/4503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:27 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:27.562025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:27.563327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:27.570760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.571731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.572877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.573675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.852838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:27.853604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:27.865351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.865804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.871045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:27.872312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:27.951534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:27.964606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e43bc31b-e456-431c-9648-34138179e727 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.406389 Jul 30 21:19:27.965853 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2278/4504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:27 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:27.994950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1295589829_updated"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:28.003428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 005c07ad-5b2d-4ca8-9835-b5ba2096ac28] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:28.016170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/servers/005c07ad-5b2d-4ca8-9835-b5ba2096ac28 HTTP/1.1 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 81 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1295589829_updated"}} Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '005c07ad-5b2d-4ca8-9835-b5ba2096ac28', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1295589829_updated'}}} Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 30 21:19:28.018954 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:28.024649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 005c07ad-5b2d-4ca8-9835-b5ba2096ac28 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:28.029074 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4127d57-a920-4263-aec5-ab2d5e1890af tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "PUT /compute/v2.1/servers/005c07ad-5b2d-4ca8-9835-b5ba2096ac28" status: 404 len: 111 microversion: 2.1 time: 0.041421 Jul 30 21:19:28.029074 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2279/4505] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:19:27 2022] PUT /compute/v2.1/servers/005c07ad-5b2d-4ca8-9835-b5ba2096ac28 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:28.038176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:28.042401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:28.060251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.060563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.063557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.064000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.154757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:28.163887 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b8b169c-0771-478a-bc13-9751fa4f90b8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.325527 Jul 30 21:19:28.165212 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2227/4506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:27 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:28.362541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:28.365272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:28.382076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.382957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.384128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.384791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.553880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:28.568888 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-335e2c2b-4aa8-406d-a10e-5413672c9a93 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.538270 Jul 30 21:19:28.570417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2280/4507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:28 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:28.592359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:28.593323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:28.610157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.611054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.626012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.627236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.667464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:28.687987 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ec7c4a15-f6f0-44d9-970f-20ef6704fed1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.338893 Jul 30 21:19:28.693292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2228/4508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:28 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:28.720479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:28.721264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:28.728387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.728835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.729730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:28.730431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:28.967105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:28.995852 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6aaf4ae-8c80-494d-8eca-ec1f668682e0 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.406047 Jul 30 21:19:29.001687 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2281/4509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:28 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:29.026557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba951159-139f-4077-a0e8-160bd3216d90 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba951159-139f-4077-a0e8-160bd3216d90 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: request: PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c HTTP/1.1 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 280 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.035938 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 30 21:19:29.039143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.057672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba951159-139f-4077-a0e8-160bd3216d90 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:29.060396 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba951159-139f-4077-a0e8-160bd3216d90 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 400 len: 619 microversion: 2.1 time: 0.040359 Jul 30 21:19:29.062356 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2282/4510] 10.222.0.17 () {60 vars in 1257 bytes} [Sat Jul 30 21:19:29 2022] PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:19:29.070251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:29.074711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:29.078419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.086505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbc693d3-67dc-4669-ab3d-59c3702092ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.377613 Jul 30 21:19:29.088344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2229/4511] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:28 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:29.094194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.095526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.100072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.102160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.114563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:29.115216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.143690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.144176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.145101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.145561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.288611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:29.303853 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a3de21d-b5f3-468e-b8dc-7649235bb566 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.237342 Jul 30 21:19:29.306292 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2283/4512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:29 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:29.312028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:29.313325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.320850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.321660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.325528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.326463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.436715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:29.447148 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d8ca5f50-6066-4952-a426-2c37a8433823 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.342447 Jul 30 21:19:29.448930 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2230/4513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:29 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:29.457044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:29.459113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.469668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.471214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.473557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.474619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.524386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:29.641771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:29.653780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46761783-3b4d-4b94-bcc4-609268ab455a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.344982 Jul 30 21:19:29.672901 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2284/4514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:29 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:29.680497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-61418551"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:29.684292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.693958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.694846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.696001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.696693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.755060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:29.777269 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4fc31b7-f481-478d-9e0c-be1bc2d458b6 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.326210 Jul 30 21:19:29.777725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2231/4515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:29 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:29.810749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f595883-bd04-4e91-9b40-090fa7bd26b8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f595883-bd04-4e91-9b40-090fa7bd26b8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c HTTP/1.1 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 24 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": ""}} Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c', 'body': {'server': {'name': ''}}} Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '' Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:19:29.824030 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f595883-bd04-4e91-9b40-090fa7bd26b8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:29.828652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9f595883-bd04-4e91-9b40-090fa7bd26b8 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 400 len: 108 microversion: 2.1 time: 0.030849 Jul 30 21:19:29.837138 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2232/4516] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:19:29 2022] PUT /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:19:29.849677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:29.851666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:29.875901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.877295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:29.879762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:29.880920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:30.029236 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6011edb5-3d61-4d66-8e44-197f89e43691 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.353523 Jul 30 21:19:30.032012 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2285/4517] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:19:29 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 30 21:19:30.204858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:30.219143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-85ecadb2-bc42-49c7-b685-fbb478218acb tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1505 microversion: 2.1 time: 0.376734 Jul 30 21:19:30.220388 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2233/4518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:29 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:30.684380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:30.685207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:30.694003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:30.694616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:30.695791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:30.696533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:30.928755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:30.955951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-874b9ca0-3cf5-4d4e-9015-f34611f4df6a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.273977 Jul 30 21:19:30.973972 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2286/4519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:30 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:31.980371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:31.982061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:32.008783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:32.009670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:32.010765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:32.011283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:32.340068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:32.350784 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-89a09767-90b0-40bc-aeae-dcf6a586c8f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.373035 Jul 30 21:19:32.360633 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2234/4520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:31 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:33.375105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:33.376764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:33.387716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:33.388470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:33.389590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:33.390232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:33.786721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:33.824013 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-09616aa9-23c3-4bf3-b227-fec374f65453 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.449311 Jul 30 21:19:33.826615 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2287/4521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:33 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:34.850968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:34.852053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:34.878825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:34.879679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:34.880731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:34.881227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.049283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:35.049885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:35.058995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.059545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.060399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.061048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.091920 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa HTTP/1.1 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '481f91ad-cd2f-4aeb-b953-c2a19e6413fa'} Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:35.094114 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.099194 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.101171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:35.102342 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef4a8c19-bf23-4537-a0eb-a41f0c98c0bf tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 404 len: 111 microversion: 2.1 time: 0.059547 Jul 30 21:19:35.103095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2288/4522] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:35 2022] DELETE /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:35.116939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:35.119089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: 481f91ad-cd2f-4aeb-b953-c2a19e6413fa] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:35.128707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.129626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.132124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.132867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.154507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa HTTP/1.1 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '481f91ad-cd2f-4aeb-b953-c2a19e6413fa'} Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:35.156715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. Jul 30 21:19:35.160903 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:35.164062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance 481f91ad-cd2f-4aeb-b953-c2a19e6413fa could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:35.169030 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-514f28bf-d11f-4520-a6c2-f8277ba8a75a tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa" status: 404 len: 111 microversion: 2.1 time: 0.058753 Jul 30 21:19:35.176631 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2289/4523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:35 2022] GET /compute/v2.1/servers/481f91ad-cd2f-4aeb-b953-c2a19e6413fa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:35.184409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:35.185281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:35.199692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.203413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.205735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.208106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.266162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:19:35.325578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:35.345573 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-335a6b3c-0e6b-47af-970b-3a1097d0ac58 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.502420 Jul 30 21:19:35.361868 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2235/4524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:34 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:35.426779 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f43293b2-277b-48c1-ae99-dca508233e0b tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 204 len: 0 microversion: 2.1 time: 0.246854 Jul 30 21:19:35.429099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2290/4525] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:35 2022] DELETE /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:19:35.436633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:35.437283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:35.451217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.453053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.455904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.457517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.659029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8490d78d-4270-4006-aa6b-c5d2215f30fe req-0f85814d-1323-4f5a-9e99-4f470b913e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-plugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:35.680202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8490d78d-4270-4006-aa6b-c5d2215f30fe req-0f85814d-1323-4f5a-9e99-4f470b913e4a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:35.681375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8490d78d-4270-4006-aa6b-c5d2215f30fe req-0f85814d-1323-4f5a-9e99-4f470b913e4a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:35.705882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8490d78d-4270-4006-aa6b-c5d2215f30fe req-0f85814d-1323-4f5a-9e99-4f470b913e4a service nova] Creating event network-vif-plugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:19:35.721349 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8490d78d-4270-4006-aa6b-c5d2215f30fe req-0f85814d-1323-4f5a-9e99-4f470b913e4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066516 Jul 30 21:19:35.722687 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2291/4526] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:36.163756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:36.173136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-469324a2-4f70-414f-9efd-a28a769a37be tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.740454 Jul 30 21:19:36.180313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2236/4527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:35 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:36.371001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:36.372005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:36.389782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:36.393744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:36.397726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:36.400267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:36.418278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:36.926645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:36.950227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03abfeea-0296-4dae-95fb-58893cb37fac tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1511 microversion: 2.1 time: 0.581367 Jul 30 21:19:36.952879 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2292/4528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:36 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:37.207405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:37.208133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:37.228986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:37.233831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:37.235381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:37.243573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:37.526694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6be699dd-e3eb-4586-925c-50dda082ff97 tempest-ComputeTenantNetworksTest-1745252252 tempest-ComputeTenantNetworksTest-1745252252-project] Calling method '.version_select at 0x7fbb4fea2310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:37.797619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:37.810963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8df6952-3d28-42ec-a214-b153f8c784ba tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1511 microversion: 2.1 time: 0.610001 Jul 30 21:19:37.811776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2293/4529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:37 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1511 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:37.817510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6be699dd-e3eb-4586-925c-50dda082ff97 tempest-ComputeTenantNetworksTest-1745252252 tempest-ComputeTenantNetworksTest-1745252252-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.096917 Jul 30 21:19:37.824334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2237/4530] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:19:36 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:37.829860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e978a0b-1d9a-4f64-a4f1-778291144de1 tempest-ComputeTenantNetworksTest-1745252252 tempest-ComputeTenantNetworksTest-1745252252-project] Calling method '.version_select at 0x7fbb4fc35790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:37.977480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:37.978610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:38.013031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.013588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.014595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.015565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.047846 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e978a0b-1d9a-4f64-a4f1-778291144de1 tempest-ComputeTenantNetworksTest-1745252252 tempest-ComputeTenantNetworksTest-1745252252-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks/63cc116a-4b35-42b0-801a-4903bddfe1bb" status: 200 len: 140 microversion: 2.1 time: 0.221785 Jul 30 21:19:38.053468 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2294/4531] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:19:37 2022] GET /compute/v2.1/os-tenant-networks/63cc116a-4b35-42b0-801a-4903bddfe1bb => generated 140 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:38.428906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-116abc00-34a1-45f4-9587-28baa3b889d1 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Action: 'create', calling method: .version_select at 0x7fbb4fc3e280>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1573166841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTbVtUqolAT+KR7PB8qcOcXK+gO/aopBgxbOanILuSLID+u8mKpGv6Q8luqIcz5tXPyUG23OBDk56YSvdz/8nf7D7Thz8oMy4kCqLTKXXMSOOnzrJNP8CT6tg/WmPNckg=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:38.481281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-116abc00-34a1-45f4-9587-28baa3b889d1 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Getting quotas for project cd884e1c0861450e9049a966a5931675. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:19:38.495040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-116abc00-34a1-45f4-9587-28baa3b889d1 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Getting quotas for user f4b80fe0ec404f0480948be6e051c9e4 and project cd884e1c0861450e9049a966a5931675. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:19:38.506223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:38.523712 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cdd0007-99ea-44b0-b9cf-10144f5c6652 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1488 microversion: 2.1 time: 0.551823 Jul 30 21:19:38.525672 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2238/4532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:37 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1488 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:38.549082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-430889219"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:38.553399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:38.560429 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-116abc00-34a1-45f4-9587-28baa3b889d1 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.137770 Jul 30 21:19:38.561334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2295/4533] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:19:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:38.570467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.570951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.571804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.592668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.783979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90ea9a86-dcb0-42a3-b635-fd96c33d01c3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "PUT /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1060 microversion: 2.1 time: 0.225458 Jul 30 21:19:38.793067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2239/4534] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:19:38 2022] PUT /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1060 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:38.812590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:38.814168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:38.829938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.832280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.833171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:38.833813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:38.835481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.836159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.848603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.849302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:38.855146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:38.856426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.066809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ba5ddf22424eff840602440872f86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73245fdcb10c4144a60fa8ca6b6a7ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:39.077385 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebac602d-f080-4a99-ac4e-21478a794251 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 200 len: 1469 microversion: 2.1 time: 0.248735 Jul 30 21:19:39.080587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2240/4535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:38 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:39.114270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aa99fc63-4df7-4095-a924-89240763fe38 req-47aa47b4-10e7-4c06-9dfb-b68edf3b1ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e21266-f697-4bd9-be1f-25ea0305e00c", "name": "network-vif-deleted", "tag": "d7c1fbde-d6c7-4274-a23f-ee1c94e798f2"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:39.149092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aa99fc63-4df7-4095-a924-89240763fe38 req-47aa47b4-10e7-4c06-9dfb-b68edf3b1ff3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:39.149976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aa99fc63-4df7-4095-a924-89240763fe38 req-47aa47b4-10e7-4c06-9dfb-b68edf3b1ff3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.189385 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aa99fc63-4df7-4095-a924-89240763fe38 req-47aa47b4-10e7-4c06-9dfb-b68edf3b1ff3 service nova] Creating event network-vif-deleted:d7c1fbde-d6c7-4274-a23f-ee1c94e798f2 for instance e0e21266-f697-4bd9-be1f-25ea0305e00c on nch1-master-1 Jul 30 21:19:39.206352 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aa99fc63-4df7-4095-a924-89240763fe38 req-47aa47b4-10e7-4c06-9dfb-b68edf3b1ff3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102284 Jul 30 21:19:39.207845 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2241/4536] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:39.516190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:39.529324 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-88382a16-85fc-4439-9e87-867305709c3f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1487 microversion: 2.1 time: 0.723538 Jul 30 21:19:39.530475 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2296/4537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:38 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1487 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:39.554940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:39.556908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:39.565165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:39.566219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.567165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:39.567783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.858718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:39.880488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-10ad6938-d3d1-43ec-a938-5b1d3b6b73cb tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1487 microversion: 2.1 time: 0.328253 Jul 30 21:19:39.885549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2242/4538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:39 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:39.906588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:39.907156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:39.919918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:39.920392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.921242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:39.921709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:39.982879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:19:40.106394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:40.114321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] [instance: e0e21266-f697-4bd9-be1f-25ea0305e00c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:40.128617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:40.131380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:40.134271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:40.137384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:40.171725 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0435655-72ff-427d-9d0e-28fc595df65d tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 204 len: 0 microversion: 2.1 time: 0.268450 Jul 30 21:19:40.172441 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2297/4539] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:39 2022] DELETE /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:19:40.190163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:40.193075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:40.194528 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] HTTP exception thrown: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Request method failure captured: Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c HTTP/1.1 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-FCmxd_YIRxch8lfl2AQ4Y6-QgmTvaIlOqxsZ9mS8VHd7k11KtfgcJi_ww4ZUwO5KRBB3GtzeyxCz3JQfmh4OsmCtCugOUz5sb6Y8IGYHQXH1qBZRJ3owPcVgrVGIuUYJ7iTUFz3IvA0gYN1Hh8yWemvFtsjxYwZiOxhk5iSyzmxo Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73245fdcb10c4144a60fa8ca6b6a7ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73245fdcb10c4144a60fa8ca6b6a7ab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 73245fdcb10c4144a60fa8ca6b6a7ab8 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1663379598 Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 23ba5ddf22424eff840602440872f86e Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1663379598-project Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'e0e21266-f697-4bd9-be1f-25ea0305e00c'} Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:40.200572 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. Jul 30 21:19:40.204322 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:40.204710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:40.204798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:40.206046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:40.206562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:40.207991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] Returning 404 to user: Instance e0e21266-f697-4bd9-be1f-25ea0305e00c could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:40.209189 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-472c5fb2-50ae-445e-a940-6be972118a83 tempest-ServersNegativeTestJSON-1663379598 tempest-ServersNegativeTestJSON-1663379598-project] 10.222.0.17 "GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c" status: 404 len: 111 microversion: 2.1 time: 0.107474 Jul 30 21:19:40.210145 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2243/4540] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:40 2022] GET /compute/v2.1/servers/e0e21266-f697-4bd9-be1f-25ea0305e00c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:40.563348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:40.579068 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f2a8438-91e2-4cd8-90e6-96320399f3b4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1493 microversion: 2.1 time: 0.399688 Jul 30 21:19:40.580715 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2298/4541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:40 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1493 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:41.605292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:41.606565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:41.633859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:41.635785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:41.643125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:41.645748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:42.006273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:42.021447 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-946b55f7-60f9-4939-b45b-36e7bc15bce5 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1493 microversion: 2.1 time: 0.419345 Jul 30 21:19:42.023144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2244/4542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:41 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1493 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:43.047069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:43.047790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:43.072952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:43.073704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:43.074775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:43.075240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:43.340440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:43.357327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2cea87dd-ebc3-4141-a965-41fa033d5e6c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 200 len: 1451 microversion: 2.1 time: 0.316227 Jul 30 21:19:43.358176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2299/4543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:43 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 1451 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:43.501153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f0c31569-88f0-4034-ad84-5965ebba7348 req-7f7846bc-8ca5-45ea-9d07-8797714d5fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0533b6d5-7589-4f50-935b-c764ce6c3138", "name": "network-vif-deleted", "tag": "435de4da-174c-4e6c-acda-2230159148e4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:43.528616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=72 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:43.541789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0c31569-88f0-4034-ad84-5965ebba7348 req-7f7846bc-8ca5-45ea-9d07-8797714d5fb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:43.542265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0c31569-88f0-4034-ad84-5965ebba7348 req-7f7846bc-8ca5-45ea-9d07-8797714d5fb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:43.585750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f0c31569-88f0-4034-ad84-5965ebba7348 req-7f7846bc-8ca5-45ea-9d07-8797714d5fb8 service nova] Creating event network-vif-deleted:435de4da-174c-4e6c-acda-2230159148e4 for instance 0533b6d5-7589-4f50-935b-c764ce6c3138 on nch1-master-1 Jul 30 21:19:43.600225 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f0c31569-88f0-4034-ad84-5965ebba7348 req-7f7846bc-8ca5-45ea-9d07-8797714d5fb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103110 Jul 30 21:19:43.605791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2245/4544] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:44.382651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:44.383716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:44.407093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.409442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.411182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.419717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.471462 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 HTTP/1.1 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0533b6d5-7589-4f50-935b-c764ce6c3138'} Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.473744 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:44.477855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48b77a71-7265-458a-b093-c42ca739ab9a tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 404 len: 111 microversion: 2.1 time: 0.097354 Jul 30 21:19:44.497164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2300/4545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:44 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:44.512307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:44.512922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:44.530812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.531457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.532885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.540389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.615790 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 HTTP/1.1 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0533b6d5-7589-4f50-935b-c764ce6c3138'} Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:44.617735 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.621694 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.629765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:44.636317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3442854c-2b13-47fc-b498-02397d4453a9 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 404 len: 111 microversion: 2.1 time: 0.129169 Jul 30 21:19:44.643344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2246/4546] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:44 2022] DELETE /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:44.649914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:44.652257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 0533b6d5-7589-4f50-935b-c764ce6c3138] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:44.660714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.676302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.677414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.678093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.739681 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 HTTP/1.1 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0533b6d5-7589-4f50-935b-c764ce6c3138'} Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.743963 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. Jul 30 21:19:44.750928 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.755640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 0533b6d5-7589-4f50-935b-c764ce6c3138 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:44.759687 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3783d92e-bea2-4665-9392-344ac8a8d987 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138" status: 404 len: 111 microversion: 2.1 time: 0.113432 Jul 30 21:19:44.760809 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2301/4547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:44 2022] GET /compute/v2.1/servers/0533b6d5-7589-4f50-935b-c764ce6c3138 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:44.774465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:44.774995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:44.811194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.811780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.823930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.824396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.886313 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:44.892667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-197368645", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4f212dba-2e86-4b92-94b3-0b7efa892285", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1573166841", "security_groups": [{"name": "tempest-secgroup-smoke-1397126510"}], "networks": [{"uuid": "044ee598-dde4-4688-adb0-3d73062c4ead"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db HTTP/1.1 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '13b557a2-3be4-4f7a-bf6f-169e16b515db'} Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:44.893900 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:44.898242 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53288203-062a-462b-a48d-25e46d6f5ed6 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 404 len: 111 microversion: 2.1 time: 0.130334 Jul 30 21:19:44.910549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2247/4548] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:44 2022] DELETE /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:44.928689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:44.933032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 13b557a2-3be4-4f7a-bf6f-169e16b515db] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:44.957164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.965632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:44.967590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:44.973203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.028945 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db HTTP/1.1 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '13b557a2-3be4-4f7a-bf6f-169e16b515db'} Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.031485 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. Jul 30 21:19:45.035261 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.038226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 13b557a2-3be4-4f7a-bf6f-169e16b515db could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.039713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07b74b42-8ce8-4db5-abdc-45873d8e8247 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db" status: 404 len: 111 microversion: 2.1 time: 0.127692 Jul 30 21:19:45.040926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2248/4549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:44 2022] GET /compute/v2.1/servers/13b557a2-3be4-4f7a-bf6f-169e16b515db => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.059168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.060184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.076924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.078739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.089609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.089609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.124959 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 HTTP/1.1 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2cf83c78-a95b-43c5-b133-8197374c3c71'} Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.126932 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.132348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.134110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.134709 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d177bb2b-e56e-41b2-894c-fe7691ebc883 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 404 len: 111 microversion: 2.1 time: 0.089352 Jul 30 21:19:45.139598 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2249/4550] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:45 2022] DELETE /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.145333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.159261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 2cf83c78-a95b-43c5-b133-8197374c3c71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.178761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.192923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.197790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.198669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.268106 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 HTTP/1.1 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2cf83c78-a95b-43c5-b133-8197374c3c71'} Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.279981 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. Jul 30 21:19:45.288173 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.292658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 2cf83c78-a95b-43c5-b133-8197374c3c71 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.301627 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e20197fc-8dbf-4a89-96ba-92496b7301f8 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71" status: 404 len: 111 microversion: 2.1 time: 0.157250 Jul 30 21:19:45.303166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2250/4551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:45 2022] GET /compute/v2.1/servers/2cf83c78-a95b-43c5-b133-8197374c3c71 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.355120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.357259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.362369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] validate_networks() for [('044ee598-dde4-4688-adb0-3d73062c4ead', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:19:45.397389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.400154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.407538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.410262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.465723 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb HTTP/1.1 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '75a27d5c-d518-476d-be57-e24b191c17eb'} Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.482287 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.490422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.497124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.499741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23ec2785-d2d2-4480-9c6b-fbb8f885e1c1 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 404 len: 111 microversion: 2.1 time: 0.186862 Jul 30 21:19:45.501491 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2251/4552] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:45 2022] DELETE /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.514040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.516092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 75a27d5c-d518-476d-be57-e24b191c17eb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.529423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.529899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.530708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.531166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.554283 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb HTTP/1.1 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '75a27d5c-d518-476d-be57-e24b191c17eb'} Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.557629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. Jul 30 21:19:45.562323 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.565259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 75a27d5c-d518-476d-be57-e24b191c17eb could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.566535 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8040806e-1c47-4625-9661-0bc5d7c1a8d2 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb" status: 404 len: 111 microversion: 2.1 time: 0.059914 Jul 30 21:19:45.567779 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2252/4553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:45 2022] GET /compute/v2.1/servers/75a27d5c-d518-476d-be57-e24b191c17eb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.581354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.582990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.599081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.602682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.603830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.604717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.637792 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 HTTP/1.1 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '584f4217-ab9f-4d64-bc00-11fccb7aebb2'} Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.644779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.648973 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.651667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.653397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9c5b109-d0a4-4183-a8bf-6a1cc22a9bb3 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 404 len: 111 microversion: 2.1 time: 0.081793 Jul 30 21:19:45.655592 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2253/4554] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:45 2022] DELETE /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:45.668859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.670911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 584f4217-ab9f-4d64-bc00-11fccb7aebb2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.681648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.682460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.683521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.684196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.701483 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 HTTP/1.1 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '584f4217-ab9f-4d64-bc00-11fccb7aebb2'} Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.703598 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. Jul 30 21:19:45.707878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.710154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 584f4217-ab9f-4d64-bc00-11fccb7aebb2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.711604 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6017109a-38d4-408f-bd72-54f339af8c34 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2" status: 404 len: 111 microversion: 2.1 time: 0.051818 Jul 30 21:19:45.712855 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2254/4555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:45 2022] GET /compute/v2.1/servers/584f4217-ab9f-4d64-bc00-11fccb7aebb2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:45.723143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.723966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.731590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.732430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.733725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.734442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.757092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 HTTP/1.1 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f968d321-00af-45a6-b799-4a94eacdcf88'} Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.760396 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.764901 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.767118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.768253 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d35f0f74-c72c-4306-b371-6a6011e0ed04 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 404 len: 111 microversion: 2.1 time: 0.051296 Jul 30 21:19:45.770059 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2255/4556] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:45 2022] DELETE /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.787185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.790428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: f968d321-00af-45a6-b799-4a94eacdcf88] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.809348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.810589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.812083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:45.813697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:45.888538 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 HTTP/1.1 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f968d321-00af-45a6-b799-4a94eacdcf88'} Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.893850 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. Jul 30 21:19:45.904992 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.907710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance f968d321-00af-45a6-b799-4a94eacdcf88 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.908887 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7ff098e-5678-450c-bafd-799637462f6f tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88" status: 404 len: 111 microversion: 2.1 time: 0.135029 Jul 30 21:19:45.910600 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2256/4557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:45 2022] GET /compute/v2.1/servers/f968d321-00af-45a6-b799-4a94eacdcf88 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.927129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.929650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:45.944870 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 HTTP/1.1 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '79a27031-f86f-4738-8eb9-eb3b38b41f78'} Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:45.954230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:45.958538 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:45.966478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:45.973196 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a7778a8a-d828-4d7b-a970-e98cbb560727 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78" status: 404 len: 111 microversion: 2.1 time: 0.055076 Jul 30 21:19:45.975631 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2257/4558] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:45 2022] DELETE /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:45.990774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:45.991741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: 79a27031-f86f-4738-8eb9-eb3b38b41f78] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:46.013401 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 HTTP/1.1 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '79a27031-f86f-4738-8eb9-eb3b38b41f78'} Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:46.015494 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:46.020409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:46.020409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:46.020409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. Jul 30 21:19:46.020409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:19:46.021988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance 79a27031-f86f-4738-8eb9-eb3b38b41f78 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:46.026278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3cf0ea3a-cc2e-4a29-9e4f-d1d28d97a3fd tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78" status: 404 len: 111 microversion: 2.1 time: 0.047495 Jul 30 21:19:46.027506 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2258/4559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:45 2022] GET /compute/v2.1/servers/79a27031-f86f-4738-8eb9-eb3b38b41f78 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:19:46.040827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:46.044615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:46.065635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.067030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.071810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.072570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.150481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:19:46.233163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:46.342912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aaed1939-1ba1-4eab-8b94-44dff3665d14 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "DELETE /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 204 len: 0 microversion: 2.1 time: 0.305495 Jul 30 21:19:46.349153 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2259/4560] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:19:46 2022] DELETE /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:19:46.368538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:46.369196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:46.387082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.387605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.388456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.389564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.754237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:19:46.755319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:19:46.756059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:19:46.756727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:19:46.758000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:19:46.804449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.806000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.813694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:46.817848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:46.879440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Getting quotas for project cd884e1c0861450e9049a966a5931675. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:19:46.893693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Getting quotas for user f4b80fe0ec404f0480948be6e051c9e4 and project cd884e1c0861450e9049a966a5931675. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:19:47.078738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:19:47.082283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f212dba-2e86-4b92-94b3-0b7efa892285',volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:19:47.230113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:47.241517 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a200ae53-6f93-4a27-be8d-99c7a38b962c tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1479 microversion: 2.1 time: 0.887126 Jul 30 21:19:47.242189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2260/4561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:46 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1479 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:47.367093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:47.439423 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.553505 Jul 30 21:19:47.440426 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2302/4562] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:19:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:19:47.452177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8d27c0c-4a7e-432f-b7c5-c507bc985125 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:47.453113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8d27c0c-4a7e-432f-b7c5-c507bc985125 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:47.765292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8d27c0c-4a7e-432f-b7c5-c507bc985125 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:47.775077 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8d27c0c-4a7e-432f-b7c5-c507bc985125 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1098 microversion: 2.1 time: 0.327592 Jul 30 21:19:47.787649 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2261/4563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:47 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1098 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:48.271419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:48.272671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:48.284365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:48.288016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:48.289301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:48.291935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:48.801386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:48.802852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:48.814227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:48.825462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:48.826583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:48.828865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:49.176036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:49.205117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d737167d-472e-4e38-af85-645ce100e1b0 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1196 microversion: 2.1 time: 0.407764 Jul 30 21:19:49.208556 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2262/4564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:48 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1196 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:49.506847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:49.524382 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f2aa07e-7a8e-48cb-bb9b-35a1cac1ec8e tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1479 microversion: 2.1 time: 1.257185 Jul 30 21:19:49.540224 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2303/4565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:48 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1479 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:50.262313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:50.262313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:50.282411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:50.291109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:50.298210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:50.304411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:50.547342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:50.548505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:50.579574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:50.582692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:50.586218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:50.587800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:50.633696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:50.653388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82227928-56dd-4a0e-acb9-8ee12de08d19 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1214 microversion: 2.1 time: 0.405577 Jul 30 21:19:50.672398 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2263/4566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:50 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1214 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:50.692362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ec445e9b-5231-4f55-bc75-a51855a1b714 req-384db1c3-52ac-4b84-b1df-b2119f287d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc7afed-292d-43c7-a874-d82be0ea06e3", "name": "network-vif-deleted", "tag": "89dd8e7c-46cb-4197-ad95-61783f180736"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:50.734234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ec445e9b-5231-4f55-bc75-a51855a1b714 req-384db1c3-52ac-4b84-b1df-b2119f287d19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:50.737360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ec445e9b-5231-4f55-bc75-a51855a1b714 req-384db1c3-52ac-4b84-b1df-b2119f287d19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:50.794655 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ec445e9b-5231-4f55-bc75-a51855a1b714 req-384db1c3-52ac-4b84-b1df-b2119f287d19 service nova] Creating event network-vif-deleted:89dd8e7c-46cb-4197-ad95-61783f180736 for instance afc7afed-292d-43c7-a874-d82be0ea06e3 on nch1-master-1 Jul 30 21:19:50.809040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a01092bfa5a4118a5fe61a6dc9c5460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc6c23a959246638169178d6a5acd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:50.820452 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ec445e9b-5231-4f55-bc75-a51855a1b714 req-384db1c3-52ac-4b84-b1df-b2119f287d19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143098 Jul 30 21:19:50.821104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2264/4567] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:50.824485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ba21bfc-3347-4952-9bb4-e91bf184978b tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 200 len: 1278 microversion: 2.1 time: 0.281066 Jul 30 21:19:50.825425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2304/4568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:50 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:51.680196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:51.681250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:51.696571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:51.697043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:51.698059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:51.698481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:51.847682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:51.848911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] [instance: afc7afed-292d-43c7-a874-d82be0ea06e3] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:51.857155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:51.858813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:51.861501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:51.862974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:51.892890 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] HTTP exception thrown: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Request method failure captured: Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 HTTP/1.1 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5Z-AoZ0-Mx5UHT9OetUJG1FTGxZUtAslnGP87JeiNNkmZ6nS7E1hZVCOiBb81w3_wB6DaMXkRO1yHqKzQ5qZ-86h6OqZXz-YFJLyiG2KADGYUs8QgSlMBKdAPmeesrz9a-xOpzitz1_JS0a22aYoutWG3kg1YmAmPRZLDu_nKhKpUPw Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_acc6c23a959246638169178d6a5acd4c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/acc6c23a959246638169178d6a5acd4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersTestJSON-842319427 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: acc6c23a959246638169178d6a5acd4c Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersTestJSON-842319427 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersTestJSON-842319427-project Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 4a01092bfa5a4118a5fe61a6dc9c5460 Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersTestJSON-842319427-project Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'afc7afed-292d-43c7-a874-d82be0ea06e3'} Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:51.896460 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. Jul 30 21:19:51.901894 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:19:51.904978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] Returning 404 to user: Instance afc7afed-292d-43c7-a874-d82be0ea06e3 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:19:51.908412 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-213874de-7c11-44b7-a735-8fbb55ac05c4 tempest-ServersTestJSON-842319427 tempest-ServersTestJSON-842319427-project] 10.222.0.17 "GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3" status: 404 len: 111 microversion: 2.1 time: 0.065450 Jul 30 21:19:51.909974 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2305/4569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:51 2022] GET /compute/v2.1/servers/afc7afed-292d-43c7-a874-d82be0ea06e3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:19:51.933861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:51.951074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-354df702-7ba8-4afb-8060-00bf29cbc281 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1214 microversion: 2.1 time: 0.278562 Jul 30 21:19:51.955282 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2265/4570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:51 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:19:52.983723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:52.985016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:53.002395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:53.007916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:53.009208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:53.012240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:53.792407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:53.811863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dcb41e71-6d6f-4e2f-a2ab-9bf8284f6f48 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.827289 Jul 30 21:19:53.830525 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2306/4571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:52 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:54.393351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-81ef8495-c16d-4f40-b080-94c790fa5342 req-769a23e6-0f6d-4313-88c9-02ceeba5be89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:19:54.414701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-81ef8495-c16d-4f40-b080-94c790fa5342 req-769a23e6-0f6d-4313-88c9-02ceeba5be89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:54.419197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-81ef8495-c16d-4f40-b080-94c790fa5342 req-769a23e6-0f6d-4313-88c9-02ceeba5be89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:54.459940 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-81ef8495-c16d-4f40-b080-94c790fa5342 req-769a23e6-0f6d-4313-88c9-02ceeba5be89 service nova] Creating event network-changed:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:19:54.493516 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-81ef8495-c16d-4f40-b080-94c790fa5342 req-769a23e6-0f6d-4313-88c9-02ceeba5be89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104545 Jul 30 21:19:54.499722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2266/4572] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:19:54.839698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:54.840962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:54.851530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:54.885553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:54.886791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:54.891766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:55.777877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:55.803242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2003919a-1dc8-4f8c-acf1-6b8f6715fae6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.953073 Jul 30 21:19:55.823501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2307/4573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:54 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:56.832210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:56.833670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:56.857876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:56.858482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:56.859336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:56.864465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:57.774070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:57.949177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:57.964740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f70e9f98-856f-40c8-9e1a-1140be4d26cd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 1.138577 Jul 30 21:19:57.966638 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2267/4574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:56 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:19:58.986006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:19:58.986637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:19:58.990512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:59.002959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:59.029469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:59.044439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:59.047149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:19:59.052603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:19:59.651872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:19:59.666144 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e92e28b8-a622-4af5-9528-1c5a863bfa5a tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.683918 Jul 30 21:19:59.667025 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2308/4575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:19:58 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:00.688894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:00.690179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:00.704160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:00.705451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:00.708100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:00.708788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:01.511892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:01.526809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92339bde-5439-4ec6-9675-3c99bef218c2 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.842246 Jul 30 21:20:01.528175 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2268/4576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:00 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:02.548570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:02.550711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:02.575769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:02.577959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:02.583246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:02.584342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:02.795383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:02.798303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:02.823169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:02.826303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:02.829066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:02.832143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:03.386524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:03.407981 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a78bc5be-191e-4072-b458-4f8f75c185ba tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.862843 Jul 30 21:20:03.412172 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2309/4577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:02 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:03.627720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:03.636827 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72c9a32e-4c95-4dd0-8e9f-d10776ffcf57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.845840 Jul 30 21:20:03.637433 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2269/4578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:02 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:04.435667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:04.436879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:04.445691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:04.446164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:04.446961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:04.447440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:04.658833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:04.660705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:04.677236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:04.679123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:04.682936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:04.683668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:04.775401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:04.793021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abc7c4b8-e93a-45ac-a59f-ac318e7c2133 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 0.359758 Jul 30 21:20:04.796174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2310/4579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:04 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:05.190015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c6c9a5d3-e5bd-4408-9064-537def51a6f9 req-2ff61db8-2602-4bd0-994c-2f552ede1bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "name": "network-vif-plugged", "status": "completed", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:05.210569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c6c9a5d3-e5bd-4408-9064-537def51a6f9 req-2ff61db8-2602-4bd0-994c-2f552ede1bb7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:05.210965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c6c9a5d3-e5bd-4408-9064-537def51a6f9 req-2ff61db8-2602-4bd0-994c-2f552ede1bb7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:05.254379 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c6c9a5d3-e5bd-4408-9064-537def51a6f9 req-2ff61db8-2602-4bd0-994c-2f552ede1bb7 service nova] Creating event network-vif-plugged:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:20:05.271125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c6c9a5d3-e5bd-4408-9064-537def51a6f9 req-2ff61db8-2602-4bd0-994c-2f552ede1bb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080176 Jul 30 21:20:05.285687 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2311/4580] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:05.585565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:05.602666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ee8f8d1-6ec5-4fd5-9f1b-99a4fbf2411c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.946165 Jul 30 21:20:05.605779 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2270/4581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:04 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:05.637569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-115580691"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:05.647854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:05.676579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:05.680631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:05.684992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:05.686192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:05.738284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:05.821377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:05.823359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:05.855720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:05.859688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:05.863526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:05.868190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:06.252158 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18806714-839e-4d30-9936-c1c579cb868a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.625863 Jul 30 21:20:06.257005 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2312/4582] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:20:05 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 30 21:20:06.802666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:06.822377 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1270 microversion: 2.1 time: 1.008651 Jul 30 21:20:06.824468 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2271/4583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:05 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1270 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:07.375072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-19a8d2a8-5c3a-4db1-b769-b140e411cd31 req-790677e9-8e5d-4ebb-b308-2668a165157b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-unplugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:07.411398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-19a8d2a8-5c3a-4db1-b769-b140e411cd31 req-790677e9-8e5d-4ebb-b308-2668a165157b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:07.413078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-19a8d2a8-5c3a-4db1-b769-b140e411cd31 req-790677e9-8e5d-4ebb-b308-2668a165157b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:07.446102 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-19a8d2a8-5c3a-4db1-b769-b140e411cd31 req-790677e9-8e5d-4ebb-b308-2668a165157b service nova] Creating event network-vif-unplugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:20:07.469821 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-19a8d2a8-5c3a-4db1-b769-b140e411cd31 req-790677e9-8e5d-4ebb-b308-2668a165157b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103888 Jul 30 21:20:07.471627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2313/4584] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:07.663997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:07.665044 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd55d0a0-c176-4c13-82dc-6f1d93211d0b tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001711 Jul 30 21:20:07.665388 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2272/4585] 10.222.0.17 () {56 vars in 886 bytes} [Sat Jul 30 21:20:07 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 30 21:20:07.854997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:07.856128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:07.880092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:07.881071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:07.882021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:07.883675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:08.280332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:08.307875 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d15f342-e03c-4673-b326-03b1ac85b8c6 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1458 microversion: 2.1 time: 0.459368 Jul 30 21:20:08.308728 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2314/4586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:07 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1458 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:08.331457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:08.332762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:08.363720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:08.365720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:08.369046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:08.369645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:08.680701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:08.694919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfa5ab25-b16d-4f15-a707-9e769b347b35 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1458 microversion: 2.1 time: 0.366896 Jul 30 21:20:08.696900 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2273/4587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:08 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1458 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:10.041402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a53ef47d-e21a-4475-ae44-e191394bb9e8 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Action: 'create', calling method: .version_select at 0x7fbb4fbc2af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2107818118", "metadata": {"Type": "work"}}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:10.760320 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a53ef47d-e21a-4475-ae44-e191394bb9e8 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.423587 Jul 30 21:20:10.760949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2315/4588] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Jul 30 21:20:09 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 30 21:20:10.776129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6d249d35-fa9f-49a2-8be0-19fe93daad36 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4feb9e50>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:10.931657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6d249d35-fa9f-49a2-8be0-19fe93daad36 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 200 len: 346 microversion: 2.1 time: 0.160244 Jul 30 21:20:10.933580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2274/4589] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:10 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:11.947772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac933718-da6a-40f8-9af2-9d9de56dfa8d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4fc921f0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:12.078372 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac933718-da6a-40f8-9af2-9d9de56dfa8d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 200 len: 347 microversion: 2.1 time: 0.135604 Jul 30 21:20:12.079485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2316/4590] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:11 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 347 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:12.104573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a2535c2-db3c-43a4-bbad-8c676af61127 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4fea2820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:12.264860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a2535c2-db3c-43a4-bbad-8c676af61127 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 200 len: 347 microversion: 2.1 time: 0.175064 Jul 30 21:20:12.266149 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2275/4591] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:12 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 347 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:12.283132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c31eef5-090c-4986-9055-dc9e48db8de2 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4fc4b5e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:12.454723 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c31eef5-090c-4986-9055-dc9e48db8de2 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 202 len: 0 microversion: 2.1 time: 0.177860 Jul 30 21:20:12.456334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2317/4592] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:20:12 2022] DELETE /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:20:12.466205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd3347ec-f9c8-44f9-94b5-b143c7d15050 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4fe5f820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:12.695539 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd3347ec-f9c8-44f9-94b5-b143c7d15050 tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 200 len: 346 microversion: 2.1 time: 0.232114 Jul 30 21:20:12.696334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2276/4593] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:12 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:20:13.712362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fded4172-9767-472d-98e1-aa96610be05a tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb4fc4b790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:13.876352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fded4172-9767-472d-98e1-aa96610be05a tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 200 len: 346 microversion: 2.1 time: 0.169304 Jul 30 21:20:13.876941 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2318/4594] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:13 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:14.892834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5445c44a-1edb-4f6a-9745-f351dd8d4e7d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Calling method '.version_select at 0x7fbb5d33cb80>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:14.977090 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5445c44a-1edb-4f6a-9745-f351dd8d4e7d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] HTTP exception thrown: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5445c44a-1edb-4f6a-9745-f351dd8d4e7d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Request method failure captured: Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 HTTP/1.1 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCJCsg-9OaJJoLWYYD0YuqQKZCCSbHnI2_XlSzSfTLo1TCkXygr5n7Am4qZy7ZxubkusRt3ZZQVB-vhSkJC9OovBlfupY8cJyozeCP-ww8Akgrjc7I7crvdZKSMzD2ntPqVdGrqjadgVWTmaVZev3ivpmB2wYYUHj4vfKnMjiyh11U Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: e51697dcd2494de8b5490f69ff651744 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesGetTestJSON-253130318 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e51697dcd2494de8b5490f69ff651744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e51697dcd2494de8b5490f69ff651744", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e51697dcd2494de8b5490f69ff651744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e51697dcd2494de8b5490f69ff651744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesGetTestJSON-253130318 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: e51697dcd2494de8b5490f69ff651744 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesGetTestJSON-253130318 Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesGetTestJSON-253130318-project Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7e4674f50d704f93a4c488a7c83056bb Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesGetTestJSON-253130318-project Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: method: Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: exception: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '64c8a78a-07e4-44a0-a9a7-5e0dd26dd400'} Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. (HTTP 404) (Request-ID: req-122c3f0d-9600-4218-835c-ae264b866935) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 21:20:14.981630 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. Jul 30 21:20:14.987995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:20:14.993040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5445c44a-1edb-4f6a-9745-f351dd8d4e7d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] Returning 404 to user: Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:20:14.994274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5445c44a-1edb-4f6a-9745-f351dd8d4e7d tempest-VolumesGetTestJSON-253130318 tempest-VolumesGetTestJSON-253130318-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400" status: 404 len: 109 microversion: 2.1 time: 0.108113 Jul 30 21:20:14.995509 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2277/4595] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:20:14 2022] GET /compute/v2.1/os-volumes/64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:20:16.567307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-536eb093-b255-4351-800b-d59459dfe8c0 req-482a50d9-b924-4523-af2f-d09f0bbd339d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-plugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:16.596329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-536eb093-b255-4351-800b-d59459dfe8c0 req-482a50d9-b924-4523-af2f-d09f0bbd339d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:16.604818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-536eb093-b255-4351-800b-d59459dfe8c0 req-482a50d9-b924-4523-af2f-d09f0bbd339d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:16.672203 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-536eb093-b255-4351-800b-d59459dfe8c0 req-482a50d9-b924-4523-af2f-d09f0bbd339d service nova] Creating event network-vif-plugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:20:16.694633 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-536eb093-b255-4351-800b-d59459dfe8c0 req-482a50d9-b924-4523-af2f-d09f0bbd339d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133459 Jul 30 21:20:16.695317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2319/4596] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:19.290970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:19.290970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:19.293191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:19.324001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:19.325234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:19.362014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Creating event network-changed:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:20:19.430155 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144085 Jul 30 21:20:19.431243 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2278/4597] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:21.310916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:21.330081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=27 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:21.342368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:21.342888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:21.371750 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Creating event network-changed:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:20:21.400554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093806 Jul 30 21:20:21.403266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2320/4598] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:22.998607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:23.000524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002427 Jul 30 21:20:23.001176 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2279/4599] 10.222.0.17 () {56 vars in 886 bytes} [Sat Jul 30 21:20:22 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 30 21:20:23.010651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:23.012701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] 10.222.0.17 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002681 Jul 30 21:20:23.013287 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2321/4600] 10.222.0.17 () {54 vars in 1035 bytes} [Sat Jul 30 21:20:23 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 30 21:20:23.021794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:23.023201 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-df6f513d-fa0f-4221-a6dc-2d7e227c3812 req-2867deb1-9398-44a4-a0f9-beceab1672f6 service nova] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002268 Jul 30 21:20:23.023836 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2280/4601] 10.222.0.17 () {54 vars in 1041 bytes} [Sat Jul 30 21:20:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:23.035399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:23.037431 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b9dafe45-3b8d-4772-a416-fda6b00eecbd req-3bdb056b-0579-4d6c-9f50-cf6cf568d7de service nova] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002529 Jul 30 21:20:23.038158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2322/4602] 10.222.0.17 () {56 vars in 886 bytes} [Sat Jul 30 21:20:23 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 30 21:20:23.449631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-eced54dd-c27a-4b85-bb80-b74483bc2d5a req-bd2ae951-de53-4b94-bff1-0a68201216df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:23.484987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-eced54dd-c27a-4b85-bb80-b74483bc2d5a req-bd2ae951-de53-4b94-bff1-0a68201216df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:23.490520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-eced54dd-c27a-4b85-bb80-b74483bc2d5a req-bd2ae951-de53-4b94-bff1-0a68201216df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:23.536080 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-eced54dd-c27a-4b85-bb80-b74483bc2d5a req-bd2ae951-de53-4b94-bff1-0a68201216df service nova] Creating event network-changed:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:20:23.552202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-eced54dd-c27a-4b85-bb80-b74483bc2d5a req-bd2ae951-de53-4b94-bff1-0a68201216df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106314 Jul 30 21:20:23.556295 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2281/4603] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:27.943583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:27.944329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:27.959340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:27.960128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:27.961052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:27.961573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:28.451604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:28.465405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:28.467151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:28.483264 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-691a084a-f9ff-4145-8b8b-9380030f666a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2944 microversion: 2.42 time: 0.546305 Jul 30 21:20:28.483898 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2323/4604] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:20:27 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2944 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:20:28.518040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:28.520936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:28.537557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:28.542439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:28.545663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:28.546984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:28.781485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20597124-0f28-44ab-9dee-7b65f947dd5a tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.270389 Jul 30 21:20:28.782497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2282/4605] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Jul 30 21:20:28 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444/os-interface => generated 1831 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:20:36.192503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:36.193529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:36.213543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:36.214413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:36.216684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:36.222187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:36.288353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:37.382990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:37.402313 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44ce7caa-451b-4d02-9658-8d1a8a69beac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.216093 Jul 30 21:20:37.405828 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2324/4606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:36 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:37.434246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-83709683"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:37.437875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:37.461240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:37.461732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:37.462562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:37.463026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:38.058153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-58de2373-cda4-4e11-8dee-544d9541b157 req-c9972ae2-0099-4634-bc80-f869f65d023a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-unplugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:38.080925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-58de2373-cda4-4e11-8dee-544d9541b157 req-c9972ae2-0099-4634-bc80-f869f65d023a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:38.082584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-58de2373-cda4-4e11-8dee-544d9541b157 req-c9972ae2-0099-4634-bc80-f869f65d023a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:38.129150 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-58de2373-cda4-4e11-8dee-544d9541b157 req-c9972ae2-0099-4634-bc80-f869f65d023a service nova] Creating event network-vif-unplugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:20:38.138881 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-58de2373-cda4-4e11-8dee-544d9541b157 req-c9972ae2-0099-4634-bc80-f869f65d023a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085391 Jul 30 21:20:38.141568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2325/4607] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:20:38.500163 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8da8dacc-2820-4961-9c9e-a4c939a03dcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 1.069904 Jul 30 21:20:38.508952 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2283/4608] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:20:37 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 30 21:20:38.514209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:38.515182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:38.539027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:38.539641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:38.542098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:38.542560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:38.858821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:38.875139 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c5f3630-b1df-4255-b659-bd7f98355aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.365562 Jul 30 21:20:38.877495 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2326/4609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:38 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:39.904267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:39.906706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:39.926520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:39.927304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:39.928273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:39.932105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:40.264557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:40.280848 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-10eb3cd5-d9dd-478a-abcc-543b38ba5bd7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.382085 Jul 30 21:20:40.283533 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2327/4610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:39 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:40.342440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-18674f65-490c-41f3-9bf3-d6ab96b0d610 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: .version_select at 0x7fbb4fe5f700>, body: {"keypair": {"name": "tempest-keypair-1987296224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPoEBhnBxD8vSZQThnM5o32/IlHo2VrynOrKYpwc7hJCV3386fAs1xKM9Jw0B0ehvzSVHm7WBJqtDFxiI1vMJZ4ilZTzi0S8jF3YCXoGJ0qhl1ZdU4aC+ei9fSfUttAUA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:40.393145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-18674f65-490c-41f3-9bf3-d6ab96b0d610 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:20:40.408108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-18674f65-490c-41f3-9bf3-d6ab96b0d610 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:20:40.474100 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-18674f65-490c-41f3-9bf3-d6ab96b0d610 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.668587 Jul 30 21:20:40.479479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2284/4611] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:20:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:41.318752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:41.321212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:41.346875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:41.347598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:41.348604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:41.349480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:41.863951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:41.875703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30b832e6-48ce-4979-a194-61576733fc28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1685 microversion: 2.1 time: 0.565912 Jul 30 21:20:41.877076 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2328/4612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:41 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1685 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:42.902650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:42.903928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:42.923955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:42.925398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:42.926468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:42.929592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:43.484776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:43.499482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-788e725d-f606-4669-97a8-12bdab25fa90 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.604949 Jul 30 21:20:43.500729 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2285/4613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:42 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:44.531032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:44.533016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:44.589620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:44.591561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:44.598895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:44.601289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:45.484071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:45.497806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c2ea816-077e-4424-99ef-50ffacb7a176 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.973827 Jul 30 21:20:45.502327 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2329/4614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:44 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:45.942167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1728162622", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a87f0dd3-85a2-450b-921c-516df3eac226"}], "security_groups": [{"name": "tempest-securitygroup--1214632519"}], "key_name": "tempest-keypair-1987296224", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:46.482677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b519e489-c8db-487c-8b3b-6c8de5912cae req-0b0c4565-f9fc-4e77-8d4a-058009ceb7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-plugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:46.500938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] validate_networks() for [('a87f0dd3-85a2-450b-921c-516df3eac226', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:20:46.513026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b519e489-c8db-487c-8b3b-6c8de5912cae req-0b0c4565-f9fc-4e77-8d4a-058009ceb7d7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:46.513732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b519e489-c8db-487c-8b3b-6c8de5912cae req-0b0c4565-f9fc-4e77-8d4a-058009ceb7d7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:46.550350 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b519e489-c8db-487c-8b3b-6c8de5912cae req-0b0c4565-f9fc-4e77-8d4a-058009ceb7d7 service nova] Creating event network-vif-plugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:20:46.577314 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b519e489-c8db-487c-8b3b-6c8de5912cae req-0b0c4565-f9fc-4e77-8d4a-058009ceb7d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099055 Jul 30 21:20:46.578262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2330/4615] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:20:46.590678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:46.593119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:46.612865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:46.613614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:46.616115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:46.617314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:47.481472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:47.514071 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe8f1941-544b-4b47-9b6c-470578f79861 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.909715 Jul 30 21:20:47.535640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2331/4616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:46 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:48.462392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:20:48.462931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:20:48.463766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:20:48.464397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:20:48.465134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:20:48.487494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:48.491989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:48.493131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:48.496440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:48.538331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:20:48.539816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:48.540551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:48.546380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:20:48.557850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:48.559052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:48.561535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:48.561997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:48.563830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:20:48.566674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:20:48.686192 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-497d2823-ad46-4250-b6b6-bbecf0fbe56e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.749213 Jul 30 21:20:48.687787 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2286/4617] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:20:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:20:48.707464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c338af3-5cae-4c8e-8bec-126a4d7f4a54 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:48.708486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c338af3-5cae-4c8e-8bec-126a4d7f4a54 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:49.099801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0c338af3-5cae-4c8e-8bec-126a4d7f4a54 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:49.108700 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c338af3-5cae-4c8e-8bec-126a4d7f4a54 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1242 microversion: 2.1 time: 0.407177 Jul 30 21:20:49.112845 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2287/4618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:48 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1242 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:49.162995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:49.174950 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45af5af5-2aec-4287-b4c9-1f40132a108a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.639671 Jul 30 21:20:49.178983 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2332/4619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:48 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:50.141750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:50.142530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:50.163437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.165458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.166284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.166734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.395680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:50.406503 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5ddaa48-9cc9-4847-b8f8-85b58a89718f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1238 microversion: 2.1 time: 0.268697 Jul 30 21:20:50.425978 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2333/4620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:50 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1238 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:20:50.453138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:50.472036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:50.487000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.487782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.488960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.492610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.689453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Calling method '.version_select at 0x7fbb4fe52940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:50.692181 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:20:50.692181 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:20:50.694043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.694758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.700405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:50.745268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:50.753377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.754623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.782966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:50.783856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:50.793893 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-767d35fa-39e3-4bb0-b315-bc9a41b8cc64 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908 tempest-PortsAdminExtendedAttrsIpV6TestJSON-908415908-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.763635 Jul 30 21:20:50.795212 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2288/4621] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:20:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:51.149075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:51.165592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6b6fb92-2656-44de-854f-41e03ffe47f4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.735700 Jul 30 21:20:51.168074 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2334/4622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:50 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:51.431592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:51.432329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:51.444440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:51.446805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:51.448096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:51.450892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:51.597102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:51.608253 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56990cb8-09b8-4bff-b369-63ba3619de80 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1300 microversion: 2.1 time: 0.181257 Jul 30 21:20:51.627021 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2289/4623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:51 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:52.190619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:52.191386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:52.204795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=26 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:52.208605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:52.209219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:52.212437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:52.213179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:52.537430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:52.549085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ff172d55-77f1-4510-9396-36dc110bc786 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.360638 Jul 30 21:20:52.559796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2335/4624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:52 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:52.634574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:52.635429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:52.646887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:52.652111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:52.653557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:52.654311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:53.573509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:53.574875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:53.602528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:53.603010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:53.603851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:53.604308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:53.630604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:53.645193 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4d666d8-f672-4a1b-8d8e-68323eb8d8ca tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 1.014841 Jul 30 21:20:53.647263 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2290/4625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:52 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:54.315118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:54.334281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf452468-816a-4213-8821-f0bffdcb4167 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.760093 Jul 30 21:20:54.335202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2336/4626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:53 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:54.671583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:54.673531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:54.694257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:54.697517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:54.703244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:54.706885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:55.356680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:55.358539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:55.379563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:55.380289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:55.381863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:55.383791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:55.448120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:55.464309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc99f4c0-ccbe-4a91-9a93-91e2a1f9c20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.795049 Jul 30 21:20:55.468117 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2291/4627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:54 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:55.896819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:55.905287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d327871f-bf4e-435d-bf2d-5a22c1638999 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.552835 Jul 30 21:20:55.912104 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2337/4628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:55 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:56.480086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-087e18e9-104b-474d-9231-a26a3623d1b8 req-4b87a2b3-e485-47ef-b434-eec61cee15e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa909cf-9974-49fe-9b0e-285825175258", "tag": "e1567ead-33c9-41d5-9d9c-41129c278d9c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:20:56.490247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:56.492289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:56.500375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-087e18e9-104b-474d-9231-a26a3623d1b8 req-4b87a2b3-e485-47ef-b434-eec61cee15e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:56.505648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-087e18e9-104b-474d-9231-a26a3623d1b8 req-4b87a2b3-e485-47ef-b434-eec61cee15e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:56.507453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:56.510360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:56.511533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:56.512440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:56.535463 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-087e18e9-104b-474d-9231-a26a3623d1b8 req-4b87a2b3-e485-47ef-b434-eec61cee15e7 service nova] Creating event network-changed:e1567ead-33c9-41d5-9d9c-41129c278d9c for instance 0fa909cf-9974-49fe-9b0e-285825175258 on nch1-master-1 Jul 30 21:20:56.553268 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-087e18e9-104b-474d-9231-a26a3623d1b8 req-4b87a2b3-e485-47ef-b434-eec61cee15e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076700 Jul 30 21:20:56.556419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2292/4629] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:20:56.707679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:56.720612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7afe032-e50c-495c-acbe-bd2e2d859848 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.234064 Jul 30 21:20:56.721786 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2338/4630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:56 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:56.934771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:56.935517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:56.953403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:56.954445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:56.955378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:56.962327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:57.743895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:57.744430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:57.755853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:57.756351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:57.757149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:57.757710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:58.100212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:58.109658 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-10f4b365-38a7-4e01-af7d-3758334b1663 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.369771 Jul 30 21:20:58.129961 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2339/4631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:57 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:58.184523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:58.207461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43462350-46d2-4432-b6fb-7a9f2e3a2d98 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 1.276092 Jul 30 21:20:58.216607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2293/4632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:56 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:59.134367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:59.135838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:59.153673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:59.154158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:59.155174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:59.159358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:59.230535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:20:59.231164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:20:59.238546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:59.239616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:59.245241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:59.246969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:59.248567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:20:59.249442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:20:59.899626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:59.913163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:20:59.919493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-977c99fe-1e8b-4cd2-8c25-c693ec710a92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.789811 Jul 30 21:20:59.942554 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2340/4633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:59 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:20:59.950421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e3421869-6c84-452f-a787-89bcb175021c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.715043 Jul 30 21:20:59.960054 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2294/4634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:20:59 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:00.950890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:00.951565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:00.967843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:00.973057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:00.976050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:00.977228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:00.981242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:00.982015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:01.018415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:01.019496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:01.021430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:01.023094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:01.586333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:01.605139 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0cf700b-dc83-49a5-8212-0c52f053f99e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.662491 Jul 30 21:21:01.611796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2341/4635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:00 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:01.843629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:01.852418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5cceb534-ccf4-4d59-9f79-0e078348620b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.875991 Jul 30 21:21:01.878919 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2295/4636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:00 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:02.633852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:02.635126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:02.651644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:02.653315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:02.656258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:02.657002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:02.665245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:02.885070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:02.885743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:02.909671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:02.910143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:02.910959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:02.911479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:03.239572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:03.248168 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8c980db5-33dd-44d5-b3d1-e24d2a09809d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.619408 Jul 30 21:21:03.248779 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2342/4637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:02 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:03.520153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:03.549718 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa1476c9-d208-4275-b014-67aff97ec302 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.664970 Jul 30 21:21:03.569643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2296/4638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:02 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:03.600972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-05efdf78-638d-4fb9-a5fa-589641597bbb req-885b5aff-63c7-4aae-aff6-1ec4c87b4b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa909cf-9974-49fe-9b0e-285825175258", "name": "network-vif-plugged", "status": "completed", "tag": "e1567ead-33c9-41d5-9d9c-41129c278d9c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:03.623229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-05efdf78-638d-4fb9-a5fa-589641597bbb req-885b5aff-63c7-4aae-aff6-1ec4c87b4b1f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:03.632726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-05efdf78-638d-4fb9-a5fa-589641597bbb req-885b5aff-63c7-4aae-aff6-1ec4c87b4b1f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:03.671934 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-05efdf78-638d-4fb9-a5fa-589641597bbb req-885b5aff-63c7-4aae-aff6-1ec4c87b4b1f service nova] Creating event network-vif-plugged:e1567ead-33c9-41d5-9d9c-41129c278d9c for instance 0fa909cf-9974-49fe-9b0e-285825175258 on nch1-master-1 Jul 30 21:21:03.696043 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-05efdf78-638d-4fb9-a5fa-589641597bbb req-885b5aff-63c7-4aae-aff6-1ec4c87b4b1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098444 Jul 30 21:21:03.700083 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2343/4639] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:04.275684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:04.277089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:04.294848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:04.298101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:04.299694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:04.304115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:04.576437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:04.577502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:04.593970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:04.594824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:04.601065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:04.601869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:04.806968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:04.834400 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-326f844b-9102-4967-a21d-917b55a2a039 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1368 microversion: 2.1 time: 0.564493 Jul 30 21:21:04.850980 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2297/4640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:04 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1368 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:05.222038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:05.241151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dab876a5-edd6-41d9-95a5-f92650c755e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.664623 Jul 30 21:21:05.241850 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2344/4641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:04 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:05.858972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:05.860444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:05.874108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:05.876910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:05.879746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:05.880590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:06.271018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:06.272238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:06.300109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:06.317899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:06.333481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:06.334701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:06.382496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:06.393035 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3435cd8-df1d-42ac-97aa-12882fc1a26e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1558 microversion: 2.1 time: 0.538750 Jul 30 21:21:06.396725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2298/4642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:05 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1558 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:06.421196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:06.421833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:06.436386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:06.437152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:06.438407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:06.439058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:06.668129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b123b83-eecd-4887-ae41-3a7e7dc2744d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252664 Jul 30 21:21:06.668996 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2299/4643] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:21:06 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:06.933821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:06.959585 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57c20f5b-c8b4-4470-9104-45b40e98d0d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.689775 Jul 30 21:21:06.978047 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2345/4644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:06 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:07.980577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:07.981216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:08.000087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:08.000087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:08.016543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:08.018609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:08.713431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:08.728936 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1969bde1-aeaa-4a9f-bdbd-e114710a6ebd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1680 microversion: 2.1 time: 0.753697 Jul 30 21:21:08.729534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2300/4645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:07 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1680 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:09.749960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:09.750724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:09.764117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:09.764578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:09.766400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:09.767009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:09.932083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3b43a8a8-cbc9-4464-9a21-fd444a8cf83c req-ddd96d46-9d46-4a13-b971-8018ef34feda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa909cf-9974-49fe-9b0e-285825175258", "tag": "e1567ead-33c9-41d5-9d9c-41129c278d9c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:09.946292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3b43a8a8-cbc9-4464-9a21-fd444a8cf83c req-ddd96d46-9d46-4a13-b971-8018ef34feda service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:09.946731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3b43a8a8-cbc9-4464-9a21-fd444a8cf83c req-ddd96d46-9d46-4a13-b971-8018ef34feda service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:09.976918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3b43a8a8-cbc9-4464-9a21-fd444a8cf83c req-ddd96d46-9d46-4a13-b971-8018ef34feda service nova] Creating event network-changed:e1567ead-33c9-41d5-9d9c-41129c278d9c for instance 0fa909cf-9974-49fe-9b0e-285825175258 on nch1-master-1 Jul 30 21:21:09.987988 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3b43a8a8-cbc9-4464-9a21-fd444a8cf83c req-ddd96d46-9d46-4a13-b971-8018ef34feda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249408 Jul 30 21:21:09.993733 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2346/4646] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:10.154495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:10.171873 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d49c428f-8982-4a00-9b66-e6fe72ed1564 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.424664 Jul 30 21:21:10.189271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2301/4647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:09 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:10.345864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:10.346751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:10.361902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:10.362819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:10.363666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:10.364120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:10.924095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:10.947470 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc144c63-9745-4abc-99db-ea341bc88595 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.605392 Jul 30 21:21:10.953082 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2347/4648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:10 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:12.226882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8aa305e7-1b7f-4dc9-8313-6ac8707b0a04 req-ad823a23-8efd-456e-8433-e918c87e7c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-unplugged", "status": "completed", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:12.242772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8aa305e7-1b7f-4dc9-8313-6ac8707b0a04 req-ad823a23-8efd-456e-8433-e918c87e7c77 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:12.247319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8aa305e7-1b7f-4dc9-8313-6ac8707b0a04 req-ad823a23-8efd-456e-8433-e918c87e7c77 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:12.277075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8aa305e7-1b7f-4dc9-8313-6ac8707b0a04 req-ad823a23-8efd-456e-8433-e918c87e7c77 service nova] Creating event network-vif-unplugged:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:21:12.289182 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8aa305e7-1b7f-4dc9-8313-6ac8707b0a04 req-ad823a23-8efd-456e-8433-e918c87e7c77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067402 Jul 30 21:21:12.291925 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2302/4649] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:21:13.835549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:13.836887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:13.857851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:13.860392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:13.861233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:13.861725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:14.236946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:14.251554 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fbf93de8-0e22-49dc-a12b-59e64edf1ef6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.420069 Jul 30 21:21:14.253858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2348/4650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:13 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:14.275807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:14.276532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:14.289788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:14.292520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:14.293587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:14.296801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:14.717323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:14.729023 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09f89d00-f921-40a5-892e-03f0e3b7b23a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.457697 Jul 30 21:21:14.735992 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2303/4651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:14 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:14.756110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:14.756724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:14.767921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:14.768399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:14.770218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:14.770896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:15.040189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:15.051523 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b978a8d-11d4-4cd2-b7bb-04d6119ee261 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.299645 Jul 30 21:21:15.077851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:15.080839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:15.082334 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2349/4652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:14 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:15.092476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:15.092955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:15.094549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:15.095020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:15.243593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77418175-db75-4c8d-9c18-4d645d255905 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.169715 Jul 30 21:21:15.244819 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2304/4653] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:21:15 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:21:15.253449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:15.254470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:15.271057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:15.272159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:15.273225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:15.273846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:15.938971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:15.949507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bdb2eb7-9575-4286-98dc-742a6fbc4763 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1669 microversion: 2.1 time: 0.700230 Jul 30 21:21:15.951093 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2350/4654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:15 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1669 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:16.977155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:16.982435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:17.004076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:17.005597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:17.006826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:17.008910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:17.068615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:17.852298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:17.866697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1134583a-61eb-46fd-82d2-d289fee99cf6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1669 microversion: 2.1 time: 0.895228 Jul 30 21:21:17.867981 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2305/4655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:16 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1669 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:18.898067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:18.900121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:18.922193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:18.922902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:18.924502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:18.927879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:19.591698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:19.601640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-460bafc6-c4f2-4ca1-b026-cd0ded07b6ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1674 microversion: 2.1 time: 0.710873 Jul 30 21:21:19.602492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2351/4656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:18 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1674 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:20.627803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:20.629214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:20.640524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:20.641993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:20.643037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:20.643763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.430667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:21.440806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87c95147-c1b4-46bc-9873-de009a61784b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.819499 Jul 30 21:21:21.457486 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2306/4657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:20 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:21.464395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:21.469262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:21.478591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.479414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.480402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.481037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.546070 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49bc6bf4-be21-4ba0-8d1c-a2e3d003bfa2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 200 len: 321 microversion: 2.1 time: 0.084430 Jul 30 21:21:21.549701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2352/4658] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:21:21 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 321 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:21:21.564252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:21.565385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:21.573289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=40 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:21.575044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.575881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.577615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.578802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.887032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:21.887676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:21.901089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.901400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.902218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:21.908054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:21.962336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:21:22.119174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 204 len: 0 microversion: 2.1 time: 0.235828 Jul 30 21:21:22.123030 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2353/4659] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:21:21 2022] DELETE /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:21:22.565723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:22.580673 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4f250b9-bdcb-40b2-a9c8-c84a7030d54c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.021935 Jul 30 21:21:22.593066 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2307/4660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:21 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:22.602272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:22.605479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:22.632800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:22.634871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:22.637524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:22.638370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:22.657321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-db23655c-5f47-4b3c-b0a9-9fdba3b734c5 req-7143d2d7-26cb-4c39-81f8-366d4edce7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:22.681920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:22.688720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-db23655c-5f47-4b3c-b0a9-9fdba3b734c5 req-7143d2d7-26cb-4c39-81f8-366d4edce7df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:22.693214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-db23655c-5f47-4b3c-b0a9-9fdba3b734c5 req-7143d2d7-26cb-4c39-81f8-366d4edce7df service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:22.717450 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-db23655c-5f47-4b3c-b0a9-9fdba3b734c5 req-7143d2d7-26cb-4c39-81f8-366d4edce7df service nova] Creating event network-changed:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:21:22.737464 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-db23655c-5f47-4b3c-b0a9-9fdba3b734c5 req-7143d2d7-26cb-4c39-81f8-366d4edce7df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.614803 Jul 30 21:21:22.738682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2354/4661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:22.744028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:22.744852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:22.761155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:22.761623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:22.762432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:22.762881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:23.479208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:23.492000 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4450682-b198-41b3-9e55-663491e5750e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.752076 Jul 30 21:21:23.492589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2355/4662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:22 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:23.514981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:23.516536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:23.525052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:23.530050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:23.531709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:23.532488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:23.552780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:23.564720 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23e20005-8722-49ed-967a-f4a037abeefc tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1582 microversion: 2.1 time: 0.979130 Jul 30 21:21:23.567619 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2308/4663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:22 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1582 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:24.053060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:24.069140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90929d04-2749-43e5-a982-0a207da79f88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.557598 Jul 30 21:21:24.070752 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2356/4664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:23 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:24.093576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:24.095437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:24.112920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:24.113594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:24.114596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:24.120199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:24.589357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:24.590252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:24.599354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:24.600211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:24.601323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:24.601950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:24.645646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:24.666092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1f31d8f7-7e1b-43c7-ba42-f8fa60ad5369 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.578192 Jul 30 21:21:24.667323 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2309/4665] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:24 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:24.833467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-432368669", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "aa7ed307-3fdf-4329-9a4b-db68b093ba0f"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:24.946517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] validate_networks() for [('aa7ed307-3fdf-4329-9a4b-db68b093ba0f', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:21:25.036596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b80fe0ec404f0480948be6e051c9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd884e1c0861450e9049a966a5931675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:25.065002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51aae839-a23b-4234-849f-89e34cfae17d tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 200 len: 1464 microversion: 2.1 time: 0.478303 Jul 30 21:21:25.065665 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2357/4666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:24 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:25.156265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7234607b-7622-490b-bbca-bd3b715661ad req-70932152-fce2-49df-9e7e-fd23306b1562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2cca3f-681a-4cfa-bf67-738701d501cb", "name": "network-vif-deleted", "tag": "9bde912f-f1ef-4b30-9a97-9991de76d16d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:25.190860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7234607b-7622-490b-bbca-bd3b715661ad req-70932152-fce2-49df-9e7e-fd23306b1562 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:25.191366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7234607b-7622-490b-bbca-bd3b715661ad req-70932152-fce2-49df-9e7e-fd23306b1562 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:25.225912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7234607b-7622-490b-bbca-bd3b715661ad req-70932152-fce2-49df-9e7e-fd23306b1562 service nova] Creating event network-vif-deleted:9bde912f-f1ef-4b30-9a97-9991de76d16d for instance 1f2cca3f-681a-4cfa-bf67-738701d501cb on nch1-master-1 Jul 30 21:21:25.236252 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7234607b-7622-490b-bbca-bd3b715661ad req-70932152-fce2-49df-9e7e-fd23306b1562 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085397 Jul 30 21:21:25.237461 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2358/4667] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:26.087946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:26.088931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] [instance: 1f2cca3f-681a-4cfa-bf67-738701d501cb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:26.097928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:26.098525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:26.099571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:26.100384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:26.116793 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] HTTP exception thrown: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Request method failure captured: Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb HTTP/1.1 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aAqw6uRdYSpTPTZ4scGfTa2j-0clgcZowXnSsmJA8MgdoXjxyVfLJH_XfIk0AciSOSP_zyFbR0erz2_xk3y1G-tM9IgjQjnopBA2aO9xzsUbla8Bcb67bvwfWDmyEx-hvp8DaJ4ERtKoyc4wQKflg89o-N63BgdZn-i54owNSci7SA Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cd884e1c0861450e9049a966a5931675 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBackupRestore-1734134401 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd884e1c0861450e9049a966a5931675"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd884e1c0861450e9049a966a5931675", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd884e1c0861450e9049a966a5931675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd884e1c0861450e9049a966a5931675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBackupRestore-1734134401 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cd884e1c0861450e9049a966a5931675 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1734134401 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBackupRestore-1734134401-project Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f4b80fe0ec404f0480948be6e051c9e4 Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBackupRestore-1734134401-project Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1f2cca3f-681a-4cfa-bf67-738701d501cb'} Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:21:26.118971 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Returning 404 to user: Instance 1f2cca3f-681a-4cfa-bf67-738701d501cb could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50669dad-fe47-41b1-9b3e-4db6db9276dd tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb" status: 404 len: 111 microversion: 2.1 time: 0.037658 Jul 30 21:21:26.126806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2359/4668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:26 2022] GET /compute/v2.1/servers/1f2cca3f-681a-4cfa-bf67-738701d501cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:21:26.593906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc5ce7b4-04f0-4b90-8ec3-3df9ef79d9b4 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] Calling method '.version_select at 0x7fbb4fc6e3a0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:26.618976 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc5ce7b4-04f0-4b90-8ec3-3df9ef79d9b4 tempest-TestVolumeBackupRestore-1734134401 tempest-TestVolumeBackupRestore-1734134401-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1573166841" status: 202 len: 0 microversion: 2.1 time: 0.030331 Jul 30 21:21:26.625093 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2360/4669] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 21:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1573166841 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:21:27.025098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:21:27.025654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:21:27.026326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:21:27.026864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:21:27.027712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:21:27.037607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:27.038178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:27.039318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:27.040016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:27.061633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:21:27.073810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:21:27.093416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:21:27.097470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:21:27.170360 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3272c5e8-b8b9-4534-96c2-53d4aeeabfd1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.342809 Jul 30 21:21:27.172132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2310/4670] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:21:27.186058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b93b04f-e426-4a4a-8789-996a85134b6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:27.186706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b93b04f-e426-4a4a-8789-996a85134b6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:27.342084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b93b04f-e426-4a4a-8789-996a85134b6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:27.352387 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b93b04f-e426-4a4a-8789-996a85134b6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1214 microversion: 2.1 time: 0.172717 Jul 30 21:21:27.356515 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2361/4671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:27 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:28.377543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:28.378430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:28.386946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:28.387779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:28.388763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:28.390257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:28.529340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:28.550013 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-545a946a-4d43-4d44-a893-87f448acd9e4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1210 microversion: 2.1 time: 0.175208 Jul 30 21:21:28.571061 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2311/4672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:28 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1210 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:29.585174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:29.586713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:29.603391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:29.604522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:29.606154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:29.607046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:29.799172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:29.808702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:29.813749 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eed688c3-1bdc-4680-afff-60910b31ac9e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1272 microversion: 2.1 time: 0.238024 Jul 30 21:21:29.834986 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2362/4673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:29 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:30.842194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:30.844190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:30.858261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:30.859151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:30.861477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:30.862170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:31.027825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:31.042887 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70972bd1-1184-4d7b-99aa-08c12419d83f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1272 microversion: 2.1 time: 0.205377 Jul 30 21:21:31.045859 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2312/4674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:30 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:32.072463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:32.073145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:32.085526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:32.086417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:32.088033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:32.088790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:32.780165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:32.793415 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f10b46aa-8475-4e7d-94d1-8f309b3ba969 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.723268 Jul 30 21:21:32.794568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2363/4675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:32 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:32.979502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a78e6a6d-f0ed-4b15-a547-2ce8315362af req-e4cd88a4-835d-466f-b399-a361c3b24090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1dd28c-fd96-473e-9285-5fc7e3d185d9", "tag": "55367a18-1117-4a82-8177-8734df153ee1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:32.995648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a78e6a6d-f0ed-4b15-a547-2ce8315362af req-e4cd88a4-835d-466f-b399-a361c3b24090 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:32.996349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a78e6a6d-f0ed-4b15-a547-2ce8315362af req-e4cd88a4-835d-466f-b399-a361c3b24090 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:33.018515 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a78e6a6d-f0ed-4b15-a547-2ce8315362af req-e4cd88a4-835d-466f-b399-a361c3b24090 service nova] Creating event network-changed:55367a18-1117-4a82-8177-8734df153ee1 for instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 on nch1-master-1 Jul 30 21:21:33.025314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a78e6a6d-f0ed-4b15-a547-2ce8315362af req-e4cd88a4-835d-466f-b399-a361c3b24090 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052482 Jul 30 21:21:33.026548 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2313/4676] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:33.826809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:33.828187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:33.836950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:33.837686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:33.839049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:33.839778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:34.659234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:34.667524 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76a7eba7-64bb-48b4-88c0-8f6a3b5f4638 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.845277 Jul 30 21:21:34.680563 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2364/4677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:33 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:35.706939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:35.708125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:35.724820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:35.728250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:35.729681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:35.731934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:36.412626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:36.436244 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8496bd8-c21e-4c77-84f5-056a551d7010 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.737561 Jul 30 21:21:36.437371 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2314/4678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:35 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:37.464533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:37.466138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:37.480072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:37.485636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:37.487710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:37.489593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:37.491983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:38.381724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:38.393120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3c81f2c2-4035-4aa3-a8dd-98abf341f3d3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.933102 Jul 30 21:21:38.393961 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2365/4679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:37 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:39.419569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:39.419953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:39.423892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:39.427146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:39.453465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:39.457424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:39.458453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:39.459673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:40.123065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:40.134024 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c2ac5dd-eb79-4fc8-948a-ca8d497d290f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.723601 Jul 30 21:21:40.135760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2315/4680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:39 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:40.467575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-866277f5-94d4-4570-a435-52101997e85f req-a47b4863-bd56-4014-bcfa-dc0f932fcb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1dd28c-fd96-473e-9285-5fc7e3d185d9", "name": "network-vif-plugged", "status": "completed", "tag": "55367a18-1117-4a82-8177-8734df153ee1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:40.488402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-866277f5-94d4-4570-a435-52101997e85f req-a47b4863-bd56-4014-bcfa-dc0f932fcb5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:40.489088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-866277f5-94d4-4570-a435-52101997e85f req-a47b4863-bd56-4014-bcfa-dc0f932fcb5f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:40.517127 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-866277f5-94d4-4570-a435-52101997e85f req-a47b4863-bd56-4014-bcfa-dc0f932fcb5f service nova] Creating event network-vif-plugged:55367a18-1117-4a82-8177-8734df153ee1 for instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 on nch1-master-1 Jul 30 21:21:40.523698 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-866277f5-94d4-4570-a435-52101997e85f req-a47b4863-bd56-4014-bcfa-dc0f932fcb5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340138 Jul 30 21:21:40.524882 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2366/4681] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:41.157213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:41.158550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:41.168411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:41.169227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:41.170335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:41.171951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:41.601394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:41.618965 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a6c7136c-ac50-4d7d-92f9-27f8fd50de92 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1314 microversion: 2.1 time: 0.465945 Jul 30 21:21:41.631714 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2316/4682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:41 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:42.643282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:42.644723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:42.656180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:42.656971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:42.657998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:42.658682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:42.898557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:42.910907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1ef5d868-f8eb-4f35-90b5-43728d0656cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1500 microversion: 2.1 time: 0.272974 Jul 30 21:21:42.923996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2367/4683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:42 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:42.936316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0c0547e2-3c32-4d4f-be46-1bcde95f96ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:42.946330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c0547e2-3c32-4d4f-be46-1bcde95f96ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:42.947005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0c0547e2-3c32-4d4f-be46-1bcde95f96ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:43.028595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0c0547e2-3c32-4d4f-be46-1bcde95f96ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:21:43.128720 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0c0547e2-3c32-4d4f-be46-1bcde95f96ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9/action" status: 202 len: 0 microversion: 2.1 time: 0.195994 Jul 30 21:21:43.130854 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2317/4684] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:21:42 2022] POST /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:21:43.140913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:43.142058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:43.151718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:43.157705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:43.161143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:43.164102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:43.665923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:43.677368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3da60184-2e79-470d-89d8-cec52f6eaa7d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.541517 Jul 30 21:21:43.678810 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2368/4685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:43 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:43.930474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:43.931479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:43.946797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:43.946797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:43.946797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:43.947555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:43.996989 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-311e8cac-cb8e-471e-9d0f-db0da66618f6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/ips" status: 200 len: 150 microversion: 2.1 time: 0.071314 Jul 30 21:21:44.011711 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2318/4686] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:21:43 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/ips => generated 150 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:21:44.704178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:44.706766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:44.721369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:44.721868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:44.722689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:44.723136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:45.809048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d160b1f-adc0-4cd3-9332-a6767a4098c9"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:45.814183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:45.827869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:45.828737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:45.829998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:45.830636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:45.831414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:45.844215 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b08dbfa-bcd9-4f12-860c-b905506191ae tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 1.143892 Jul 30 21:21:45.844848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2369/4687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:44 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:46.312416 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510952 Jul 30 21:21:46.313117 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2319/4688] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:21:45 2022] POST /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:46.876712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:46.877581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:46.896365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:46.897370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:46.900991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:46.902346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:47.471762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:47.481860 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-600148ef-2c7d-4dbf-8dfb-2ac05e2285b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.618459 Jul 30 21:21:47.495973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2370/4689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:46 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:48.507094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:48.508545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:48.535703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:48.537424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:48.539005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:48.539922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:48.547096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:49.635202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:49.658590 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eee35cf9-0647-4326-801a-655ac8f3df5c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 1.156606 Jul 30 21:21:49.661626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2320/4690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:48 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:21:50.042927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a861095-0b52-4d3a-a1c8-7f60a8403bff tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: .version_select at 0x7fbb4fc92160>, body: {"keypair": {"name": "tempest-keypair-1869218179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTq1NXe5T2to1ZB5yFJ35g1Hi/sXAoxEpNubMaLEaQ56Hy89T32W90T89BGmFjowhhBINxwDpizbm+1CBPoZInUF845S1t0ubOm5VBOupDr9/CoqAKXAww4FTGl6Dnghg=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:50.071540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9a861095-0b52-4d3a-a1c8-7f60a8403bff tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:21:50.086667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9a861095-0b52-4d3a-a1c8-7f60a8403bff tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:21:50.171047 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a861095-0b52-4d3a-a1c8-7f60a8403bff tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131883 Jul 30 21:21:50.172525 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2371/4691] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:21:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:21:50.697050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:50.698429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:50.710397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:50.722103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:50.723330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:50.724437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:51.038949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:51.048697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80fa62d1-62b6-4d7c-a8f0-8937917599a7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.356067 Jul 30 21:21:51.050129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2321/4692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:50 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:52.073155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:52.075177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:52.101039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:52.101937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:52.106791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:52.107785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:52.445954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:52.464212 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-336e919f-458c-4be5-b019-a1f18a40e9c0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.396887 Jul 30 21:21:52.466059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2372/4693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:52 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:53.486744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:53.487437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:53.490887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:53.517382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:53.518255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:53.520634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:53.526165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:54.200578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:54.211777 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-38a35c71-3965-46a5-8b67-eb40d2fafd44 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.729442 Jul 30 21:21:54.213593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2322/4694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:53 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:54.569275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1423610417", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a87f0dd3-85a2-450b-921c-516df3eac226"}], "security_groups": [{"name": "tempest-securitygroup--188606283"}], "key_name": "tempest-keypair-1869218179", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:21:54.602571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:54.827799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] validate_networks() for [('a87f0dd3-85a2-450b-921c-516df3eac226', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:21:55.234545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:55.235397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:55.255754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:55.261207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:55.263874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:55.265447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:55.757528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:55.768624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fb41c6a-326a-4e60-99dd-f6e8245f6e6f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.537928 Jul 30 21:21:55.771417 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2323/4695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:55 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:56.176367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:21:56.183080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:21:56.184224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:21:56.187647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:21:56.189868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:21:56.203491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:56.204371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:56.205557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:56.206459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:56.229503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:21:56.238713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:21:56.257425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:21:56.260387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:21:56.328086 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2803c94-f647-4980-969e-c7e2c525f615 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.763941 Jul 30 21:21:56.336756 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2373/4696] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:21:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:21:56.365553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9cfd1a61-f794-473e-9b0b-c8eac3d77f92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:56.366325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9cfd1a61-f794-473e-9b0b-c8eac3d77f92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:56.553194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9cfd1a61-f794-473e-9b0b-c8eac3d77f92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:56.561274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9cfd1a61-f794-473e-9b0b-c8eac3d77f92 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1242 microversion: 2.1 time: 0.215757 Jul 30 21:21:56.564308 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2324/4697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:56 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:56.792142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:56.800833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:56.823605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:56.825602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:56.832211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:56.835677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:57.205017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:57.217371 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45c4f2ac-578e-4049-8c51-02dfbf51fd57 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.430277 Jul 30 21:21:57.218170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2374/4698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:56 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:57.585197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:57.586391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:57.601708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:57.602175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:57.607233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:57.607805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:57.788126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:57.804153 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b25d9155-e157-4046-8df4-68e87e387af6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1238 microversion: 2.1 time: 0.223367 Jul 30 21:21:57.805544 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2325/4699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:57 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1238 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:58.243431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:58.244151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:58.265441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:58.265906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:58.266703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:58.267152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:58.643817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:58.687490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3a98812-d89f-41d3-b81c-bec1c29d8310 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.452440 Jul 30 21:21:58.688100 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2375/4700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:58 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:58.833510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:58.834157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:58.841978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:58.843230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:58.844238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:58.844891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:59.200329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:21:59.208768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2384cc15-0b9c-48aa-b842-07bfb4125705 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1300 microversion: 2.1 time: 0.379099 Jul 30 21:21:59.209254 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2326/4701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:58 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1300 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:21:59.712738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:21:59.713982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:21:59.721713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:59.722573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:21:59.723614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:21:59.724294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:00.143439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:00.163702 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e60d0473-801e-4273-9496-5ac5ed029550 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.456252 Jul 30 21:22:00.166624 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2376/4702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:21:59 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:00.230107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:00.231398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:00.246428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:00.247924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:00.252359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:00.253396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:00.482024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:00.494601 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-10e9cef2-e8f4-411b-b479-60518f1fde48 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1300 microversion: 2.1 time: 0.268321 Jul 30 21:22:00.499863 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2327/4703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:00 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:01.191037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:01.192403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:01.219326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:01.221517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:01.230246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:01.231500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:01.524161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:01.526515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:01.538784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:01.539596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:01.542039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:01.542787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:02.246042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:02.262824 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2692f587-19e5-42b6-8510-5620558eaedc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.745595 Jul 30 21:22:02.266876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2328/4704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:01 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:02.294291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:02.302723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=76 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:02.306793 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-569f0494-2d3e-4aec-97bc-b178e038b7b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 1.124688 Jul 30 21:22:02.307403 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2377/4705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:01 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:03.288518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:03.289769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:03.298749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:03.299999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:03.300976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:03.301594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:03.335221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:03.336427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:03.345106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:03.345809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:03.346813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:03.347459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:03.759941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:03.772812 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6dfa06a4-bc56-46e6-9a8e-2f6454ad7c44 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.489038 Jul 30 21:22:03.775401 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2329/4706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:03 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:03.792531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-25c6de1f-2a13-49b7-b342-48b508149727 req-9dac688c-b863-4629-baac-ae7f59766022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75379208-09c6-4e01-aeda-2b121b343517", "tag": "2c242c24-8d24-48f6-a322-cda9b3375073"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:03.806220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25c6de1f-2a13-49b7-b342-48b508149727 req-9dac688c-b863-4629-baac-ae7f59766022 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:03.807006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25c6de1f-2a13-49b7-b342-48b508149727 req-9dac688c-b863-4629-baac-ae7f59766022 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:03.840896 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-25c6de1f-2a13-49b7-b342-48b508149727 req-9dac688c-b863-4629-baac-ae7f59766022 service nova] Creating event network-changed:2c242c24-8d24-48f6-a322-cda9b3375073 for instance 75379208-09c6-4e01-aeda-2b121b343517 on nch2-master-1 Jul 30 21:22:03.853317 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-25c6de1f-2a13-49b7-b342-48b508149727 req-9dac688c-b863-4629-baac-ae7f59766022 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074878 Jul 30 21:22:03.857204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2330/4707] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:04.129374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:04.141078 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a752e4d9-f1fc-438e-8ad5-9259d8b7d4d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.815337 Jul 30 21:22:04.155938 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2378/4708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:03 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:04.799453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:04.800794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:04.807946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:04.808642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:04.809628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:04.810264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:05.137421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:05.150738 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-535c022c-0ac0-4e2b-afc3-f015ca571a75 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.357013 Jul 30 21:22:05.162201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:05.163499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:05.168886 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2331/4709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:04 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:05.175552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:05.177309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:05.178140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:05.178699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:05.699688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:05.737104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a558fcd-0128-4d7a-a433-48cc12a82642 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.575651 Jul 30 21:22:05.738192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2379/4710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:05 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:06.177918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:06.178703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:06.198721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:06.199608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:06.205740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:06.206538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:06.526448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:06.548991 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f5b60603-0eee-49f9-8ebd-276d7a244b39 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.375447 Jul 30 21:22:06.550571 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2332/4711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:06 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:06.766473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:06.768425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:06.774787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:06.776717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:06.793013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:06.793905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:06.795413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:06.796653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:07.397834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:07.407083 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a227a42e-2259-44f2-a476-bf0c941c175a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.652044 Jul 30 21:22:07.412913 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2380/4712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:06 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:07.572193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:07.572894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:07.575356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:07.586767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:07.588710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:07.592314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:07.593177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:07.945041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:07.963190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd1e8e94-d162-4bdb-8a7a-1df1711c150d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.394771 Jul 30 21:22:07.966311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2333/4713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:07 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:08.436551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:08.437372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:08.454219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:08.455886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:08.457845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:08.461682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:08.843745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:08.858431 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1f2bb71-8e7a-4a4e-b861-f9c90243ab33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1510 microversion: 2.1 time: 0.422973 Jul 30 21:22:08.860312 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2381/4714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:08 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:08.988562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:08.989922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:09.005531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:09.007254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:09.009786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:09.011569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:09.664982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:09.677220 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc491e87-a689-43ba-b273-c06b8970e8c6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.694961 Jul 30 21:22:09.694178 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2334/4715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:08 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:09.882648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:09.884395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:09.898329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:09.899014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:09.900910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:09.902310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.421273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:10.439153 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22830c6b-813c-40ea-8df6-b7215d1ab161 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1487 microversion: 2.1 time: 0.562486 Jul 30 21:22:10.444264 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2382/4716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:09 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1487 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:10.463738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:10.467487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:10.481083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.490236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.491433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.492051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.586268 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d5394d97-5981-415d-a9f5-b52575b5fa9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 200 len: 122 microversion: 2.1 time: 0.126412 Jul 30 21:22:10.591671 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2335/4717] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:10 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 122 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:10.597660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:10.598977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:10.606715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.610073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.614144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.614919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.701671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:10.702391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:10.715454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.716223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:10.724707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:10.725434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:11.093985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:11.109163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47ce29d7-7e98-4d65-9e9d-540288f14771 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.515294 Jul 30 21:22:11.120495 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2383/4718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:10 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:11.140645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4df36d2a-7d67-4e52-8ba6-486afedf8364 req-d128ee07-ab50-40c0-83ca-bb65dfe8c0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75379208-09c6-4e01-aeda-2b121b343517", "name": "network-vif-plugged", "status": "completed", "tag": "2c242c24-8d24-48f6-a322-cda9b3375073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:11.155979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4df36d2a-7d67-4e52-8ba6-486afedf8364 req-d128ee07-ab50-40c0-83ca-bb65dfe8c0aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:11.156747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4df36d2a-7d67-4e52-8ba6-486afedf8364 req-d128ee07-ab50-40c0-83ca-bb65dfe8c0aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:11.175589 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4df36d2a-7d67-4e52-8ba6-486afedf8364 req-d128ee07-ab50-40c0-83ca-bb65dfe8c0aa service nova] Creating event network-vif-plugged:2c242c24-8d24-48f6-a322-cda9b3375073 for instance 75379208-09c6-4e01-aeda-2b121b343517 on nch2-master-1 Jul 30 21:22:11.181120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4df36d2a-7d67-4e52-8ba6-486afedf8364 req-d128ee07-ab50-40c0-83ca-bb65dfe8c0aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059038 Jul 30 21:22:11.182058 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2384/4719] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:11.189184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:11.190306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:11.197345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:11.198058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:11.199126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:11.199764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:11.447768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:11.475186 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2e96500-757d-484e-9012-ba3ad8342a02 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.777715 Jul 30 21:22:11.476579 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2336/4720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:10 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:11.617669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:11.632424 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53ed8ec3-25ee-41b0-849b-9869596c4fd3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.447951 Jul 30 21:22:11.634070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2385/4721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:11 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:11.665393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:11.666364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:11.676706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:11.677875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:11.679027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:11.679829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:12.121376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:12.158064 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69fe3bc9-7575-4058-a324-8ac80051e325 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.498244 Jul 30 21:22:12.171041 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2337/4722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:11 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:12.192485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:12.194476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:12.213219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:12.215755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:12.216883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:12.219375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:12.498721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:12.500033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:12.512358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:12.515024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:12.516073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:12.522429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:12.701896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:12.712771 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d4fce64-3d56-4c7a-8ce7-e6338954c891 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.525458 Jul 30 21:22:12.713371 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2386/4723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:12 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:12.893055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-819850237", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "aa7ed307-3fdf-4329-9a4b-db68b093ba0f"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:12.992476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] validate_networks() for [('aa7ed307-3fdf-4329-9a4b-db68b093ba0f', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:22:13.038875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:13.059672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:13.070866 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43f3e886-a5db-4c0e-9b78-2df8b7b91bae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1367 microversion: 2.1 time: 0.577043 Jul 30 21:22:13.073797 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2338/4724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:12 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:14.110311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:14.112912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:14.125903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.126923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.129125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.129764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.459472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:14.473078 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d56a091-bef8-4132-9d9c-380c23fa7a42 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1558 microversion: 2.1 time: 0.374066 Jul 30 21:22:14.474131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2339/4725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:14 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1558 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:14.506523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:14.508508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:14.530720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.531480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.532679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.534044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.654455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:22:14.658689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:22:14.662233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:22:14.662978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:22:14.664569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:22:14.694274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7697f541-dc63-4033-bbda-e1f8141a5c11 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200178 Jul 30 21:22:14.695752 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2340/4726] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:22:14 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:14.706594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.707169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.708880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:14.709446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:14.744132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:22:14.755430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:22:14.792055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:22:14.796880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:22:14.871230 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8ec6f99c-a927-421e-8a20-8e5e71fd4309 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984368 Jul 30 21:22:14.872439 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2387/4727] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:22:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:22:14.884115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-612d1763-cda3-49c3-b03c-e92c1a76cd84 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:14.885139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-612d1763-cda3-49c3-b03c-e92c1a76cd84 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:15.100461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-612d1763-cda3-49c3-b03c-e92c1a76cd84 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:15.109713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-612d1763-cda3-49c3-b03c-e92c1a76cd84 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1214 microversion: 2.1 time: 0.230232 Jul 30 21:22:15.110314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2341/4728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:14 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:16.135959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:16.137800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:16.150472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:16.153327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:16.154849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:16.158678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:16.342130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:16.359163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5306e827-3d9f-4aa0-bfc4-433bc52aca3d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1266 microversion: 2.1 time: 0.232686 Jul 30 21:22:16.359903 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2388/4729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:16 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:17.382959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:17.383931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:17.405675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:17.408354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:17.411378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:17.411827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:17.758010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:17.766614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d18f2199-cd50-4692-a8c3-e0a5a105a343 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1272 microversion: 2.1 time: 0.388673 Jul 30 21:22:17.767926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2342/4730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:17 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:18.703004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-33b9c7a0-59da-439a-8213-b74a18e1c34e req-0ed7bdaa-bb68-4530-95a7-c9ea89b58ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75379208-09c6-4e01-aeda-2b121b343517", "tag": "2c242c24-8d24-48f6-a322-cda9b3375073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:18.746447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-33b9c7a0-59da-439a-8213-b74a18e1c34e req-0ed7bdaa-bb68-4530-95a7-c9ea89b58ca8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:18.747385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-33b9c7a0-59da-439a-8213-b74a18e1c34e req-0ed7bdaa-bb68-4530-95a7-c9ea89b58ca8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:18.771310 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-33b9c7a0-59da-439a-8213-b74a18e1c34e req-0ed7bdaa-bb68-4530-95a7-c9ea89b58ca8 service nova] Creating event network-changed:2c242c24-8d24-48f6-a322-cda9b3375073 for instance 75379208-09c6-4e01-aeda-2b121b343517 on nch2-master-1 Jul 30 21:22:18.781746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-33b9c7a0-59da-439a-8213-b74a18e1c34e req-0ed7bdaa-bb68-4530-95a7-c9ea89b58ca8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083741 Jul 30 21:22:18.784954 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2389/4731] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:18.792549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:18.793500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:18.811983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:18.812528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:18.815631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:18.817027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:19.409691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:19.429074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-766099d7-4500-4cf0-be5e-87d4ee712656 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1272 microversion: 2.1 time: 0.638750 Jul 30 21:22:19.447747 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2343/4732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:18 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1272 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:20.458514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:20.459247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:20.476727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:20.477160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:20.477961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:20.480751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:20.792475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:20.804743 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd8e6d27-d5b4-4fd9-973d-58c0c57e5f53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.356915 Jul 30 21:22:20.823699 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2390/4733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:20 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:21.834257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:21.837304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:21.860152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:21.861486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:21.862664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:21.863940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:23.112378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:23.120945 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d47aca5-b1aa-4440-b138-07d520ce5804 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 1.294014 Jul 30 21:22:23.135394 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2344/4734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:21 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:23.789873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d06c1205-511e-44ed-bfc0-69e23bd7b6b3 req-20a6b46f-4a25-4406-a0c6-bdbb19455afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9044217-518c-4773-8903-dd8fcc3d94bc", "tag": "925f2858-709f-4254-bc6b-3d3f3897de36"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:23.801410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d06c1205-511e-44ed-bfc0-69e23bd7b6b3 req-20a6b46f-4a25-4406-a0c6-bdbb19455afa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:23.802303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d06c1205-511e-44ed-bfc0-69e23bd7b6b3 req-20a6b46f-4a25-4406-a0c6-bdbb19455afa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:23.815575 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d06c1205-511e-44ed-bfc0-69e23bd7b6b3 req-20a6b46f-4a25-4406-a0c6-bdbb19455afa service nova] Creating event network-changed:925f2858-709f-4254-bc6b-3d3f3897de36 for instance d9044217-518c-4773-8903-dd8fcc3d94bc on nch1-master-1 Jul 30 21:22:23.824973 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d06c1205-511e-44ed-bfc0-69e23bd7b6b3 req-20a6b46f-4a25-4406-a0c6-bdbb19455afa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Jul 30 21:22:23.826541 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2391/4735] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:24.142680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:24.143321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:24.146089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=50 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:24.157546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:24.159880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:24.160769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:24.162642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:24.770908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:24.779247 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f571a6a0-f12e-4bfa-8eee-4258dad886b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.640927 Jul 30 21:22:24.791952 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2345/4736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:24 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:25.814598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:25.816205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:25.824962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:25.827148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:25.829731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:25.839868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:25.840616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:25.841644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:25.843436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:26.399239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:26.416243 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba4749af-4b4e-4f2d-9680-a404e55f9dca tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.606987 Jul 30 21:22:26.417895 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2392/4737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:25 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:27.442932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:27.443595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:27.450142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:27.472025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:27.476236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:27.478218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:27.483380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:27.835943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:27.853045 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d6499c11-594a-40dc-a2c3-4d6c795988d4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.413586 Jul 30 21:22:27.855447 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2346/4738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:27 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:28.896189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:28.897576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:28.941045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:28.944384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:28.948776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:28.950085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:29.821698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:29.836255 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f9c3df35-5d55-42ef-abce-2d7941f34a2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.959487 Jul 30 21:22:29.836860 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2393/4739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:28 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:30.865106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:30.866376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:30.878754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:30.879517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:30.880562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:30.881939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:31.337969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:31.363477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6a88b220-435b-4630-9980-2c34ec4b3a9a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.502625 Jul 30 21:22:31.395939 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2347/4740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:30 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:31.710829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f701a628-52c9-47b3-920d-a5bdb5ae1755 req-36c25c6c-c50e-4fbb-b742-ddc650b909ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9044217-518c-4773-8903-dd8fcc3d94bc", "name": "network-vif-plugged", "status": "completed", "tag": "925f2858-709f-4254-bc6b-3d3f3897de36"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:31.735206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f701a628-52c9-47b3-920d-a5bdb5ae1755 req-36c25c6c-c50e-4fbb-b742-ddc650b909ab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:31.735700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f701a628-52c9-47b3-920d-a5bdb5ae1755 req-36c25c6c-c50e-4fbb-b742-ddc650b909ab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:31.748560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f701a628-52c9-47b3-920d-a5bdb5ae1755 req-36c25c6c-c50e-4fbb-b742-ddc650b909ab service nova] Creating event network-vif-plugged:925f2858-709f-4254-bc6b-3d3f3897de36 for instance d9044217-518c-4773-8903-dd8fcc3d94bc on nch1-master-1 Jul 30 21:22:31.766435 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f701a628-52c9-47b3-920d-a5bdb5ae1755 req-36c25c6c-c50e-4fbb-b742-ddc650b909ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059203 Jul 30 21:22:31.775505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2394/4741] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:32.392765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:32.393883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:32.405538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:32.406290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:32.407419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:32.408037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:32.626897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:32.635927 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea4e36d1-3568-45a6-b46a-d2bf4050f0fd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1314 microversion: 2.1 time: 0.249910 Jul 30 21:22:32.651521 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2348/4742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:32 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:33.668882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:33.672154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:33.697079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:33.697590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:33.702099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:33.702575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:33.714334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=84 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:34.084039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:34.092840 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9593e52f-8416-4e88-aec3-8e6715e6605d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1501 microversion: 2.1 time: 0.436654 Jul 30 21:22:34.108389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2395/4743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:33 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1501 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:34.114378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:34.116860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:34.126008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.126552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:34.127498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.128699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:34.173923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9636ebac-e9b1-4940-a4be-dc3bf8ad7a68 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.063259 Jul 30 21:22:34.175363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2349/4744] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:34 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:34.510782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:34.511556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:34.518355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.518820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:34.520315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.520815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:34.552444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:22:34.642779 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bda39e84-1641-4984-9656-6eafec2c8e48 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 204 len: 0 microversion: 2.42 time: 0.423316 Jul 30 21:22:34.644095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2396/4745] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:22:34 2022] DELETE /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:22:34.655937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:34.657569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:34.669367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.672595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:34.674645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:34.675307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:35.187770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:35.190531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:35.198535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:35.199012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:35.201095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:35.201570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:35.241202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c1bd0b2-cf46-45a2-a290-bddb5b449588 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.058351 Jul 30 21:22:35.242226 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2397/4746] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:35 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:35.248163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:35.259421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:35.261419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:35.263888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a3b3eed-2101-472c-a212-8a9966419442 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2950 microversion: 2.42 time: 0.614483 Jul 30 21:22:35.265155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2350/4747] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:34 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2950 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:36.256223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:36.258827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:36.273612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:36.274337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:36.275470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:36.276153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:36.291183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:36.292652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:36.312820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:36.313679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:36.320389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:36.321248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:36.379525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-46e13a92-865e-4b89-8e1e-6bb348b1c1aa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.129257 Jul 30 21:22:36.381627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2398/4748] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:36 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:36.781484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:36.801714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:36.803605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:36.805798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bdf35ebc-2c27-46bf-ae18-bc37c3dde2d1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2950 microversion: 2.42 time: 0.520606 Jul 30 21:22:36.806987 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2351/4749] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:36 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2950 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:37.394787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:37.397201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:37.405640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:37.406446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:37.407498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:37.408150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:37.457791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-978e187b-d1c1-422b-9a6f-17b544dc6208 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.067649 Jul 30 21:22:37.458867 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2399/4750] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:37 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:22:37.831908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:37.833586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:37.856898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:37.858171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:37.859241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:37.860011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:38.471518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:38.473636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:38.500093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:38.500563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:38.501367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:38.501868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:38.566242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba8875f9-1d3f-4475-8308-17560312044f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.099258 Jul 30 21:22:38.570808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2400/4751] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:38 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:22:38.924077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:38.935462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:38.938112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:38.939580 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3847e0f5-fb0c-4b7c-92a8-67745cc9d6cc tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2950 microversion: 2.42 time: 1.112087 Jul 30 21:22:38.941665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2352/4752] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:37 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2950 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:39.587376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:39.590597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:39.598956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:39.599821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:39.601022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:39.601556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:39.660249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3c84b90-d8c1-4b30-9cb0-14107b3fe247 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.086715 Jul 30 21:22:39.661335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2401/4753] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:39 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:39.966721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:39.967400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:39.975409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:39.976084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:39.977075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:39.977592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:40.494738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-03a58ae9-384c-47fa-b79b-28dde8794083 req-5fc2a6bc-831b-4d72-afaf-64626e745b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc0f246-08ce-4e10-9c66-6bc474965f2f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:40.508363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-03a58ae9-384c-47fa-b79b-28dde8794083 req-5fc2a6bc-831b-4d72-afaf-64626e745b40 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:40.509059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-03a58ae9-384c-47fa-b79b-28dde8794083 req-5fc2a6bc-831b-4d72-afaf-64626e745b40 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:40.527713 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-03a58ae9-384c-47fa-b79b-28dde8794083 req-5fc2a6bc-831b-4d72-afaf-64626e745b40 service nova] Creating event network-vif-unplugged:6dc0f246-08ce-4e10-9c66-6bc474965f2f for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:40.535970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:40.536493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-03a58ae9-384c-47fa-b79b-28dde8794083 req-5fc2a6bc-831b-4d72-afaf-64626e745b40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047448 Jul 30 21:22:40.537798 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2402/4754] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:40.549929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:40.551893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:40.554108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b5451def-d334-45ce-ad63-dd118efcdeff tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2950 microversion: 2.42 time: 0.591501 Jul 30 21:22:40.571957 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2353/4755] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:39 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2950 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:40.677039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:40.681349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:40.703133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:40.707889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:40.708936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:40.710058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:40.830996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-766862f2-f070-4d0e-862b-81c0ac76483a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.163061 Jul 30 21:22:40.834620 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2403/4756] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:40 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:41.582249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:41.582882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:41.590006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:41.591275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:41.592264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:41.592871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:41.843665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:41.846050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:41.877132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:41.881395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:41.882491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:41.884486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:41.947475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-180e7c2a-e955-4bc5-a04e-31d61fdf4122 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.108675 Jul 30 21:22:41.948140 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2404/4757] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:41 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:22:42.125980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:42.147797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:42.150715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:42.153683 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a99726d3-455c-47ef-8867-9080ee58d244 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2929 microversion: 2.42 time: 0.574646 Jul 30 21:22:42.175282 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2354/4758] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:41 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2929 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:42.595099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "d0477c94-c4f8-4008-b836-6bb759f343b9"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "51517a60-c982-4096-a107-b749686187d7"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "778ee310-a269-432b-b3e4-d817f4ae4ecd"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "ebb280be-9aa4-4c83-8b08-5bb73d1e6a07"}, {"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:42.606626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:42.607380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:42.628257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Creating event network-vif-unplugged:d0477c94-c4f8-4008-b836-6bb759f343b9 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:42.629155 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Creating event network-vif-unplugged:51517a60-c982-4096-a107-b749686187d7 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:42.629839 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Creating event network-vif-unplugged:778ee310-a269-432b-b3e4-d817f4ae4ecd for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:42.630518 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Creating event network-vif-unplugged:ebb280be-9aa4-4c83-8b08-5bb73d1e6a07 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:42.631191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] Creating event network-vif-unplugged:8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:42.637900 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b57c1a12-d104-4126-8320-e39c4284e6b7 req-668bbb9d-8ca0-4855-9bd2-ea9f97ec657b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.046823 Jul 30 21:22:42.639115 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2405/4759] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:42.961114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:42.966107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:42.974679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:42.979852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:42.981144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:42.982701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:43.080307 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d4e73cd-019e-4672-89a4-33b8e8763ba0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.123910 Jul 30 21:22:43.086131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2355/4760] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:42 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:43.185542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:43.187656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:43.208575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:43.211412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:43.212274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:43.212742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:43.605876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:43.632732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:43.634908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:43.636535 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20cbc0b4-07c1-402d-9c78-5caf25124ed7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2908 microversion: 2.42 time: 0.457845 Jul 30 21:22:43.637483 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2406/4761] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:43 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2908 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:44.087673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-51821a1d-8bfc-4382-8b6a-74178d6368d8 req-5d3da1c3-b216-4c9c-b1d6-9bbc81e354fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-deleted", "tag": "d0477c94-c4f8-4008-b836-6bb759f343b9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:44.092856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:44.095495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:44.108201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-51821a1d-8bfc-4382-8b6a-74178d6368d8 req-5d3da1c3-b216-4c9c-b1d6-9bbc81e354fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:44.111714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:44.112413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:44.114243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:44.115827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-51821a1d-8bfc-4382-8b6a-74178d6368d8 req-5d3da1c3-b216-4c9c-b1d6-9bbc81e354fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:44.116239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:44.139435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=92 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:44.148208 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-51821a1d-8bfc-4382-8b6a-74178d6368d8 req-5d3da1c3-b216-4c9c-b1d6-9bbc81e354fc service nova] Creating event network-vif-deleted:d0477c94-c4f8-4008-b836-6bb759f343b9 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:44.161782 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-51821a1d-8bfc-4382-8b6a-74178d6368d8 req-5d3da1c3-b216-4c9c-b1d6-9bbc81e354fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076721 Jul 30 21:22:44.162482 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2356/4762] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:44.174402 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f763bb1d-aa57-4d4c-8b72-857e510a9669 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 14 microversion: 2.1 time: 0.085317 Jul 30 21:22:44.176442 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2407/4763] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:44 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:22:44.670008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:44.670745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:44.679013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:44.679521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:44.680518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:44.681139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.192356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:45.199231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:45.215112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.216567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.218148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.218995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.279577 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18befe36-4964-4700-91bf-9110f2a92b65 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action" status: 200 len: 8204 microversion: 2.1 time: 0.094483 Jul 30 21:22:45.280924 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2408/4764] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:45 2022] POST /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc/action => generated 8204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:45.292867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:45.293681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:45.305380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.306112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.306910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.307413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.589997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:45.604527 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cdfff292-dc6d-4b3e-a951-9ae26e06153c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.317888 Jul 30 21:22:45.613857 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2409/4765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:45 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:45.620483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:45.634393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:45.635445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:45.639158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:45.647162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.647458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:45.648125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:45.649038 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb2167af-2ec1-4bd0-8f57-786a88221446 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2749 microversion: 2.42 time: 0.984350 Jul 30 21:22:45.649387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:45.649623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2357/4766] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:44 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2749 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:45.650397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.077928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:46.095167 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0841df67-3d00-496c-b47a-f65d034aa8f8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.465702 Jul 30 21:22:46.095909 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2410/4767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:45 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:46.116637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:46.117508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:46.126082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.126457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.132329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.133963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.680302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:46.681581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:46.689044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.689771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.690838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.691510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.748741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:46.773100 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d02e1c0-4db8-4529-b935-657cf7a6a127 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.660302 Jul 30 21:22:46.774783 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2358/4768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:46 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:46.795522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:46.797072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:46.819234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.827445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.832461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:46.832960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:46.984666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:46.996238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:46.999107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:47.001470 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0c389f7-1130-40c6-92a1-034c4f3d65b6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2704 microversion: 2.42 time: 0.325120 Jul 30 21:22:47.002230 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2411/4769] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:46 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2704 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:22:47.499520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:47.514581 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3885b43c-cfcf-4891-8838-9bd7f89bc543 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.723761 Jul 30 21:22:47.515126 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2359/4770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:46 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:47.538058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:47.538664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9fcadfc8-aeda-4b5a-a40e-7fd8cda80e5e req-1f1f036d-0d88-43fc-96b9-cba3643e135a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-deleted", "tag": "ebb280be-9aa4-4c83-8b08-5bb73d1e6a07"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:47.539604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:47.550423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:47.551273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:47.554601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9fcadfc8-aeda-4b5a-a40e-7fd8cda80e5e req-1f1f036d-0d88-43fc-96b9-cba3643e135a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:47.555133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:47.556058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:47.560035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9fcadfc8-aeda-4b5a-a40e-7fd8cda80e5e req-1f1f036d-0d88-43fc-96b9-cba3643e135a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:47.593879 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9fcadfc8-aeda-4b5a-a40e-7fd8cda80e5e req-1f1f036d-0d88-43fc-96b9-cba3643e135a service nova] Creating event network-vif-deleted:ebb280be-9aa4-4c83-8b08-5bb73d1e6a07 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:47.599610 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9fcadfc8-aeda-4b5a-a40e-7fd8cda80e5e req-1f1f036d-0d88-43fc-96b9-cba3643e135a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064771 Jul 30 21:22:47.600723 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2360/4771] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:47.649342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Locking {{(pid=130984) lock /opt/stack/nova/nova/compute/api.py:4781}} Jul 30 21:22:47.711505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:47.781229 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e5031dcb-8c28-41fc-8607-57437b04cd93 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.249694 Jul 30 21:22:47.782763 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2412/4772] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:47 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:22:47.792483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:47.794787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:47.811088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:47.811929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:47.813036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:47.813959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.029121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:48.029754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:48.038919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.043919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.045124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.045751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.336401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:48.340847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:48.346072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:48.350269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:48.356413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9f10211-bcf2-4306-8ef9-bbaaeb908caf tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2413 microversion: 2.42 time: 0.331836 Jul 30 21:22:48.361640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2413/4773] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:48 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2413 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:22:48.373422 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5902e16-953d-4149-8b60-147974894110 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.585915 Jul 30 21:22:48.377115 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2361/4774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:47 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:48.398736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:48.428262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.428742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.456056 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action HTTP/1.1 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 15 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: {"os-stop": {}} Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4b930d1a-368c-43db-a27d-b93bdaa392ad', 'body': {'os-stop': {}}} Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked Jul 30 21:22:48.457929 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:48.463953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 409 to user: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad is locked {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:22:48.464989 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c2c24ac-624f-4541-9418-58ca95472cee tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 409 len: 107 microversion: 2.1 time: 0.070406 Jul 30 21:22:48.466088 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2414/4775] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:48 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 107 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 21:22:48.475067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:48.476125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:48.486310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.487435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.488747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.489442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.551703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Unlocking {{(pid=130983) unlock /opt/stack/nova/nova/compute/api.py:4810}} Jul 30 21:22:48.666537 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bbe2f15-1dba-461a-bd5f-7266e0b471ce tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.195433 Jul 30 21:22:48.667880 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2362/4776] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:48 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:22:48.676954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb8bc579-eb29-4c74-a642-2946c2c2d01d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:48.684863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb8bc579-eb29-4c74-a642-2946c2c2d01d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.685604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb8bc579-eb29-4c74-a642-2946c2c2d01d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.711582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb8bc579-eb29-4c74-a642-2946c2c2d01d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Going to try to stop instance {{(pid=130984) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:22:48.785064 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb8bc579-eb29-4c74-a642-2946c2c2d01d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.111749 Jul 30 21:22:48.785684 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2415/4777] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:22:48 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:22:48.794773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:48.796206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:48.811737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.812723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:48.813962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:48.815814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:49.387915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:49.388639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:49.408295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:49.409143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:49.410812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:49.412094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:49.421433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:49.454371 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d296b057-3717-4abf-8fca-a27e1326b1d8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.664386 Jul 30 21:22:49.459271 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2363/4778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:48 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:49.824364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:49.838651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:49.841005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6456cf70-2ae1-42dd-bdac-7e5e6cc3bc33 req-3dcc70c8-3855-431a-bc65-b893e32b0378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-deleted", "tag": "51517a60-c982-4096-a107-b749686187d7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:49.846930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:49.848246 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-896afdf7-58dd-4b92-b538-3071a2bf7794 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2368 microversion: 2.42 time: 0.464780 Jul 30 21:22:49.856874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6456cf70-2ae1-42dd-bdac-7e5e6cc3bc33 req-3dcc70c8-3855-431a-bc65-b893e32b0378 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:49.857582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6456cf70-2ae1-42dd-bdac-7e5e6cc3bc33 req-3dcc70c8-3855-431a-bc65-b893e32b0378 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:49.859809 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2416/4779] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:49 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2368 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:49.895207 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6456cf70-2ae1-42dd-bdac-7e5e6cc3bc33 req-3dcc70c8-3855-431a-bc65-b893e32b0378 service nova] Creating event network-vif-deleted:51517a60-c982-4096-a107-b749686187d7 for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:49.908028 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6456cf70-2ae1-42dd-bdac-7e5e6cc3bc33 req-3dcc70c8-3855-431a-bc65-b893e32b0378 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071839 Jul 30 21:22:49.909011 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2364/4780] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:50.483156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:50.484057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:50.494038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:50.495835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:50.499341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:50.500045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:50.889978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:50.891668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:50.912580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:50.915055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:50.917669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:50.919416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.033142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:51.040894 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb31af6a-6362-4c59-9a51-47c40e7d6689 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.562521 Jul 30 21:22:51.049689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2417/4781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:50 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:51.097135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:51.097643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:51.106845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.111920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.112842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.113363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.163614 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad17263d-bb39-44ac-820d-8e22dfb1b585 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/ips" status: 200 len: 150 microversion: 2.1 time: 0.070205 Jul 30 21:22:51.173918 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2418/4782] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:22:51 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:51.179614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d160b1f-adc0-4cd3-9332-a6767a4098c9"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:51.182657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:51.190198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.190926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.191968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.193114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.372072 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/os-volume_attachments HTTP/1.1 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 74 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: {"volumeAttachment": {"volumeId": "4d160b1f-adc0-4cd3-9332-a6767a4098c9"}} Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': '75379208-09c6-4e01-aeda-2b121b343517', 'body': {'volumeAttachment': {'volumeId': '4d160b1f-adc0-4cd3-9332-a6767a4098c9'}}} Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:22:51.373860 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 400 to user: Invalid volume: volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9 is already attached to instances: 0fa909cf-9974-49fe-9b0e-285825175258 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:22:51.379002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-395a7a84-35fe-4819-8bbd-4da47a9d2471 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200105 Jul 30 21:22:51.385241 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2419/4783] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:22:51 2022] POST /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517/os-volume_attachments => generated 174 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:22:51.391014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:51.392119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:51.398769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.399546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.401129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.401775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.407932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:51.427726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:51.430724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:22:51.431546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:51.433086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d748cc56-5695-4c4e-8a7e-9a49fe426ca6 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2254 microversion: 2.42 time: 0.548378 Jul 30 21:22:51.433669 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2365/4784] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:50 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2254 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:22:51.684542 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a76ebff-ac88-479f-80af-e01d81163df7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 204 len: 0 microversion: 2.1 time: 0.296757 Jul 30 21:22:51.685490 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2420/4785] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:22:51 2022] DELETE /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:22:51.694202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:51.695004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:51.714867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.716099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.717152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:51.723735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:51.964477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ea19a9ae-4f01-4ebb-9d4e-cd09cc4f3039 req-b2c3f558-6212-43b5-a4d9-085c1ab18f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-deleted", "tag": "8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:52.001616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ea19a9ae-4f01-4ebb-9d4e-cd09cc4f3039 req-b2c3f558-6212-43b5-a4d9-085c1ab18f97 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:52.002122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ea19a9ae-4f01-4ebb-9d4e-cd09cc4f3039 req-b2c3f558-6212-43b5-a4d9-085c1ab18f97 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:52.050930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ea19a9ae-4f01-4ebb-9d4e-cd09cc4f3039 req-b2c3f558-6212-43b5-a4d9-085c1ab18f97 service nova] Creating event network-vif-deleted:8fe200e9-6c80-4af8-ad93-8d3a5ee01c5c for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:52.069120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ea19a9ae-4f01-4ebb-9d4e-cd09cc4f3039 req-b2c3f558-6212-43b5-a4d9-085c1ab18f97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109228 Jul 30 21:22:52.070096 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2421/4786] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:22:52.082118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:52.084193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:52.104004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:52.104480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:52.109107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:52.109830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:52.358920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:52.373716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b95fabc4-ca10-4add-b3c8-f0b2c988f955 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1682 microversion: 2.1 time: 0.680322 Jul 30 21:22:52.376515 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2366/4787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:51 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1682 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:52.542085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:52.543817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:52.552314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:52.553164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:52.554747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:52.555554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:52.591653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:52.607117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d629543-09b7-4960-bc93-0ae327da67b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.535653 Jul 30 21:22:52.614584 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2422/4788] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:52 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:53.358962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:53.382804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:53.385799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:53.398249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-469ee9b1-c821-4d51-b65e-33dc04424b43 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 2209 microversion: 2.42 time: 0.853341 Jul 30 21:22:53.400777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:53.413434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2367/4789] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:52 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 2209 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:22:53.416089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:53.429877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:53.436282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:53.437254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:53.437723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:53.642788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:53.643496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:53.677152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:53.679500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:53.680456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:53.686242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:53.818060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:53.830342 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ace158af-7a40-4e6f-8c3a-52ae51c0945f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1682 microversion: 2.1 time: 0.433348 Jul 30 21:22:53.830937 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2423/4790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:53 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1682 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:54.242693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8e2216f3-1075-400c-bf97-d4cf65898e00 req-2057fd45-db59-4d1d-af48-2be745d142f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df61dfee-28eb-45b7-b2b9-83ca2c4a6444", "name": "network-vif-deleted", "tag": "778ee310-a269-432b-b3e4-d817f4ae4ecd"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:54.270291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8e2216f3-1075-400c-bf97-d4cf65898e00 req-2057fd45-db59-4d1d-af48-2be745d142f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:54.280166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8e2216f3-1075-400c-bf97-d4cf65898e00 req-2057fd45-db59-4d1d-af48-2be745d142f8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:54.295278 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8e2216f3-1075-400c-bf97-d4cf65898e00 req-2057fd45-db59-4d1d-af48-2be745d142f8 service nova] Creating event network-vif-deleted:778ee310-a269-432b-b3e4-d817f4ae4ecd for instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 on nch2-master-1 Jul 30 21:22:54.312475 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8e2216f3-1075-400c-bf97-d4cf65898e00 req-2057fd45-db59-4d1d-af48-2be745d142f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072801 Jul 30 21:22:54.313601 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2424/4791] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:54.430338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:54.433490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:54.467188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:54.469775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:54.475864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:54.478505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:54.746245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:54.758754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:54.761173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7369e2a4c5b24e85b94816e6404b300f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8696e08b027f4d259759dff57403f900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:54.763157 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a633e40-87fd-4a85-a4a4-1cab58019fb7 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 200 len: 1603 microversion: 2.42 time: 0.339193 Jul 30 21:22:54.775335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2425/4792] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:54 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 1603 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:22:54.852118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:54.852751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:54.869808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:54.871766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:54.874823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:54.876580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:55.044745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:55.059415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29d98c23-1288-4123-b07f-b3a0bf485805 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 1.422589 Jul 30 21:22:55.061456 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2368/4793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:53 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:55.376155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:55.404540 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b311d2c6-5f23-4768-bda3-3dd6a27d716d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1682 microversion: 2.1 time: 0.554588 Jul 30 21:22:55.408117 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2426/4794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:54 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1682 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:22:55.788618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:55.789942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:55.792451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=48 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:55.805336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:55.805967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:55.806996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:55.807693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:55.846264 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] HTTP exception thrown: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Request method failure captured: Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 HTTP/1.1 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-1KDlDpGouRjmo-aVHCkIEKGyQwFrhFGjBRd12nV4H6qA9FdDJf9rgISwXNpf_lqiD_1GsIYwVVoY9K54Iq8TKghg-9HI2vTusGyW6wE7zWtlvnzwAbSIq74ajqT_vPgtIaYQ4Zb4LYSIo_6TOVCo_VUBppbEGSdlMz-zG0kaTWs0 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.42 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8696e08b027f4d259759dff57403f900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8696e08b027f4d259759dff57403f900", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7369e2a4c5b24e85b94816e6404b300f Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'df61dfee-28eb-45b7-b2b9-83ca2c4a6444'} Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:22:55.850177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:22:55.855189 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:22:55.858678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Returning 404 to user: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:22:55.860967 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-93e2cc28-d521-4c0c-9733-ac18d3b385a0 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 404 len: 111 microversion: 2.42 time: 0.076348 Jul 30 21:22:55.863375 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2369/4795] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:22:55 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:22:55.876093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e68ca0f6-a2bd-4f3e-8eaa-d83ee7df16b1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '.version_select at 0x7fbb4fc7e160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:55.929532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e68ca0f6-a2bd-4f3e-8eaa-d83ee7df16b1 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595636488" status: 204 len: 0 microversion: 2.42 time: 0.059704 Jul 30 21:22:55.930754 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2427/4796] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Jul 30 21:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595636488 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:22:56.091346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:56.092706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:56.114074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:56.115871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:56.117849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:56.118717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:56.434464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:56.436091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:56.452340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:56.461240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:56.461581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:56.462415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:56.462869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:56.714833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:56.723400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:56.732800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73547394-5a15-468c-abb0-3c3edf5de6f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 200 len: 1615 microversion: 2.1 time: 0.300986 Jul 30 21:22:56.748436 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2428/4797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:56 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 1615 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:56.771729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b7aad39c-90a5-46db-8e3f-75a1454986cc req-e201c03a-c058-4ada-ad9b-c603403d0147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75379208-09c6-4e01-aeda-2b121b343517", "name": "network-vif-deleted", "tag": "2c242c24-8d24-48f6-a322-cda9b3375073"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:22:56.817500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b7aad39c-90a5-46db-8e3f-75a1454986cc req-e201c03a-c058-4ada-ad9b-c603403d0147 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:56.817970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b7aad39c-90a5-46db-8e3f-75a1454986cc req-e201c03a-c058-4ada-ad9b-c603403d0147 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:56.866587 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b7aad39c-90a5-46db-8e3f-75a1454986cc req-e201c03a-c058-4ada-ad9b-c603403d0147 service nova] Creating event network-vif-deleted:2c242c24-8d24-48f6-a322-cda9b3375073 for instance 75379208-09c6-4e01-aeda-2b121b343517 on nch2-master-1 Jul 30 21:22:56.876787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b7aad39c-90a5-46db-8e3f-75a1454986cc req-e201c03a-c058-4ada-ad9b-c603403d0147 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116946 Jul 30 21:22:56.891937 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2429/4798] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:22:57.113829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:57.130605 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50fe2f90-b277-4660-a059-e8cd140efe28 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 1.046277 Jul 30 21:22:57.132965 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2370/4799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:56 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:22:57.772961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:57.774142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:57.814010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:57.814751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:57.815915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:57.816752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:57.871904 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 HTTP/1.1 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '75379208-09c6-4e01-aeda-2b121b343517'} Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:22:57.875968 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:22:57.881459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:22:57.885440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:22:57.886519 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e7cc3c6-1cf6-4e07-a672-0613c15acc5b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 404 len: 111 microversion: 2.1 time: 0.127016 Jul 30 21:22:57.889738 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2430/4800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:57 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:22:57.898925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-562cb1dc-846c-4a31-9505-828b2fbe94bf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '.version_select at 0x7fbb4fddf820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:57.936136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-562cb1dc-846c-4a31-9505-828b2fbe94bf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869218179" status: 202 len: 0 microversion: 2.1 time: 0.042458 Jul 30 21:22:57.937234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2371/4801] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869218179 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:22:58.153100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:22:58.154042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:22:58.178512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:58.179247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:58.180284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:22:58.180934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:22:59.705651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:22:59.718951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0496e945-a554-4a22-bd19-1f9f66519b30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 1.570099 Jul 30 21:22:59.728244 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2431/4802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:22:58 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:00.245850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:00.247026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:00.257181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.257935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.258986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.259690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.384346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lazy-loading 'services' on Instance uuid 0fa909cf-9974-49fe-9b0e-285825175258 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:23:00.485867 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a3ee53a-6fec-47e9-aa38-af0811efb66c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments/4d160b1f-adc0-4cd3-9332-a6767a4098c9" status: 202 len: 0 microversion: 2.1 time: 0.246768 Jul 30 21:23:00.490630 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2372/4803] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:23:00 2022] DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments/4d160b1f-adc0-4cd3-9332-a6767a4098c9 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:00.497394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:00.501774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:00.511305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.512392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.513406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.514821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.565745 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-deaadd0c-b33c-4862-9dfe-0bf36ea28784 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074021 Jul 30 21:23:00.568648 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2432/4804] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:23:00 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:00.750459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:00.751421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:00.764286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.765297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.769563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:00.770564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:00.791488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:01.020378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:01.030718 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cd45d97e-7d67-4be6-827e-6c74aa8d7f6a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1654 microversion: 2.1 time: 0.284400 Jul 30 21:23:01.031415 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2373/4805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:00 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1654 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:01.054891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fac44880-d030-448a-b579-8d92667547b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:01.063344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fac44880-d030-448a-b579-8d92667547b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.064127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fac44880-d030-448a-b579-8d92667547b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.090768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fac44880-d030-448a-b579-8d92667547b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Going to try to start instance {{(pid=130984) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:23:01.155966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fac44880-d030-448a-b579-8d92667547b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.105575 Jul 30 21:23:01.165984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:01.167248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:01.175233 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2433/4806] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:23:01 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:01.178238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.178969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.180027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.180689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.520916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:01.556558 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c9752fd2-56f2-45ff-9810-99bd9671ee8a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1663 microversion: 2.1 time: 0.394415 Jul 30 21:23:01.559630 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2374/4807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:01 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1663 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:01.582052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:01.585075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:01.591791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.592433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.593405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.593859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.641388 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-460423ab-da9c-4d98-b30d-ea3e64e6c8cf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065004 Jul 30 21:23:01.642733 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2434/4808] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:23:01 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:23:01.711035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:01.711698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:01.719691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.720260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.721164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.721718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.767998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:23:01.927884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48ef169b-1bb8-479f-967a-6ee0306964b3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 204 len: 0 microversion: 2.1 time: 0.220297 Jul 30 21:23:01.928966 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2375/4809] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:23:01 2022] DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:23:01.940542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:01.941657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:01.961738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.962311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:01.963315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:01.964013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:02.580230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:02.581690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:02.594294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:02.595017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:02.596235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:02.596992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:02.876060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:02.888815 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3853a013-ed63-4a23-8a9f-3d1bfcbba58d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1663 microversion: 2.1 time: 0.312968 Jul 30 21:23:02.907640 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2376/4810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:02 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1663 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:03.126107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:03.137979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79f0b970-9c44-475b-98bf-daa891fed3ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1683 microversion: 2.1 time: 1.204476 Jul 30 21:23:03.138868 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2435/4811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:01 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1683 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:03.916761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:03.917382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:03.925328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:03.925826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:03.926609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:03.927438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.170181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:04.170869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:04.178425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.179035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.179974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.180523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.437358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:04.449152 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-962ea16d-5015-4c0d-af50-9193ca6f3cf2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.537495 Jul 30 21:23:04.450051 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2377/4812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:03 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:04.482284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:04.484976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:04.501978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.504478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.505949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.506663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.761271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:04.790506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5deccaec-d93f-45d0-bf1c-f78290c414d7 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1683 microversion: 2.1 time: 0.622213 Jul 30 21:23:04.806469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2436/4813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:04 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1683 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:04.928443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:04.937343 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b3e2a87-6464-4b04-a0d3-483928d6bff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.462685 Jul 30 21:23:04.938165 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2378/4814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:04 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:04.957478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:04.958011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:04.964420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.965411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:04.966880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:04.967390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.022655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Unlocking {{(pid=130984) unlock /opt/stack/nova/nova/compute/api.py:4810}} Jul 30 21:23:05.092974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ba7c7b5-78d6-4670-b765-0465de51ecf0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.139144 Jul 30 21:23:05.094065 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2437/4815] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:23:04 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:05.105207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:05.106454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:05.113099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.113778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.114722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.115357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.431430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:05.440735 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8aa94a46-f3d6-4088-8751-683177c33995 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.339837 Jul 30 21:23:05.441596 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2379/4816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:05 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:05.465745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:05.467563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:05.478675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.479661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.480553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.481151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.823253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:05.825376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:05.840332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.841143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.841937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:05.845231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:05.989425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:05.989999 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b81e6c60-a9dc-4cbe-b841-d925f97e6765 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1615 microversion: 2.1 time: 0.178013 Jul 30 21:23:05.998405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:06.002607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2380/4817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:05 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1615 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:06.011851 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0feed996-0b2d-491a-b88b-e31430d1fb01 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.553609 Jul 30 21:23:06.012445 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2438/4818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:05 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:06.039116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:06.039784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:06.040177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:06.040845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:06.052200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.052683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.053313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.053784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.053897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.054583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.054689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.055037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.073461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] HTTP exception thrown: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Request method failure captured: Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 HTTP/1.1 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-1KDlDpGouRjmo-aVHCkIEKGyQwFrhFGjBRd12nV4H6qA9FdDJf9rgISwXNpf_lqiD_1GsIYwVVoY9K54Iq8TKghg-9HI2vTusGyW6wE7zWtlvnzwAbSIq74ajqT_vPgtIaYQ4Zb4LYSIo_6TOVCo_VUBppbEGSdlMz-zG0kaTWs0 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.42 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8696e08b027f4d259759dff57403f900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8696e08b027f4d259759dff57403f900", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7369e2a4c5b24e85b94816e6404b300f Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'df61dfee-28eb-45b7-b2b9-83ca2c4a6444'} Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:23:06.076582 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Returning 404 to user: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d1d547f-d68c-4b87-a557-fd0c8f8c24fe tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 404 len: 111 microversion: 2.42 time: 0.074081 Jul 30 21:23:06.081138 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2381/4819] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:23:06 2022] DELETE /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:23:06.089102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:06.090580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] [instance: df61dfee-28eb-45b7-b2b9-83ca2c4a6444] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:06.101528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.102257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.103641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.104262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.133737 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] HTTP exception thrown: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Request method failure captured: Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 HTTP/1.1 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5Z-1KDlDpGouRjmo-aVHCkIEKGyQwFrhFGjBRd12nV4H6qA9FdDJf9rgISwXNpf_lqiD_1GsIYwVVoY9K54Iq8TKghg-9HI2vTusGyW6wE7zWtlvnzwAbSIq74ajqT_vPgtIaYQ4Zb4LYSIo_6TOVCo_VUBppbEGSdlMz-zG0kaTWs0 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Openstack-Nova-Api-Version: 2.42 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8696e08b027f4d259759dff57403f900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8696e08b027f4d259759dff57403f900", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8696e08b027f4d259759dff57403f900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 8696e08b027f4d259759dff57403f900 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1264652532 Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7369e2a4c5b24e85b94816e6404b300f Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1264652532-project Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'df61dfee-28eb-45b7-b2b9-83ca2c4a6444'} Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.135327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:23:06.140412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] Returning 404 to user: Instance df61dfee-28eb-45b7-b2b9-83ca2c4a6444 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:23:06.144534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f87c1336-49ee-4268-8939-644c68323463 tempest-TaggedBootDevicesTest_v242-1264652532 tempest-TaggedBootDevicesTest_v242-1264652532-project] 10.222.0.17 "GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444" status: 404 len: 111 microversion: 2.42 time: 0.052805 Jul 30 21:23:06.156713 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2382/4820] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:23:06 2022] GET /compute/v2.1/servers/df61dfee-28eb-45b7-b2b9-83ca2c4a6444 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:23:06.447811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e6122fb5-d8f3-4766-bfe9-af4f0f972e7f req-842841ab-219a-4d22-9c15-fa2cc35dfe54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa909cf-9974-49fe-9b0e-285825175258", "name": "network-vif-deleted", "tag": "e1567ead-33c9-41d5-9d9c-41129c278d9c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:06.486844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:06.492669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e6122fb5-d8f3-4766-bfe9-af4f0f972e7f req-842841ab-219a-4d22-9c15-fa2cc35dfe54 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.493259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e6122fb5-d8f3-4766-bfe9-af4f0f972e7f req-842841ab-219a-4d22-9c15-fa2cc35dfe54 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.511001 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e6122fb5-d8f3-4766-bfe9-af4f0f972e7f req-842841ab-219a-4d22-9c15-fa2cc35dfe54 service nova] Creating event network-vif-deleted:e1567ead-33c9-41d5-9d9c-41129c278d9c for instance 0fa909cf-9974-49fe-9b0e-285825175258 on nch1-master-1 Jul 30 21:23:06.511411 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9becf670-928b-466a-af86-169d52a656fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.477300 Jul 30 21:23:06.511773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2439/4821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:06 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:06.531233 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e6122fb5-d8f3-4766-bfe9-af4f0f972e7f req-842841ab-219a-4d22-9c15-fa2cc35dfe54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088922 Jul 30 21:23:06.536303 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2383/4822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:06.547343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:06.548155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:06.558339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.559009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.561579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.565041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.758471 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c980204c-70c4-4596-b838-b43858caed53 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.225516 Jul 30 21:23:06.764298 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2440/4823] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:23:06 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:23:06.769520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:06.773071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:06.828638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.831433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:06.832326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:06.838211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:07.030164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:07.030893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:07.068217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:07.068954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:07.071099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:07.078380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:07.182068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:07.182746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:07.184120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lazy-loading 'fault' on Instance uuid 0fa909cf-9974-49fe-9b0e-285825175258 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:23:07.359110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:07.368682 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa2780b0-2d08-4e3f-a8fd-8be889c0eb28 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 200 len: 1332 microversion: 2.1 time: 0.354306 Jul 30 21:23:07.369335 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2441/4824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:07 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 1332 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:07.504671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:07.516807 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a1b4ab4-72c9-495a-9777-706b07596627 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1672 microversion: 2.1 time: 0.751356 Jul 30 21:23:07.519607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2384/4825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:06 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1672 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:08.390785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:08.392012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:08.400929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:08.404791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:08.405762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:08.406327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:08.474219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:08.476473 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 HTTP/1.1 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0fa909cf-9974-49fe-9b0e-285825175258'} Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:23:08.480403 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:23:08.485428 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:23:08.488566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:23:08.489442 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfbabfec-2ee1-4cc4-b332-7d856ba49ac5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 404 len: 111 microversion: 2.1 time: 0.103230 Jul 30 21:23:08.493868 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2442/4826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:08 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:23:08.500065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b915ce84-7737-498d-a014-bb237d093f4a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '.version_select at 0x7fbb4fdf94c0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:08.543385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:08.544065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:08.547817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b915ce84-7737-498d-a014-bb237d093f4a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987296224" status: 202 len: 0 microversion: 2.1 time: 0.052488 Jul 30 21:23:08.550645 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2385/4827] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:23:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987296224 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:08.565888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:08.566372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:08.567188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:08.570051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:09.526032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:09.542151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-312b4b6d-4a38-498b-b272-79a2f6dd4169 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1652 microversion: 2.1 time: 1.007457 Jul 30 21:23:09.543173 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2443/4828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:08 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1652 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:09.566623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:09.567301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:09.577153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:09.577827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:09.578803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:09.579615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:09.663643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5330ee71-632e-4630-9682-e870ff284a34 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.103563 Jul 30 21:23:09.664744 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2386/4829] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:23:09 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:09.674684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:09.675852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:09.682524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:09.683777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:09.684733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:09.685403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:10.466235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:10.476259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2fbe00d2-3956-49d0-9e94-bc8b2e309011 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1659 microversion: 2.1 time: 0.805803 Jul 30 21:23:10.477816 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2444/4830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:09 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1659 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:11.326507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e760532f-bbd6-454f-8c1e-cb9e5b8ee895 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: .version_select at 0x7fbb4fe1e8b0>, body: {"keypair": {"name": "tempest-keypair-776563924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN82Fsh/zTo6h740w78NWEpLE40GvJCUH+VUhgFJkilFmx5SD4b1GAQbiNH/51tTIq7+iZcMBj0slhM2loxXQC78a5BUoTQvvEYPPuyFbKJlozX6cQeGqjYU686NMs4O1Q=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:11.356264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e760532f-bbd6-454f-8c1e-cb9e5b8ee895 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:23:11.372403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e760532f-bbd6-454f-8c1e-cb9e5b8ee895 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:23:11.421386 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e760532f-bbd6-454f-8c1e-cb9e5b8ee895 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102019 Jul 30 21:23:11.422037 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2387/4831] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:23:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:11.499396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:11.501946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:11.517732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:11.518706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:11.520772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:11.522138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:12.349066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:12.360649 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5015a0b1-be61-49f3-babb-2df13bcaf170 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.865592 Jul 30 21:23:12.362251 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2445/4832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:11 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:12.385477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:12.388292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:12.402283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:12.404730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:12.407127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:12.410990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:13.494001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:13.528345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-93f39e41-4232-4c55-8d69-4df14cf39c7a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.146511 Jul 30 21:23:13.529612 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2388/4833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:12 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:13.802845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:13.803665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:13.810425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:13.811183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:13.812692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:13.813361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:14.376480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:14.388930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35a2a94d-29b2-4622-9ec0-acc37017d4b9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.841796 Jul 30 21:23:14.390437 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2446/4834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:13 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:14.414828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:14.415899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:14.429262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:14.430025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:14.430851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:14.431331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:14.844328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:14.860049 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-66400442-5fb2-4117-9a8c-4433cd44c19e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.449417 Jul 30 21:23:14.861712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2389/4835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:14 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:14.887161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:14.889088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:14.899234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:14.899798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:14.901137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:14.902062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:15.514798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:15.529384 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0924afd-a103-41fc-95c9-6fe843a76a2a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.643658 Jul 30 21:23:15.530471 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2447/4836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:14 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:15.558265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:15.559107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:15.575903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:15.577721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:15.580079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:15.580875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:15.985195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:15.998975 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15c6508d-284e-45a9-bf30-272900e89064 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.447154 Jul 30 21:23:16.000584 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2390/4837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:15 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:18.176532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-596205551", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a87f0dd3-85a2-450b-921c-516df3eac226"}], "security_groups": [{"name": "tempest-securitygroup--1585024759"}], "key_name": "tempest-keypair-776563924", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:18.501335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] validate_networks() for [('a87f0dd3-85a2-450b-921c-516df3eac226', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:23:20.041602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:23:20.043748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:23:20.047198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:23:20.047940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:23:20.048587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:23:20.073986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:20.079528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:20.081614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:20.082293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:20.142158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:23:20.151060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:23:20.181487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:23:20.184357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:23:20.280911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e693e1d6-ebe6-4f4d-8343-d2dc3b7f7dcd tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.116445 Jul 30 21:23:20.281753 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2448/4838] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:23:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:23:20.294031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ae400d1-c802-4e3b-a4c2-dc9be84d6fb8 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:20.294993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ae400d1-c802-4e3b-a4c2-dc9be84d6fb8 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:20.512552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ae400d1-c802-4e3b-a4c2-dc9be84d6fb8 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:20.519710 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ae400d1-c802-4e3b-a4c2-dc9be84d6fb8 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1240 microversion: 2.1 time: 0.229699 Jul 30 21:23:20.524580 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2391/4839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:20 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1240 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:21.548237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:21.549054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:21.579351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:21.579971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:21.580940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:21.581410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:21.811739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:21.828813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52a1cb87-c5e4-4555-b1ef-1202dff00218 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1292 microversion: 2.1 time: 0.282340 Jul 30 21:23:21.832841 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2449/4840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:21 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1292 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:22.856944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:22.857649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:22.875054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:22.878046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:22.879780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:22.881114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:22.951626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:23.261321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:23.271581 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-65fa4566-5913-4676-a513-bd1785b70b13 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1298 microversion: 2.1 time: 0.421381 Jul 30 21:23:23.272577 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2392/4841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:22 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1298 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:24.299469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:24.300820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:24.311255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:24.312116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:24.313132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:24.313943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:24.480831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:24.493151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a21329d2-5e01-46f1-8fde-ae1048daaf03 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1298 microversion: 2.1 time: 0.202303 Jul 30 21:23:24.507887 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2450/4842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:24 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:25.516432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:25.521385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:25.537610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:25.538088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:25.539065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:25.539558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:26.779912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:26.793437 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8fffc34-fe28-4728-85dc-25bb22dd444f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 1.280197 Jul 30 21:23:26.810165 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2393/4843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:25 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:27.818935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:27.820053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:27.829514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:27.831625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:27.832491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:27.833586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:27.834456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:28.054288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:28.066195 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6dd3a9d3-e567-486a-bedd-da4afc2781ae tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 0.252911 Jul 30 21:23:28.066945 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2451/4844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:27 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:29.013153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-02444a3a-1662-45d1-b13a-9b213c563bd7 req-5ca0143e-0c8c-4ff5-a7a3-51c4955c8284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26b1696-dd46-42b3-b3cb-fc676de68d31", "tag": "da144652-e4e2-4f65-b1dc-a8a41e9ba6f4"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:29.045924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:29.060512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-02444a3a-1662-45d1-b13a-9b213c563bd7 req-5ca0143e-0c8c-4ff5-a7a3-51c4955c8284 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:29.061305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-02444a3a-1662-45d1-b13a-9b213c563bd7 req-5ca0143e-0c8c-4ff5-a7a3-51c4955c8284 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:29.099140 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-02444a3a-1662-45d1-b13a-9b213c563bd7 req-5ca0143e-0c8c-4ff5-a7a3-51c4955c8284 service nova] Creating event network-changed:da144652-e4e2-4f65-b1dc-a8a41e9ba6f4 for instance c26b1696-dd46-42b3-b3cb-fc676de68d31 on nch2-master-1 Jul 30 21:23:29.100435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:29.104953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:29.135817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-02444a3a-1662-45d1-b13a-9b213c563bd7 req-5ca0143e-0c8c-4ff5-a7a3-51c4955c8284 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125149 Jul 30 21:23:29.136389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:29.136519 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2394/4845] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:29.138758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:29.140978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:29.141633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:29.705698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:29.717573 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70f039a9-d95e-46f8-9353-3196c80337cb tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 0.630017 Jul 30 21:23:29.721469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2452/4846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:29 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:30.745438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:30.747478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:30.757893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:30.817872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:30.818612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:30.820327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:30.821265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:31.293926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:31.314129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0794132f-637d-40d7-a98f-050526d781ed tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 0.575004 Jul 30 21:23:31.316131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2395/4847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:30 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:32.339747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:32.340450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:32.347354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:32.350372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:32.352526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:32.353264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:32.354512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:32.355312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:32.747886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:32.766946 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3927cd89-68e3-49f0-a464-cb03e50ed20d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 0.430302 Jul 30 21:23:32.780136 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2453/4848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:32 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:33.794621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:33.796197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:33.827713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:33.831065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:33.832946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:33.837674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:34.827229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:34.839595 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-527ab7c0-db10-4a0c-bfc3-aa9d897d6ca2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 1.050249 Jul 30 21:23:34.844532 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2396/4849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:33 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:35.007270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8d8d8b0d-ee23-4033-8cb4-7290cca59e81 req-dd1343b3-0bf7-4252-8761-2bf0dba3ff54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26b1696-dd46-42b3-b3cb-fc676de68d31", "name": "network-vif-plugged", "status": "completed", "tag": "da144652-e4e2-4f65-b1dc-a8a41e9ba6f4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:35.024857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d8d8b0d-ee23-4033-8cb4-7290cca59e81 req-dd1343b3-0bf7-4252-8761-2bf0dba3ff54 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:35.025644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8d8d8b0d-ee23-4033-8cb4-7290cca59e81 req-dd1343b3-0bf7-4252-8761-2bf0dba3ff54 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:35.044077 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8d8d8b0d-ee23-4033-8cb4-7290cca59e81 req-dd1343b3-0bf7-4252-8761-2bf0dba3ff54 service nova] Creating event network-vif-plugged:da144652-e4e2-4f65-b1dc-a8a41e9ba6f4 for instance c26b1696-dd46-42b3-b3cb-fc676de68d31 on nch2-master-1 Jul 30 21:23:35.050863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8d8d8b0d-ee23-4033-8cb4-7290cca59e81 req-dd1343b3-0bf7-4252-8761-2bf0dba3ff54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049814 Jul 30 21:23:35.052413 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2454/4850] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:35.865424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:35.866868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:35.876028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:35.878425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:35.879547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:35.880263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:36.342045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:36.367593 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e83355c-c0a4-4e1e-96eb-8954ec1b3177 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1366 microversion: 2.1 time: 0.506049 Jul 30 21:23:36.385139 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2397/4851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:35 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:37.393307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:37.394099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:37.402703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:37.403585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:37.404622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:37.407281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:37.844483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:37.861439 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8db0b87b-ef7c-4d1f-8baa-72bb79663adc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1556 microversion: 2.1 time: 0.473197 Jul 30 21:23:37.880288 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2455/4852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:37 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1556 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:37.892307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:37.892974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:37.902533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:37.903115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:37.904197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:37.904759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:38.152402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2e930971-761c-4f86-8b06-ec6af571f52c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262360 Jul 30 21:23:38.164354 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2398/4853] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:23:37 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:39.319210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:39.322353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:39.340191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:39.341505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:39.342516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:39.344282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:39.354117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=72 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:39.482670 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a49ba3f1-52f4-47b7-b6fa-3cf86f499809 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.168411 Jul 30 21:23:39.483801 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2456/4854] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:23:39 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:23:39.493277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:39.493910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:39.503664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:39.504582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:39.514064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:39.519008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:40.378455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:40.393943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fb6fc9e-4a33-4b79-a75e-861ecb41e9b6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1669 microversion: 2.1 time: 0.904913 Jul 30 21:23:40.394893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2399/4855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:39 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1669 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:41.417653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:41.419186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:41.439899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:41.440421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:41.441266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:41.441720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:41.933706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:41.944660 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a201ed8-55e7-472f-a0df-deb615e9ad30 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1669 microversion: 2.1 time: 0.532191 Jul 30 21:23:41.945618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2457/4856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:41 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:42.969065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:42.969700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:43.002428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:43.005817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:43.007723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:43.033354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:43.834112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:43.880807 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ad441b28-f200-4006-aa40-bd8caedc8033 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1669 microversion: 2.1 time: 0.915536 Jul 30 21:23:43.900256 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2400/4857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:42 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1669 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:44.257905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d524f09a-1336-4ce5-abc2-a0331d0cdf3c req-21c9a7ac-6c3f-431a-ab18-49a219dc779d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26b1696-dd46-42b3-b3cb-fc676de68d31", "tag": "da144652-e4e2-4f65-b1dc-a8a41e9ba6f4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:44.297076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d524f09a-1336-4ce5-abc2-a0331d0cdf3c req-21c9a7ac-6c3f-431a-ab18-49a219dc779d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:44.298872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d524f09a-1336-4ce5-abc2-a0331d0cdf3c req-21c9a7ac-6c3f-431a-ab18-49a219dc779d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:44.334768 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d524f09a-1336-4ce5-abc2-a0331d0cdf3c req-21c9a7ac-6c3f-431a-ab18-49a219dc779d service nova] Creating event network-changed:da144652-e4e2-4f65-b1dc-a8a41e9ba6f4 for instance c26b1696-dd46-42b3-b3cb-fc676de68d31 on nch2-master-1 Jul 30 21:23:44.357039 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d524f09a-1336-4ce5-abc2-a0331d0cdf3c req-21c9a7ac-6c3f-431a-ab18-49a219dc779d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110593 Jul 30 21:23:44.362996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2458/4858] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:23:44.909069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:44.909873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:44.924908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:44.925633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:44.926605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:44.927891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:46.260901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:46.272985 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-35db253e-87a4-4b94-ac69-147bb3b1fff2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.368375 Jul 30 21:23:46.276171 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2401/4859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:44 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:54.267105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2076166371", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "f62d7e65-73fa-4b19-b649-f94a260bd84c"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:23:54.288197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=15 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:54.333743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:54.372396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] validate_networks() for [('f62d7e65-73fa-4b19-b649-f94a260bd84c', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:23:55.423263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:23:55.423897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:23:55.424605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:23:55.425107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:23:55.425765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:23:55.463841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:55.463841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:55.470671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:55.471153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:55.605617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Getting quotas for project b87e9ef5272f4aac99f5fe95ca96219a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:23:55.624194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Getting quotas for user 424bc1ec391d4b92beb35305d5060f42 and project b87e9ef5272f4aac99f5fe95ca96219a. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:23:55.686076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:23:55.689414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:23:55.825828 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769083 Jul 30 21:23:55.832110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2459/4860] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:23:55.838481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d77899d4-4d42-4531-af0a-236f4eaed318 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:55.839119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d77899d4-4d42-4531-af0a-236f4eaed318 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:55.849050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=15 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:56.106449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d77899d4-4d42-4531-af0a-236f4eaed318 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:56.119707 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d77899d4-4d42-4531-af0a-236f4eaed318 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1217 microversion: 2.1 time: 0.285956 Jul 30 21:23:56.120347 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2402/4861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:55 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1217 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:23:57.143099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:57.143940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:57.158461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:57.163969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:57.175554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:57.176469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:57.450203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:57.462212 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2c73133-7c3d-41c6-8617-80bf1b936dcc tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1213 microversion: 2.1 time: 0.323033 Jul 30 21:23:57.475314 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2460/4862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:57 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:58.487983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:58.489225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:58.501374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=52 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:58.504499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:58.508576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:58.512096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:58.512927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:58.774206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:23:58.791759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e5ea919-5a1b-4a7f-9d5e-3661aa6937fe tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1275 microversion: 2.1 time: 0.305697 Jul 30 21:23:58.792397 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2403/4863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:58 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:23:59.818214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:23:59.819589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:23:59.834574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:59.835376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:23:59.836449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:23:59.838052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:00.011793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:00.024196 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4da04d0-12b9-4332-8030-f32bcf351177 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1275 microversion: 2.1 time: 0.206437 Jul 30 21:24:00.026357 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2461/4864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:23:59 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:01.053433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:01.054255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:01.069339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:01.072505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:01.077694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:01.078316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:01.568322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:01.581717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-19bfdc2a-e3f4-48f9-b9db-3c6748577406 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.533694 Jul 30 21:24:01.584689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2404/4865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:01 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:02.605508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:02.606142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:02.644888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:02.649124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:02.651006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:02.652804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:02.997713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:03.029559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4997068e-d222-4013-8250-c013ea90bd8c tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.428119 Jul 30 21:24:03.030191 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2462/4866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:02 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:03.969914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a820c864-d239-4d94-8355-48146b4b10e2 req-10abe9ad-a753-4dbe-9d4a-bb929c13edb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb354cbc-e4ef-4a12-b00f-6818fd096842", "tag": "7d26b05b-7b1d-4d4c-b864-c0561d84580c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:03.985737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a820c864-d239-4d94-8355-48146b4b10e2 req-10abe9ad-a753-4dbe-9d4a-bb929c13edb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:03.986553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a820c864-d239-4d94-8355-48146b4b10e2 req-10abe9ad-a753-4dbe-9d4a-bb929c13edb3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:04.012015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a820c864-d239-4d94-8355-48146b4b10e2 req-10abe9ad-a753-4dbe-9d4a-bb929c13edb3 service nova] Creating event network-changed:7d26b05b-7b1d-4d4c-b864-c0561d84580c for instance bb354cbc-e4ef-4a12-b00f-6818fd096842 on nch1-master-1 Jul 30 21:24:04.019654 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a820c864-d239-4d94-8355-48146b4b10e2 req-10abe9ad-a753-4dbe-9d4a-bb929c13edb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053144 Jul 30 21:24:04.020884 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2405/4867] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:04.056473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:04.057144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:04.068323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:04.069074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:04.070203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:04.070828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:04.450639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:04.459655 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92743742-1e7c-4c8b-9146-3af8592d85c0 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.408090 Jul 30 21:24:04.464059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2463/4868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:04 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:05.490017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:05.490849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:05.505174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:05.506326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:05.507424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:05.508115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:06.059589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:06.082031 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a47161e2-c5ae-4e59-a61a-e0149397d30f tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.597089 Jul 30 21:24:06.084367 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2406/4869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:05 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:07.108779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:07.109424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:07.113372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:07.114070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:07.130400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:07.130883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:07.131739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:07.132202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:07.496858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:07.509510 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f84cabf-187c-4fa7-b77b-8b4f21baee48 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.404597 Jul 30 21:24:07.510765 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2464/4870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:07 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:08.533620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:08.537319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:08.550994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:08.562140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:08.563277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:08.565544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:08.566446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:08.893452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:08.902534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4a9a83a-de7b-47e5-916c-26e10d07ed78 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.375307 Jul 30 21:24:08.904298 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2407/4871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:08 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:09.926992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:09.929100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:09.942918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:09.950455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:09.952735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:09.953521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:10.298475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:10.316191 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c94fb05-7663-43ae-bf94-0d1cc13276f9 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.395064 Jul 30 21:24:10.327413 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2465/4872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:09 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:11.077733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-09312159-b51a-4b8c-b2ae-69c9c63d1f57 req-63ec155f-009a-4997-8367-d4e4aeabfb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb354cbc-e4ef-4a12-b00f-6818fd096842", "name": "network-vif-plugged", "status": "completed", "tag": "7d26b05b-7b1d-4d4c-b864-c0561d84580c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:11.098564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-09312159-b51a-4b8c-b2ae-69c9c63d1f57 req-63ec155f-009a-4997-8367-d4e4aeabfb8d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:11.099050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-09312159-b51a-4b8c-b2ae-69c9c63d1f57 req-63ec155f-009a-4997-8367-d4e4aeabfb8d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:11.126102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-09312159-b51a-4b8c-b2ae-69c9c63d1f57 req-63ec155f-009a-4997-8367-d4e4aeabfb8d service nova] Creating event network-vif-plugged:7d26b05b-7b1d-4d4c-b864-c0561d84580c for instance bb354cbc-e4ef-4a12-b00f-6818fd096842 on nch1-master-1 Jul 30 21:24:11.141275 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-09312159-b51a-4b8c-b2ae-69c9c63d1f57 req-63ec155f-009a-4997-8367-d4e4aeabfb8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067398 Jul 30 21:24:11.142582 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2408/4873] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:24:11.349904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:11.351112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:11.366524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:11.367262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:11.368150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:11.368607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:11.850349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:11.865940 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c496b963-f2d9-430e-9bed-6f2bf25aa4af tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 0.521078 Jul 30 21:24:11.867826 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2466/4874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:11 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:12.891586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:12.893795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:12.907956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:12.909473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:12.910550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:12.911369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:14.226818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:14.234506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe394b25-fcea-4d7c-9130-731c500e43c3 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1317 microversion: 2.1 time: 1.349005 Jul 30 21:24:14.237430 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2409/4875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:12 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1317 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:15.258643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:15.259936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:15.288254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.289461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:15.291068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.291796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:15.809101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:15.820359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9aacd0fa-8697-40e8-ac2d-359589eea766 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1507 microversion: 2.1 time: 0.565812 Jul 30 21:24:15.821971 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2467/4876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:15 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:15.844620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:15.846859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:15.856323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.857528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:15.858522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.859130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:15.909546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:15.910803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5d81928c-e2ca-4064-b26d-5a31c5a20cb5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/os-instance-actions/req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7" status: 200 len: 313 microversion: 2.1 time: 0.070175 Jul 30 21:24:15.912497 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2410/4877] 10.222.0.17 () {58 vars in 1419 bytes} [Sat Jul 30 21:24:15 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/os-instance-actions/req-eb80d3da-8a01-4e03-a6e5-1af19a6c2eb7 => generated 313 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:15.928280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:15.937755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:15.955504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.956869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:15.963903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:15.964409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:16.178151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f55b5eb1-854d-4dfc-a2f7-0590db5c6b83 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "POST /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/action" status: 202 len: 0 microversion: 2.1 time: 0.254610 Jul 30 21:24:16.178817 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2468/4878] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:24:15 2022] POST /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:24:16.193158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:16.194393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:16.211395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:16.214239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:16.225713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:16.227082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:16.763742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:16.782373 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d72157fe-1058-4f2d-843a-462c2319ea92 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1509 microversion: 2.1 time: 0.597214 Jul 30 21:24:16.784505 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2411/4879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:16 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:16.824790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:16.826526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:16.838833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:16.843741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:16.845916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:16.846401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:16.908597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7fe6ca31-1558-46c2-955c-afccd4e703e2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/ips" status: 200 len: 149 microversion: 2.1 time: 0.092065 Jul 30 21:24:16.910187 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2469/4880] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:24:16 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:17.806096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:17.806913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:17.820583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:17.822232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:17.825230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:17.825997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:18.314475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:18.327953 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ea518ce-6d61-4888-95ba-676acdeab1f2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1509 microversion: 2.1 time: 0.526813 Jul 30 21:24:18.368401 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2412/4881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:17 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:18.545237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:18.546174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:18.568252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:18.569626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:18.628229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4626f264-6101-4b93-9bbf-7c9a5c6b3f81"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:18.637343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:18.641436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.068s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:18.645433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:18.658127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:18.661556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:18.667987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:18.669099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.161525 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4d63f8e1-d744-40a1-8a9e-705c97740c01 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539503 Jul 30 21:24:19.164447 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2413/4882] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:24:18 2022] POST /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:19.346709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:19.352792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:19.353627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:19.366975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.371524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.374376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.374689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f810106-5336-4212-a16a-d9a40e89d376 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.819240 Jul 30 21:24:19.382591 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2470/4883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:18 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:19.388051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.406541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:19.407192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:19.414125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.416426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.417422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.418042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.849966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:19.860625 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-132d900b-b187-42d4-87ab-7609a9c97bd5 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1507 microversion: 2.1 time: 0.513770 Jul 30 21:24:19.869479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2414/4884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:19 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:19.889719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '.version_select at 0x7fbb4fe52790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:19.890381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:19.897623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.898235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.899213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.899870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.953175 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3cd85cd1-2cd7-4324-a759-124cfe06f4e4 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.067608 Jul 30 21:24:19.954997 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2415/4885] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Jul 30 21:24:19 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842/os-instance-actions => generated 611 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:19.973442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:19.974633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:19.983411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.984117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:19.985761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:19.986665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:20.044127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:24:20.234921 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27a6c940-3023-439d-bd5e-09eea11ef2df tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 204 len: 0 microversion: 2.1 time: 0.266601 Jul 30 21:24:20.235782 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2416/4886] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:24:19 2022] DELETE /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:24:20.245302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:20.246245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:20.259800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:20.272128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:20.273359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:20.274151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:20.932426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:20.943486 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90c88a29-db5a-465d-8469-e86a5ff96edd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.546350 Jul 30 21:24:20.944289 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2471/4887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:19 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:24:20.969547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:20.970513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:20.990632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:20.991929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:20.993608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:20.994586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:20.995357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:20.996024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:21.010911 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d722889b-d9ad-46ac-9ab9-37f82dca8dc2 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1513 microversion: 2.1 time: 0.770423 Jul 30 21:24:21.011929 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2417/4888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:20 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1513 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:21.538342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:21.553387 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c5e0dd6-a3e3-48da-9cc7-560e9f4e8e96 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.589378 Jul 30 21:24:21.570078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2472/4889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:20 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:21.578780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:21.580132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:21.594567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:21.595636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:21.596666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:21.597322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:22.042942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:22.044631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:22.055631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:22.056276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:22.057288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:22.058156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:22.518173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:22.535146 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-baabe309-0065-40bc-a44f-b184963f4497 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1513 microversion: 2.1 time: 0.499264 Jul 30 21:24:22.538021 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2473/4890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:22 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:22.707611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4626f264-6101-4b93-9bbf-7c9a5c6b3f81"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:22.710384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:22.717952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:22.718785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:22.719850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:22.721140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:22.802426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:22.822776 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fef81959-df00-4375-968b-66e77be4b05c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.247870 Jul 30 21:24:22.825823 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2418/4891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:21 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:22.934476 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments HTTP/1.1 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 74 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: {"volumeAttachment": {"volumeId": "4626f264-6101-4b93-9bbf-7c9a5c6b3f81"}} Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: exception: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'c26b1696-dd46-42b3-b3cb-fc676de68d31', 'body': {'volumeAttachment': {'volumeId': '4626f264-6101-4b93-9bbf-7c9a5c6b3f81'}}} Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:24:22.936699 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 Jul 30 21:24:22.940949 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:24:22.952746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 400 to user: Invalid volume: volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is already attached to instances: c26b1696-dd46-42b3-b3cb-fc676de68d31 {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:24:22.957495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed180c61-b879-494b-afe7-4d409f2ded15 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.253945 Jul 30 21:24:22.962021 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2474/4892] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:24:22 2022] POST /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments => generated 174 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:24:23.084511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:23.085284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:23.097832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.101117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.102200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.105162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.177287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1418563139", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "aa7ed307-3fdf-4329-9a4b-db68b093ba0f"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:23.311478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lazy-loading 'services' on Instance uuid c26b1696-dd46-42b3-b3cb-fc676de68d31 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:24:23.341100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] validate_networks() for [('aa7ed307-3fdf-4329-9a4b-db68b093ba0f', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:24:23.464380 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-871a09e1-86fd-4318-a7f9-d17917847255 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments/4626f264-6101-4b93-9bbf-7c9a5c6b3f81" status: 202 len: 0 microversion: 2.1 time: 0.385280 Jul 30 21:24:23.466338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2419/4893] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:24:23 2022] DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments/4626f264-6101-4b93-9bbf-7c9a5c6b3f81 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:24:23.523400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:23.533352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:23.570302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.573222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.579524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.585472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.678577 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f100f632-9b81-498c-b028-e12c1fc3cebf tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174173 Jul 30 21:24:23.687968 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2420/4894] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:24:23 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:23.707859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6ab5bc07-70e8-4dde-9862-9f0068df71e5 req-30f4c4bd-a363-4797-bce7-ed64ccc3ed76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb354cbc-e4ef-4a12-b00f-6818fd096842", "name": "network-vif-deleted", "tag": "7d26b05b-7b1d-4d4c-b864-c0561d84580c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:23.726397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6ab5bc07-70e8-4dde-9862-9f0068df71e5 req-30f4c4bd-a363-4797-bce7-ed64ccc3ed76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.727171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6ab5bc07-70e8-4dde-9862-9f0068df71e5 req-30f4c4bd-a363-4797-bce7-ed64ccc3ed76 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.741799 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6ab5bc07-70e8-4dde-9862-9f0068df71e5 req-30f4c4bd-a363-4797-bce7-ed64ccc3ed76 service nova] Creating event network-vif-deleted:7d26b05b-7b1d-4d4c-b864-c0561d84580c for instance bb354cbc-e4ef-4a12-b00f-6818fd096842 on nch1-master-1 Jul 30 21:24:23.748412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6ab5bc07-70e8-4dde-9862-9f0068df71e5 req-30f4c4bd-a363-4797-bce7-ed64ccc3ed76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058882 Jul 30 21:24:23.749896 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2421/4895] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:23.760793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:23.761932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:23.771910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.772620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.773689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.775589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.818423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:23.819782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:23.821668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lazy-loading 'fault' on Instance uuid bb354cbc-e4ef-4a12-b00f-6818fd096842 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:24:24.271405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424bc1ec391d4b92beb35305d5060f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87e9ef5272f4aac99f5fe95ca96219a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:24.282697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddbd8a0f-eb86-4b97-9ee0-db40863ca362 tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 200 len: 1307 microversion: 2.1 time: 0.529096 Jul 30 21:24:24.284016 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2422/4896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:23 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 1307 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:24.694409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:24.696902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:24.709022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:24.716468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:24.717828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:24.718509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:24.754803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-406ce899-be2d-4572-82fe-35256a353ea2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064494 Jul 30 21:24:24.756486 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2423/4897] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:24:24 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:24:24.833828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:24.835250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:24.842899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:24.843769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:24.844785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:24.845447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:24.874899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:24:25.017663 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68a63959-8c91-4aea-9c76-c060da65319d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 204 len: 0 microversion: 2.1 time: 0.187849 Jul 30 21:24:25.018742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2424/4898] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:24:24 2022] DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:24:25.029040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:25.030391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:25.047819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.048448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:25.049487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.050119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:25.626509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:25.652414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca2a96c2-77c5-4296-8e5f-89f55c274a62 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1680 microversion: 2.1 time: 0.628837 Jul 30 21:24:25.653901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2425/4899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:25 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1680 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:25.660401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:25.662315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] [instance: bb354cbc-e4ef-4a12-b00f-6818fd096842] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:25.671836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.673371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:25.674879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.676145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:25.705818 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] HTTP exception thrown: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Request method failure captured: Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 HTTP/1.1 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aFp9ftyhMlhlNuV8Rt0FiYQglMa97UTh8XQJ7M41zGJRxUcnUFQgUJFthRYTyAX8SY_KzswUokhyTXrjGcj-ZDFzony6hOmQNNeEGBBjpT0_3MEO1FsW_mX-333OqHrlsoyqM97w3USAJUENcqToebNfzrSW1B7au67tdikJkwWsIQ Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: b87e9ef5272f4aac99f5fe95ca96219a Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-InstanceActionsTestJSON-437591406 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b87e9ef5272f4aac99f5fe95ca96219a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b87e9ef5272f4aac99f5fe95ca96219a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b87e9ef5272f4aac99f5fe95ca96219a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b87e9ef5272f4aac99f5fe95ca96219a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-InstanceActionsTestJSON-437591406 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: b87e9ef5272f4aac99f5fe95ca96219a Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-InstanceActionsTestJSON-437591406 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-InstanceActionsTestJSON-437591406-project Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 424bc1ec391d4b92beb35305d5060f42 Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-InstanceActionsTestJSON-437591406-project Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'bb354cbc-e4ef-4a12-b00f-6818fd096842'} Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:25.708337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. Jul 30 21:24:25.717422 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:25.721590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] Returning 404 to user: Instance bb354cbc-e4ef-4a12-b00f-6818fd096842 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:24:25.722758 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22dab66e-1a0c-4865-95fc-bd3e8c35ca1a tempest-InstanceActionsTestJSON-437591406 tempest-InstanceActionsTestJSON-437591406-project] 10.222.0.17 "GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842" status: 404 len: 111 microversion: 2.1 time: 0.067579 Jul 30 21:24:25.724199 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2426/4900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:25 2022] GET /compute/v2.1/servers/bb354cbc-e4ef-4a12-b00f-6818fd096842 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:24:25.941698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:24:25.942864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:24:25.944913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:24:25.946368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:24:25.947080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:24:25.953556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:25.982511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.983394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:25.984588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:25.985635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:26.003088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:26.035112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:24:26.049727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:24:26.089351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:24:26.092290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:24:26.224888 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0787ebd2-1c22-4992-ad3e-143066b7d398 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.055764 Jul 30 21:24:26.225809 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2475/4901] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:24:26.237715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c55b2548-1a00-41d0-bd8b-398d9594dd5a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:26.238482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c55b2548-1a00-41d0-bd8b-398d9594dd5a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:26.251489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:26.687561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:26.688172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:26.695545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:26.697308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:26.698444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:26.699731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:26.842460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c55b2548-1a00-41d0-bd8b-398d9594dd5a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:26.858874 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c55b2548-1a00-41d0-bd8b-398d9594dd5a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1215 microversion: 2.1 time: 0.625315 Jul 30 21:24:26.872573 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2427/4902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:26 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1215 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:27.412743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:27.433066 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1212f269-c7c0-401f-865e-14c83bd18a6d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1680 microversion: 2.1 time: 0.761326 Jul 30 21:24:27.434303 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2476/4903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:26 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1680 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:27.885286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:27.886619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:27.894804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:27.895547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:27.896593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:27.897288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:28.122728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:28.141043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a404890d-b9a9-4074-bb21-6220c328a1fa tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1273 microversion: 2.1 time: 0.257810 Jul 30 21:24:28.142639 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2428/4904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:27 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:28.456189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:28.457408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:28.465549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:28.466200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:28.467177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:28.467672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:29.169350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:29.170999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:29.191408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:29.196273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:29.197819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:29.198455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:29.258000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:29.274227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6240a94c-6852-4303-8bc3-a694bff1e55b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1680 microversion: 2.1 time: 0.821667 Jul 30 21:24:29.277340 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2477/4905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:28 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1680 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:29.425690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:29.438721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5fae479f-c851-406e-b513-ef1f1db98690 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1273 microversion: 2.1 time: 0.275553 Jul 30 21:24:29.457222 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2429/4906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:29 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:30.300114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:30.300759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:30.317605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:30.321424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:30.322543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:30.323179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:30.457030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:30.465503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:30.466153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:30.470206 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d3326f7-c34b-495b-aa56-b9785588936f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1612 microversion: 2.1 time: 0.173974 Jul 30 21:24:30.471192 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2478/4907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:30 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1612 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:30.480463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:30.484038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:30.487980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:30.488666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:31.162174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:31.183216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6849bbd9-cee4-47ca-a69d-032a999b5fcb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 0.722893 Jul 30 21:24:31.185037 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2430/4908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:30 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:31.406733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4d608f2f-71ee-4c9c-b877-1aaca8370e2b req-0d8096d2-f5f2-47aa-a32a-14e91a29639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26b1696-dd46-42b3-b3cb-fc676de68d31", "name": "network-vif-deleted", "tag": "da144652-e4e2-4f65-b1dc-a8a41e9ba6f4"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:31.429601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4d608f2f-71ee-4c9c-b877-1aaca8370e2b req-0d8096d2-f5f2-47aa-a32a-14e91a29639c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:31.430634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4d608f2f-71ee-4c9c-b877-1aaca8370e2b req-0d8096d2-f5f2-47aa-a32a-14e91a29639c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:31.469894 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4d608f2f-71ee-4c9c-b877-1aaca8370e2b req-0d8096d2-f5f2-47aa-a32a-14e91a29639c service nova] Creating event network-vif-deleted:da144652-e4e2-4f65-b1dc-a8a41e9ba6f4 for instance c26b1696-dd46-42b3-b3cb-fc676de68d31 on nch2-master-1 Jul 30 21:24:31.504576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:31.510320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:31.520828 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4d608f2f-71ee-4c9c-b877-1aaca8370e2b req-0d8096d2-f5f2-47aa-a32a-14e91a29639c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116534 Jul 30 21:24:31.523707 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2479/4909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:31.534580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:31.536052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:31.537285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:31.537917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:31.613083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:31.615883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:31.616548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lazy-loading 'fault' on Instance uuid c26b1696-dd46-42b3-b3cb-fc676de68d31 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:24:31.757780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:31.772399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1227317b-7f7a-4409-bf5d-b42803e95db6 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 200 len: 1330 microversion: 2.1 time: 0.280193 Jul 30 21:24:31.776305 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2431/4910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:31 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 1330 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:32.209009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:32.210015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:32.233034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:32.235593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:32.237868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:32.239222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:32.802606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:32.803241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:32.819236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:32.819728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:32.820736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:32.821378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:32.861950 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 HTTP/1.1 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c26b1696-dd46-42b3-b3cb-fc676de68d31'} Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:24:32.865348 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:24:32.870145 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:24:32.872424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:24:32.873499 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a9ef31c-5b9c-4724-8bce-a2cb7adf4e64 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 404 len: 111 microversion: 2.1 time: 0.077332 Jul 30 21:24:32.878340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2432/4911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:32 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:24:32.886564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-669add80-a6b0-4db6-b32a-2dd4894e08e4 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '.version_select at 0x7fbb4fe750d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:32.928668 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-669add80-a6b0-4db6-b32a-2dd4894e08e4 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776563924" status: 202 len: 0 microversion: 2.1 time: 0.048669 Jul 30 21:24:32.935449 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2433/4912] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:24:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776563924 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:24:32.949372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:32.967438 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57a906d5-a7ba-40d2-9057-9cce6cb397c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 0.758989 Jul 30 21:24:32.971782 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2480/4913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:32 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:33.580222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b3e04d3a-1758-4983-9809-5a6dfa3e4160 req-a48abd78-6d25-4732-ab53-833c1c1084ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a21a86-29f9-4123-a680-83141144b152", "tag": "d513fb13-9ef8-4e93-bda1-968eaa462c92"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:33.600279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3e04d3a-1758-4983-9809-5a6dfa3e4160 req-a48abd78-6d25-4732-ab53-833c1c1084ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:33.603403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3e04d3a-1758-4983-9809-5a6dfa3e4160 req-a48abd78-6d25-4732-ab53-833c1c1084ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:33.629526 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b3e04d3a-1758-4983-9809-5a6dfa3e4160 req-a48abd78-6d25-4732-ab53-833c1c1084ad service nova] Creating event network-changed:d513fb13-9ef8-4e93-bda1-968eaa462c92 for instance 31a21a86-29f9-4123-a680-83141144b152 on nch2-master-1 Jul 30 21:24:33.635148 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b3e04d3a-1758-4983-9809-5a6dfa3e4160 req-a48abd78-6d25-4732-ab53-833c1c1084ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058558 Jul 30 21:24:33.636725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2434/4914] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:33.999997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:34.000724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:34.015315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:34.015864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:34.017853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:34.018350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:35.147227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:35.163848 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20a082b6-72dc-483c-8137-8c138310f0d0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 1.172354 Jul 30 21:24:35.179328 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2481/4915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:33 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:36.194369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:36.195158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:36.229242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:36.230014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:36.231096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:36.231798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:36.620821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dfd6cd4d-7a09-473b-b582-15286480a76e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: .version_select at 0x7fbb5d05a5e0>, body: {"keypair": {"name": "tempest-keypair-2140816002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9Y+dyj1WHpsovXXFdJbbX6G4BK4yUZGkHv3poEsb9OvB/j2iNdn8nYEA3La0LtQCiANF1mHlM8YUJZDYsmecrDjgUcJ0H+jDsPJompK0j/Y0Lgms0ms3iQUYBFEi7MKQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:36.633663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:36.635396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:36.659616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dfd6cd4d-7a09-473b-b582-15286480a76e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:24:36.677284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-dfd6cd4d-7a09-473b-b582-15286480a76e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:24:36.687201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:36.695014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dcdf9cf5-e636-474d-b4d2-17ca9726cdde tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 0.505914 Jul 30 21:24:36.700539 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2435/4916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:36 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:24:36.727122 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dfd6cd4d-7a09-473b-b582-15286480a76e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110581 Jul 30 21:24:36.727739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2482/4917] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:24:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:37.723539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:37.725298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:37.741128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:37.765194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:37.765761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:37.766575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:37.767353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:37.778012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:38.328112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:38.339644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39252e19-f4cc-4da3-bdd5-d5354770432c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 0.619586 Jul 30 21:24:38.340533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2436/4918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:37 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:39.106784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-71410c4f-5773-401c-921a-512663dc9c5a req-1efe7be1-04c6-4013-b73b-baae548a25d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a21a86-29f9-4123-a680-83141144b152", "name": "network-vif-plugged", "status": "completed", "tag": "d513fb13-9ef8-4e93-bda1-968eaa462c92"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:39.127843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-71410c4f-5773-401c-921a-512663dc9c5a req-1efe7be1-04c6-4013-b73b-baae548a25d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:39.130874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-71410c4f-5773-401c-921a-512663dc9c5a req-1efe7be1-04c6-4013-b73b-baae548a25d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:39.182270 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-71410c4f-5773-401c-921a-512663dc9c5a req-1efe7be1-04c6-4013-b73b-baae548a25d3 service nova] Creating event network-vif-plugged:d513fb13-9ef8-4e93-bda1-968eaa462c92 for instance 31a21a86-29f9-4123-a680-83141144b152 on nch2-master-1 Jul 30 21:24:39.199849 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-71410c4f-5773-401c-921a-512663dc9c5a req-1efe7be1-04c6-4013-b73b-baae548a25d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092530 Jul 30 21:24:39.200547 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2483/4919] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:24:39.362824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:39.363493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:39.376095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:39.377335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:39.379812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:39.382493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:40.175377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:40.189656 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-731cf1d6-b846-4cb0-b91a-43e17b812f5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1315 microversion: 2.1 time: 0.831005 Jul 30 21:24:40.193795 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2437/4920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:39 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:41.217678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:41.218514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:41.235355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:41.235953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:41.240816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:41.241305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:41.843958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:41.851988 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c30ec6d-16bc-4d95-9773-adfdb5783fab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1501 microversion: 2.1 time: 0.638975 Jul 30 21:24:41.856170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2484/4921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:41 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1501 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:41.873781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:41.875058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:41.886341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:41.890904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:41.892651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:41.896256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:42.779587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Removing security group 085f6bb5-1cff-41fc-b36f-ee7a57bc8f36 from port d513fb13-9ef8-4e93-bda1-968eaa462c92 Jul 30 21:24:43.266258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562190595", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a87f0dd3-85a2-450b-921c-516df3eac226"}], "security_groups": [{"name": "tempest-securitygroup--1628627930"}], "key_name": "tempest-keypair-2140816002", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:43.922802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] validate_networks() for [('a87f0dd3-85a2-450b-921c-516df3eac226', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:24:44.124995 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bdaa4d2-1e77-4908-b98f-4b03578ada39 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152/action" status: 202 len: 0 microversion: 2.1 time: 2.255457 Jul 30 21:24:44.129808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2438/4922] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:24:41 2022] POST /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152/action => generated 0 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:24:44.135479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:44.136123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:44.150921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:44.152760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:44.156342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:44.156983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:44.680128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:44.689847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa2e3bb7-e5d2-4cbd-9d14-56226220479e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1459 microversion: 2.1 time: 0.558724 Jul 30 21:24:44.700345 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2439/4923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:44 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1459 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:44.713229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-603e3a20-d715-40b4-b7c2-ead859b71100 req-e225b45d-8338-4546-8cf4-fc7e51667b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a21a86-29f9-4123-a680-83141144b152", "tag": "d513fb13-9ef8-4e93-bda1-968eaa462c92"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:44.732630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-603e3a20-d715-40b4-b7c2-ead859b71100 req-e225b45d-8338-4546-8cf4-fc7e51667b23 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:44.733113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-603e3a20-d715-40b4-b7c2-ead859b71100 req-e225b45d-8338-4546-8cf4-fc7e51667b23 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:44.760531 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-603e3a20-d715-40b4-b7c2-ead859b71100 req-e225b45d-8338-4546-8cf4-fc7e51667b23 service nova] Creating event network-changed:d513fb13-9ef8-4e93-bda1-968eaa462c92 for instance 31a21a86-29f9-4123-a680-83141144b152 on nch2-master-1 Jul 30 21:24:44.774675 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-603e3a20-d715-40b4-b7c2-ead859b71100 req-e225b45d-8338-4546-8cf4-fc7e51667b23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069656 Jul 30 21:24:44.779881 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2440/4924] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:44.796375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:44.797435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:44.822246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:44.823481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:44.825507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:44.827601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:45.432966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:24:45.433453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:24:45.433957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:24:45.434393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:24:45.434811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:24:45.450638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:45.451400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:45.452730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:45.453187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:45.490618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:24:45.509303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Getting quotas for user 6896ccb6369541d5a552f3373f39c64d and project 5850a54af6204e2f83d8e61141a04013. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:24:45.544627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:24:45.551196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:24:45.608953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:45.617802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f3109599-0595-42b4-9bb5-6d3ac8a0ac88 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.836023 Jul 30 21:24:45.618419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2441/4925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:44 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:45.651198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:45.651948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:45.673341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:45.676244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:45.679111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:45.680452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:45.705579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26a10776-1864-4a09-b45e-c4d4a577bc5c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.447098 Jul 30 21:24:45.718530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2485/4926] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:24:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:24:45.729818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0e5069e-f87c-41b0-b4e8-a8d9c74cf43e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:45.732410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0e5069e-f87c-41b0-b4e8-a8d9c74cf43e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:46.034131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0e5069e-f87c-41b0-b4e8-a8d9c74cf43e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:46.043826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0e5069e-f87c-41b0-b4e8-a8d9c74cf43e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1242 microversion: 2.1 time: 0.323446 Jul 30 21:24:46.048011 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2486/4927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:45 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1242 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:46.234547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:46.244236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8fedcaf-69d9-4bfb-84c4-a1ef851310bd tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.599103 Jul 30 21:24:46.266585 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2442/4928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:45 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:46.290166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:46.291138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:46.301440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:46.302261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:46.303847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:46.305282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:47.078420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:47.079086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:47.114996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:47.115791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:47.118060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:47.119152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:47.205349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:47.218355 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53576183-e0af-479c-8819-88981487c737 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.932492 Jul 30 21:24:47.220558 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2487/4929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:46 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:47.242983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:47.243908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:47.272102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:47.274159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:47.283456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:47.284400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:47.386728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:47.415311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4222c454-7799-48b7-a480-00a1f2fb9d00 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1294 microversion: 2.1 time: 0.340602 Jul 30 21:24:47.418809 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2443/4930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:47 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1294 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:48.442842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:48.445399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:48.479795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:48.482221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:48.485392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:48.487487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:48.751854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:48.768055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-186c6a67-c083-4ed6-8d11-d4b92939476f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1300 microversion: 2.1 time: 0.330079 Jul 30 21:24:48.769421 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2444/4931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:48 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1300 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:48.841219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:48.855028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-206be48c-3f4b-48df-9df3-520acfad7fa3 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.617156 Jul 30 21:24:48.855667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2488/4932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:47 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:49.108894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1822049616", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "aa7ed307-3fdf-4329-9a4b-db68b093ba0f"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:49.198402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] validate_networks() for [('aa7ed307-3fdf-4329-9a4b-db68b093ba0f', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:24:49.790229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:49.791134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:49.802843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:49.803585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:49.805865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:49.806485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:49.928881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:49.949560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9ccd5962-e941-44ab-b6a2-9cb136c4e85c tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1300 microversion: 2.1 time: 0.163505 Jul 30 21:24:49.953405 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2489/4933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:49 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1300 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:50.987420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:50.991737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:51.032629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:51.033492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:51.035791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:51.036674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:51.233753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:51.244214 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14e141ce-d3dd-45b7-9ae9-17be1ca0fc1e tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1300 microversion: 2.1 time: 0.273434 Jul 30 21:24:51.250106 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2490/4934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:50 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:51.876398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:24:51.877906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:24:51.878412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:24:51.878955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:24:51.879599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:24:51.900019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:51.901633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:51.904055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:51.904551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:51.960697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:24:51.971710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Getting quotas for user c025e35fd22a4895a5d0301c1d5b0e8e and project 116c26d6b98641bb8ed5ff5dcdd966c8. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:24:51.991360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:24:51.995185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:24:52.104544 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99ef7166-7963-44bf-b204-37dda8575aeb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.001263 Jul 30 21:24:52.110217 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2445/4935] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:24:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:24:52.123239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bea06f74-0dcf-4f1a-b784-802919c92f23 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:52.124615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bea06f74-0dcf-4f1a-b784-802919c92f23 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:52.266608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:52.267617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:52.283960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:52.284792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:52.293553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:52.294383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:52.369961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bea06f74-0dcf-4f1a-b784-802919c92f23 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:52.380327 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bea06f74-0dcf-4f1a-b784-802919c92f23 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1215 microversion: 2.1 time: 0.262136 Jul 30 21:24:52.387256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2491/4936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:52 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:53.017130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:53.043738 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e07dbdf-a248-45ee-af4b-cbda41cb7def tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.776492 Jul 30 21:24:53.044747 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2446/4937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:52 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:53.407842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:53.410090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:53.439400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:53.440711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:53.442290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:53.444268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:53.809136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:53.837796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f57a498-c493-4af2-9377-d734338a8a2f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1267 microversion: 2.1 time: 0.436625 Jul 30 21:24:53.842929 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2492/4938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:53 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1267 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:54.065946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:54.066627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:54.082186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:54.094031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:54.095348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:54.096184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:54.866794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:54.867466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:54.891032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:54.894988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:54.897670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:54.898789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:55.026554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:55.040927 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-622dd3b1-478c-4a77-b7ac-05805d3d7dcc tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.979317 Jul 30 21:24:55.051365 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2447/4939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:54 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:55.200514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:55.209386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3a716d5e-e508-482d-8440-7919dd251296 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1273 microversion: 2.1 time: 0.347074 Jul 30 21:24:55.219391 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2493/4940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:54 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:56.072594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:56.075191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:56.092947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:56.098152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:56.103142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:56.131696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:56.243100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:56.244784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:56.255730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:56.259848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:56.266525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:56.273819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:56.276472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:56.277121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:56.307336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=80 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:56.383945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:56.401823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-da1b351c-7777-4d70-816b-1e0ef0ec001b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1273 microversion: 2.1 time: 0.161065 Jul 30 21:24:56.403968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2494/4941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:56 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:24:56.432277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cf051268-ae35-4c03-9bf1-0c633ce99f94 req-5c3dd485-3bc4-40a3-8b40-c3ac22c775b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0825b3da-7fd0-46cd-959c-5c13ae860adb", "tag": "8f88c0ac-5990-4c73-8fae-9a67f0098132"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:24:56.469100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cf051268-ae35-4c03-9bf1-0c633ce99f94 req-5c3dd485-3bc4-40a3-8b40-c3ac22c775b4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:56.475882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cf051268-ae35-4c03-9bf1-0c633ce99f94 req-5c3dd485-3bc4-40a3-8b40-c3ac22c775b4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:56.511051 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cf051268-ae35-4c03-9bf1-0c633ce99f94 req-5c3dd485-3bc4-40a3-8b40-c3ac22c775b4 service nova] Creating event network-changed:8f88c0ac-5990-4c73-8fae-9a67f0098132 for instance 0825b3da-7fd0-46cd-959c-5c13ae860adb on nch1-master-1 Jul 30 21:24:56.526403 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cf051268-ae35-4c03-9bf1-0c633ce99f94 req-5c3dd485-3bc4-40a3-8b40-c3ac22c775b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119512 Jul 30 21:24:56.529304 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2495/4942] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:24:57.111026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:57.130508 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6095c871-cd47-4397-96a7-b13660b97b4b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 1.062403 Jul 30 21:24:57.137772 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2448/4943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:56 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:57.424246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:57.424966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:57.445996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:57.446469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:57.447587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:57.449097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:57.696703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:57.706452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-928f0e7c-6856-4ee2-b922-d0f300544d56 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1273 microversion: 2.1 time: 0.286337 Jul 30 21:24:57.707071 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2496/4944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:57 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:58.158513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:58.159098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:58.163342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:58.183506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:58.184285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:58.185394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:58.186065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:58.730985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:24:58.732255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:24:58.751047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:58.751845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:58.753122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:24:58.753576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:24:59.140076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:59.193144 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9dde55c6-7447-472f-8620-c3aa0443e0a2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 1.036897 Jul 30 21:24:59.217474 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2449/4945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:58 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:24:59.575728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:24:59.590405 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61bbd5eb-20b0-4b72-8fd4-cac0272363a1 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.863460 Jul 30 21:24:59.591315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2497/4946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:24:58 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:00.219255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:00.220812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:00.234431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:00.235983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:00.237072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:00.239246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:00.615110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:00.615940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:00.637276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:00.637742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:00.638780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:00.639238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:00.909896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:00.946240 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b896473-023c-4c64-bab8-d9c19ad1f327 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.730912 Jul 30 21:25:00.963716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2450/4947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:00 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:01.412436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:01.422352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e41c2e94-f30c-4c35-be3b-ae474bbe552c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.812398 Jul 30 21:25:01.426513 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2498/4948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:00 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:01.485804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-019c7e5c-8bbe-4bac-8fba-0222d9b56acb req-48addeb5-99a7-45a2-afbb-55ea6d1cb19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eda93f8-d7de-4d11-9632-9aeb8ad443da", "tag": "a9b44af9-319e-4e40-88b9-e53bd2c10632"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:01.521810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-019c7e5c-8bbe-4bac-8fba-0222d9b56acb req-48addeb5-99a7-45a2-afbb-55ea6d1cb19c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:01.523301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-019c7e5c-8bbe-4bac-8fba-0222d9b56acb req-48addeb5-99a7-45a2-afbb-55ea6d1cb19c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:01.558597 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-019c7e5c-8bbe-4bac-8fba-0222d9b56acb req-48addeb5-99a7-45a2-afbb-55ea6d1cb19c service nova] Creating event network-changed:a9b44af9-319e-4e40-88b9-e53bd2c10632 for instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da on nch2-master-1 Jul 30 21:25:01.577629 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-019c7e5c-8bbe-4bac-8fba-0222d9b56acb req-48addeb5-99a7-45a2-afbb-55ea6d1cb19c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095428 Jul 30 21:25:01.580765 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2451/4949] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:01.970078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:01.970755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:01.986365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:01.987587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:01.992325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:01.992830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:02.375773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=14 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:02.449243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:02.450051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:02.457233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:02.458487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:02.466039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:02.468682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:02.469794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:02.472618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:02.588785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:02.610920 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80596e8b-7d74-481d-812b-d601164e2806 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.646388 Jul 30 21:25:02.625438 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2499/4950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:01 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:02.908765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:02.917930 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c1643726-a591-4ac5-9c80-0fb2e91925ec tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.474228 Jul 30 21:25:02.924656 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2452/4951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:02 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:03.634263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:03.634866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:03.642240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:03.642717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:03.643559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:03.644023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:03.945793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:03.947143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:03.963664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:03.964670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:03.965638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:03.966209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:04.301474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:04.312746 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca86b591-39ba-4773-bdd6-b675d395263b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.371828 Jul 30 21:25:04.313344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2453/4952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:03 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:04.529207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:04.544525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98163f73-d537-4124-9679-f312991d5683 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.914705 Jul 30 21:25:04.545485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2500/4953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:03 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:05.335785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:05.335785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:05.345031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:05.349595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:05.353316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:05.353916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:05.569882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:05.570631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:05.589108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:05.589695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:05.590608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:05.591160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:05.862834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:05.874097 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47b2b0ff-fd45-43a3-ae6b-a086a739b18a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.309159 Jul 30 21:25:05.885073 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2501/4954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:05 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:06.456739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:06.481863 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6231b4d6-0d51-4d17-8a48-b3113850ac50 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 1.150834 Jul 30 21:25:06.489542 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2454/4955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:05 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:06.895667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:06.896375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:06.912131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:06.927152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:06.929077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:06.934937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:07.326603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:07.337680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90864e5a-8fe6-4067-963d-61a5763a5a30 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.446015 Jul 30 21:25:07.351507 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2502/4956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:06 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:07.509713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:07.510932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:07.533045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:07.534030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:07.535228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:07.535910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:07.596453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:07.861766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-416214444", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "c8220f84-21f8-4cef-be67-e6de8b42613c"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:07.951774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] validate_networks() for [('c8220f84-21f8-4cef-be67-e6de8b42613c', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:25:08.132106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:08.143864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-243753f6-8116-4c92-b57a-cc1d1194a1be tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.644319 Jul 30 21:25:08.144795 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2455/4957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:07 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:08.364347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:08.365454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:08.375698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:08.379063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:08.380706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:08.381934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:08.934071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:08.946027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-905896ea-26d0-4cd2-8176-ae24198d79a9 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.585785 Jul 30 21:25:08.956299 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2456/4958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:08 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:09.165604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:09.166224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:09.172708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:09.173172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:09.173970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:09.174419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:09.661851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:09.680051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eefd1213-b862-4582-a289-cf437ecabdd4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.518778 Jul 30 21:25:09.680660 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2457/4959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:09 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:09.739748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:25:09.741506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:25:09.744865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:25:09.747106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:25:09.747843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:25:09.769752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:09.770611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:09.771836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:09.774517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:09.803519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Getting quotas for project ce4d73e8180d4d08b9f5698ae767d325. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:25:09.830670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Getting quotas for user 1284634867a44f298cfc85cce91c5f58 and project ce4d73e8180d4d08b9f5698ae767d325. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:25:09.853198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:25:09.856576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:25:09.942348 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3e035cf-fd6b-4d72-ac09-dd8128a70023 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.289566 Jul 30 21:25:09.944998 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2503/4960] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:25:09.955731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:09.956361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:09.984104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:09.984744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:10.011223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:10.018681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:10.019600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:10.020083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:10.112837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:10.123269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:10.135831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:10.137274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c97c4325-195d-431e-8e89-e06bca1d4fed tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1258 microversion: 2.21 time: 0.185355 Jul 30 21:25:10.137885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2458/4961] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:09 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:10.544240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:10.559953 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb9f5d5f-7150-47c4-9119-7420ad0db4da tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.577558 Jul 30 21:25:10.560940 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2504/4962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:09 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:10.701183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:10.701833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:10.711382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b1fce4c0-a053-478a-8d21-1e906d81bc5f req-53a94649-fcce-470b-83c5-89431f69a514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0825b3da-7fd0-46cd-959c-5c13ae860adb", "name": "network-vif-plugged", "status": "completed", "tag": "8f88c0ac-5990-4c73-8fae-9a67f0098132"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:10.717666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:10.718158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:10.722663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:10.723670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:10.737164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b1fce4c0-a053-478a-8d21-1e906d81bc5f req-53a94649-fcce-470b-83c5-89431f69a514 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:10.738957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b1fce4c0-a053-478a-8d21-1e906d81bc5f req-53a94649-fcce-470b-83c5-89431f69a514 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:10.760701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b1fce4c0-a053-478a-8d21-1e906d81bc5f req-53a94649-fcce-470b-83c5-89431f69a514 service nova] Creating event network-vif-plugged:8f88c0ac-5990-4c73-8fae-9a67f0098132 for instance 0825b3da-7fd0-46cd-959c-5c13ae860adb on nch1-master-1 Jul 30 21:25:10.769603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b1fce4c0-a053-478a-8d21-1e906d81bc5f req-53a94649-fcce-470b-83c5-89431f69a514 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069195 Jul 30 21:25:10.771095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2505/4963] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:11.167740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:11.168992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:11.181824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:11.184643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:11.187389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:11.187923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:11.295958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:11.310518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:11.312237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:11.313882 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91abf6d2-c591-4fa0-863d-76902f6fb86a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1310 microversion: 2.21 time: 0.153744 Jul 30 21:25:11.332620 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2506/4964] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:11 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1310 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:11.584535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:11.585305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:11.605537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:11.606029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:11.606857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:11.607334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:11.744277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:11.757413 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4209720f-09f1-4898-90aa-a2bb7d976562 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 1.060038 Jul 30 21:25:11.778598 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2459/4965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:10 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:12.158173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:12.172492 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f12826a5-dded-4407-a389-40930bee135f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1368 microversion: 2.1 time: 0.592906 Jul 30 21:25:12.184043 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2507/4966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:11 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1368 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:12.339759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:12.340433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:12.357443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:12.357919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:12.358738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:12.359246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:12.641429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:12.652863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:12.655815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:12.657648 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88e2d812-becc-4004-827e-d486638971f6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1316 microversion: 2.21 time: 0.323241 Jul 30 21:25:12.674991 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2460/4967] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:12 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:12.784336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:12.785296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:12.802094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:12.804441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:12.805660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:12.811723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.193502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:13.201132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:13.201725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:13.211654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.214999 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf41e6e2-7966-4501-aa7e-36ba261172b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.429652 Jul 30 21:25:13.216391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.217732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.219319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2508/4968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:12 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:13.229755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.686063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:13.686849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:13.701475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.703828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.706513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.720128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:13.738805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.747315 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfb6d1e7-80ab-45c9-bab3-41290d3d5657 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1559 microversion: 2.1 time: 0.550730 Jul 30 21:25:13.752182 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2461/4969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:13 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1559 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:13.785861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:13.790195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:13.842843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.849802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:13.856629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:13.858526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:14.096665 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e614d890-e31f-403f-8ed0-b41d6e427d25 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319232 Jul 30 21:25:14.098078 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2462/4970] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:25:13 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-interface => generated 285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:14.242562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:14.244001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:14.268009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:14.268560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:14.269422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:14.269877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:14.648792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:14.664544 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f99f04e-a332-4d50-9d60-025f5b1d7c5d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.425696 Jul 30 21:25:14.665188 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2463/4971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:14 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:14.897922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:14.909411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:14.921367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:14.927325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b62c82f0-13a3-417f-ba7e-41051f85ed5c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 1.246106 Jul 30 21:25:14.931239 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2509/4972] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:13 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:15.689229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:15.690473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:15.758216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:15.758985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:15.777286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:15.778785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:15.955551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:15.957325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:15.971915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:15.976005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:15.977058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:15.979648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:16.469351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:16.535675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:16.541578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:16.546598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b4814a1-e2bf-4eca-8193-56fa53a8758b tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.593191 Jul 30 21:25:16.547903 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2510/4973] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:15 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:16.559355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-830daf4a-3bf9-4fa3-9bd5-37844eb32559 req-4164609f-f361-4d8f-94b8-d787aa766714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eda93f8-d7de-4d11-9632-9aeb8ad443da", "name": "network-vif-plugged", "status": "completed", "tag": "a9b44af9-319e-4e40-88b9-e53bd2c10632"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:16.577756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-830daf4a-3bf9-4fa3-9bd5-37844eb32559 req-4164609f-f361-4d8f-94b8-d787aa766714 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:16.578594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-830daf4a-3bf9-4fa3-9bd5-37844eb32559 req-4164609f-f361-4d8f-94b8-d787aa766714 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:16.597070 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-830daf4a-3bf9-4fa3-9bd5-37844eb32559 req-4164609f-f361-4d8f-94b8-d787aa766714 service nova] Creating event network-vif-plugged:a9b44af9-319e-4e40-88b9-e53bd2c10632 for instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da on nch2-master-1 Jul 30 21:25:16.612966 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-830daf4a-3bf9-4fa3-9bd5-37844eb32559 req-4164609f-f361-4d8f-94b8-d787aa766714 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055903 Jul 30 21:25:16.617806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2511/4974] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:16.672483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-93c83d72-6c60-4536-b6c2-160d81169c5b req-37e71a7b-7375-43bb-a9c9-a90ac74a2829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec28d1f-406c-4389-828f-b9f4fa78a6ac", "tag": "dd30e17b-3404-458a-933c-22cb5f8c2f95"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:16.703507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-93c83d72-6c60-4536-b6c2-160d81169c5b req-37e71a7b-7375-43bb-a9c9-a90ac74a2829 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:16.704075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-93c83d72-6c60-4536-b6c2-160d81169c5b req-37e71a7b-7375-43bb-a9c9-a90ac74a2829 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:16.722952 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-93c83d72-6c60-4536-b6c2-160d81169c5b req-37e71a7b-7375-43bb-a9c9-a90ac74a2829 service nova] Creating event network-changed:dd30e17b-3404-458a-933c-22cb5f8c2f95 for instance eec28d1f-406c-4389-828f-b9f4fa78a6ac on nch1-master-1 Jul 30 21:25:16.730909 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-93c83d72-6c60-4536-b6c2-160d81169c5b req-37e71a7b-7375-43bb-a9c9-a90ac74a2829 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095154 Jul 30 21:25:16.731840 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2512/4975] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:17.040428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:17.050082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-591ea910-454e-4bfb-a24e-93fe53f08c29 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 1.366488 Jul 30 21:25:17.051121 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2464/4976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:15 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:17.569849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:17.571211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:17.583361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:17.584092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:17.585597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:17.586216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:18.072757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:18.074010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:18.078766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:18.089964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:18.092836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:18.094778 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f8f0584c-a9aa-4d2d-8fec-a53247d34ef7 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.529222 Jul 30 21:25:18.096320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2513/4977] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:17 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:18.098597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:18.099150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:18.100035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:18.104559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:19.026316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:19.035028 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51f05c2a-f478-4def-ac89-3cb6e45bf38d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1315 microversion: 2.1 time: 0.967359 Jul 30 21:25:19.038609 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2465/4978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:18 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:19.121141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:19.121780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:19.134049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:19.134535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:19.147666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:19.150553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:19.179368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:19.497279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:19.508175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:19.510084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:19.514688 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c169d92-999f-4d27-b1f8-7fe5e5cd285c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.396414 Jul 30 21:25:19.517783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2514/4979] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:19 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:25:20.060780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:20.061421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:20.072267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.079929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.081073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.083250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.149447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:20.383827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d43906f0-475f-42dd-846f-447af8d3d2e9 req-e1ccce22-d35c-4e2a-b5fe-fc007bc095ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0825b3da-7fd0-46cd-959c-5c13ae860adb", "tag": "8f88c0ac-5990-4c73-8fae-9a67f0098132"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:20.404456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:20.405260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:20.408348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d43906f0-475f-42dd-846f-447af8d3d2e9 req-e1ccce22-d35c-4e2a-b5fe-fc007bc095ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.408781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d43906f0-475f-42dd-846f-447af8d3d2e9 req-e1ccce22-d35c-4e2a-b5fe-fc007bc095ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.436272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d43906f0-475f-42dd-846f-447af8d3d2e9 req-e1ccce22-d35c-4e2a-b5fe-fc007bc095ca service nova] Creating event network-changed:8f88c0ac-5990-4c73-8fae-9a67f0098132 for instance 0825b3da-7fd0-46cd-959c-5c13ae860adb on nch1-master-1 Jul 30 21:25:20.458514 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d43906f0-475f-42dd-846f-447af8d3d2e9 req-e1ccce22-d35c-4e2a-b5fe-fc007bc095ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079205 Jul 30 21:25:20.482132 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2515/4980] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:25:20.541353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:20.542143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:20.555382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.555822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.556637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.557097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.744253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:20.762666 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f7655ce-12ba-4f94-bca9-9525a0d44867 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1501 microversion: 2.1 time: 0.707718 Jul 30 21:25:20.766741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2466/4981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:20 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1501 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:20.801219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:20.802199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:20.822386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.822865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.823711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:20.829052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:20.998138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5813cdd4-f4dd-4334-942a-0f059422f266 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da/action" status: 202 len: 0 microversion: 2.1 time: 0.208340 Jul 30 21:25:21.001806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2467/4982] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:25:20 2022] POST /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:25:21.007968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:21.008696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:21.029763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:21.030486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:21.031574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:21.032293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:21.184793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:21.211461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:21.215488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:21.218293 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42aace27-25f3-44b6-9752-5a17447db99c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.683731 Jul 30 21:25:21.221640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2516/4983] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:20 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:21.731337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:21.741271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8a82365-c296-4765-8f7b-bb726189ba47 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1506 microversion: 2.1 time: 0.736961 Jul 30 21:25:21.751690 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2468/4984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:21 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:22.243363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:22.244010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:22.251935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:22.253366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:22.254428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:22.255119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:22.764892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:22.765504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:22.783002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:22.783500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:22.784311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:22.784953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:23.138987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:23.182811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:23.182987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:23.184824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:23.186352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8c012822-4895-4870-9e55-01428b8cfcd9 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.947139 Jul 30 21:25:23.193892 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23f735c6-baa2-445f-8b40-9984325d5390 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1486 microversion: 2.1 time: 0.432797 Jul 30 21:25:23.195243 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2469/4985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:22 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1486 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:23.195424 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2517/4986] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:22 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:23.235838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:23.236476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:23.247801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:23.251039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:23.252137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:23.253922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:23.317949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lazy-loading 'flavor' on Instance uuid 9eda93f8-d7de-4d11-9632-9aeb8ad443da {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:25:23.654756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71048c7e-ec38-404b-b095-cd53d5863947 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da/action" status: 202 len: 0 microversion: 2.1 time: 0.431178 Jul 30 21:25:23.656220 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2518/4987] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:25:23 2022] POST /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:25:23.666113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:23.666851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:23.676471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:23.677215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:23.678377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:23.679113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:24.192382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:24.202202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8709b5a-a060-4e31-87ed-396c9d6c05cc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1492 microversion: 2.1 time: 0.541386 Jul 30 21:25:24.203648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2470/4988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:23 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1492 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:24.237658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:24.238385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:24.251743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:24.252584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:24.253254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:24.253704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:25.225882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:25.226515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:25.242246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:25.247925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:25.248965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:25.249441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:25.401904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:25.446309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:25.448447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:25.452769 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cab30b9f-d863-4501-8ae6-1a8129ad6ddf tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 1.220577 Jul 30 21:25:25.456137 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2519/4989] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:24 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:25.943034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:25.952994 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ad47809-9381-47cf-9498-4551af687102 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1513 microversion: 2.1 time: 0.732182 Jul 30 21:25:25.953952 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2471/4990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:25 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1513 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:26.476313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:26.476941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:26.482622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:26.494139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:26.494610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:26.500462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:26.501159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:26.979348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:26.980750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:26.993285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:26.995831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:26.997518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:26.999877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:27.012709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:27.020218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:27.029133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:27.030723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:27.032000 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ff6ac66-54ad-4862-8077-a2df09de573f tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.560290 Jul 30 21:25:27.032577 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2520/4991] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:26 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:28.058327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:28.059724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:28.066892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:28.087501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:28.088511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:28.089052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:28.204492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:28.217575 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8d1354a0-8d0a-4f83-a69d-975d3b5e9e66 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.241106 Jul 30 21:25:28.219716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2472/4992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:26 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:28.236671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-65689f15-72ab-42a2-aef0-33fcdaf8b12c req-ba89cae8-12e4-413c-b711-07c2858749d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec28d1f-406c-4389-828f-b9f4fa78a6ac", "name": "network-vif-plugged", "status": "completed", "tag": "dd30e17b-3404-458a-933c-22cb5f8c2f95"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:28.256972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=50 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:28.262328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-65689f15-72ab-42a2-aef0-33fcdaf8b12c req-ba89cae8-12e4-413c-b711-07c2858749d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:28.274471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-65689f15-72ab-42a2-aef0-33fcdaf8b12c req-ba89cae8-12e4-413c-b711-07c2858749d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:28.303184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-65689f15-72ab-42a2-aef0-33fcdaf8b12c req-ba89cae8-12e4-413c-b711-07c2858749d3 service nova] Creating event network-vif-plugged:dd30e17b-3404-458a-933c-22cb5f8c2f95 for instance eec28d1f-406c-4389-828f-b9f4fa78a6ac on nch1-master-1 Jul 30 21:25:28.317552 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-65689f15-72ab-42a2-aef0-33fcdaf8b12c req-ba89cae8-12e4-413c-b711-07c2858749d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093318 Jul 30 21:25:28.321312 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2473/4993] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:28.432197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:28.452746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:28.461275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:28.463812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37aad168-3ade-434b-9424-a1c95132ca7c tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.412358 Jul 30 21:25:28.467446 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2521/4994] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:28 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:29.245449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:29.246862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:29.271615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:29.273140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:29.274234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:29.276420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:29.492536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:29.494533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:29.507502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:29.508532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:29.510089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:29.512053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:29.512779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:29.524974 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7c116a9-7021-4778-b88b-abfdcad90831 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.284595 Jul 30 21:25:29.527451 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2474/4995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:29 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:30.235209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:30.256924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:30.261206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:30.264805 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-260246bf-890a-412d-9500-89542b47ec6a tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1358 microversion: 2.21 time: 0.778463 Jul 30 21:25:30.267149 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2522/4996] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:29 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1358 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:30.550227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:30.550867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:30.598330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:30.599105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:30.600660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:30.601288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:31.294470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:31.295091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:31.321718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:31.322423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:31.323443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:31.324151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:31.586217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:31.609422 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee65a7e2-2c8e-4019-ab65-c391b2f04c33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.063493 Jul 30 21:25:31.610236 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2475/4997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:30 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:31.667104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:31.678551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:31.680464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:31.689336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1311d72-f0e8-4ef7-a856-7dfb0968d7cd tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1550 microversion: 2.21 time: 0.402686 Jul 30 21:25:31.690441 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2523/4998] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:31 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1550 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:31.717756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:31.718539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:31.737336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:31.738341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:31.739363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:31.740031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:31.797641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:25:31.988286 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ea45d00-4f86-4d89-b39b-41c3c133b1a6 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 204 len: 0 microversion: 2.21 time: 0.274084 Jul 30 21:25:31.994622 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2476/4999] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:25:31 2022] DELETE /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:25:32.003114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:32.011165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:32.034605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:32.035714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:32.036936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:32.037728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:32.403852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:32.416600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:32.418986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:32.427019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe2afb91-c539-46a7-8c25-e78e180eb281 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1556 microversion: 2.21 time: 0.427256 Jul 30 21:25:32.445384 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2524/5000] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:31 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1556 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:32.633593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:32.636593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:32.654152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:32.659764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:32.663795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:32.665256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:33.451850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:33.452647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:33.476562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:33.477832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:33.485539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:33.490929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:33.527972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:33.570587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e258a3a-9520-4c85-bf80-351764b39150 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.942301 Jul 30 21:25:33.575519 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2477/5001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:32 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:33.592872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-db6c9eec-c654-4daf-82f7-b508522ab1c5 req-3c452f0b-a98a-49da-890a-297724802cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eda93f8-d7de-4d11-9632-9aeb8ad443da", "name": "network-vif-plugged", "status": "completed", "tag": "a9b44af9-319e-4e40-88b9-e53bd2c10632"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:33.632041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-db6c9eec-c654-4daf-82f7-b508522ab1c5 req-3c452f0b-a98a-49da-890a-297724802cd8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:33.633844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-db6c9eec-c654-4daf-82f7-b508522ab1c5 req-3c452f0b-a98a-49da-890a-297724802cd8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:33.703365 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-db6c9eec-c654-4daf-82f7-b508522ab1c5 req-3c452f0b-a98a-49da-890a-297724802cd8 service nova] Creating event network-vif-plugged:a9b44af9-319e-4e40-88b9-e53bd2c10632 for instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da on nch2-master-1 Jul 30 21:25:33.733466 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-db6c9eec-c654-4daf-82f7-b508522ab1c5 req-3c452f0b-a98a-49da-890a-297724802cd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153272 Jul 30 21:25:33.739221 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2478/5002] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:34.426314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:34.443658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:34.448034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:34.449551 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7b697b6-1d71-4386-8240-a700927c1c32 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1556 microversion: 2.21 time: 1.001893 Jul 30 21:25:34.451990 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2525/5003] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:33 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1556 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:25:34.594733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:34.595806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:34.609871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:34.616599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:34.620617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:34.624467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:35.475481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:35.476972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:35.506803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:35.506803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:35.506803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:35.506803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:35.633850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:35.674143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fceff654-0366-4978-9717-43f82e248ebf tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.081993 Jul 30 21:25:35.680358 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2479/5004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:34 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:35.703560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e1b2ed20-7ba5-4766-8c03-e4829e6b9185 req-c13ae43b-7c3e-4555-9d7e-19705fae535f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec28d1f-406c-4389-828f-b9f4fa78a6ac", "name": "network-vif-deleted", "tag": "dd30e17b-3404-458a-933c-22cb5f8c2f95"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:35.799916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e1b2ed20-7ba5-4766-8c03-e4829e6b9185 req-c13ae43b-7c3e-4555-9d7e-19705fae535f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:35.801384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e1b2ed20-7ba5-4766-8c03-e4829e6b9185 req-c13ae43b-7c3e-4555-9d7e-19705fae535f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:35.827941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e1b2ed20-7ba5-4766-8c03-e4829e6b9185 req-c13ae43b-7c3e-4555-9d7e-19705fae535f service nova] Creating event network-vif-deleted:dd30e17b-3404-458a-933c-22cb5f8c2f95 for instance eec28d1f-406c-4389-828f-b9f4fa78a6ac on nch1-master-1 Jul 30 21:25:35.872359 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e1b2ed20-7ba5-4766-8c03-e4829e6b9185 req-c13ae43b-7c3e-4555-9d7e-19705fae535f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181878 Jul 30 21:25:35.874694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:35.879584 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2480/5005] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:35.885991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:35.892823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1284634867a44f298cfc85cce91c5f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4d73e8180d4d08b9f5698ae767d325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:35.901708 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69d15c5a-98a6-407b-a65c-7f87eec527fb tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 200 len: 1514 microversion: 2.21 time: 0.431401 Jul 30 21:25:35.902616 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2526/5006] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:35 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:25:36.705052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:36.706908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:36.717836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:36.719389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:36.720459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:36.721375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:36.926016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:36.928144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:36.954494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:36.967687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:36.972194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:36.973916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.004963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] HTTP exception thrown: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Request method failure captured: Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac HTTP/1.1 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aGzUb0kdvME9cxera5BsD8CCiRxu19iF0hWcb1L_2VkbYM5lp_It66UB6s6QHhztPKux-3G3WhdkQPIVTlQfbNKemVS4DlSCTTtuAUIq6iXt7bvZWY9TjDsh9zL6HN2xlt-bPC4SBps4T5EphjnRMNdtDBC9_bhSE9u6NCDiJ4nbq4 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.21 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ce4d73e8180d4d08b9f5698ae767d325", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 1284634867a44f298cfc85cce91c5f58 Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'eec28d1f-406c-4389-828f-b9f4fa78a6ac'} Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.006764 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Returning 404 to user: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:25:37.012431 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eb32b2b7-4ecf-4f4d-9e31-881bf6e4b2c0 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 404 len: 111 microversion: 2.21 time: 0.087099 Jul 30 21:25:37.019476 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2527/5007] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:36 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 30 21:25:37.025207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '.version_select at 0x7fbb5d3c3d30>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:37.025805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:37.044507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.045044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.045692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.046137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.230436 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d62e7793-5fe5-4eaa-b6fd-3111cdd41745 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.209568 Jul 30 21:25:37.239967 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2528/5008] 10.222.0.17 () {60 vars in 1337 bytes} [Sat Jul 30 21:25:37 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac/os-instance-actions => generated 611 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:25:37.245220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:37.245743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:37.268786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.269242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.270041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.270499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.307580 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] HTTP exception thrown: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Request method failure captured: Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac HTTP/1.1 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aGzUb0kdvME9cxera5BsD8CCiRxu19iF0hWcb1L_2VkbYM5lp_It66UB6s6QHhztPKux-3G3WhdkQPIVTlQfbNKemVS4DlSCTTtuAUIq6iXt7bvZWY9TjDsh9zL6HN2xlt-bPC4SBps4T5EphjnRMNdtDBC9_bhSE9u6NCDiJ4nbq4 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.21 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ce4d73e8180d4d08b9f5698ae767d325", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 1284634867a44f298cfc85cce91c5f58 Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'eec28d1f-406c-4389-828f-b9f4fa78a6ac'} Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:25:37.321262 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.326229 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.328444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Returning 404 to user: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:25:37.329520 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1e9172d-62cf-4801-83c2-955fce1a6d08 tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 404 len: 111 microversion: 2.21 time: 0.088351 Jul 30 21:25:37.334489 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2529/5009] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:25:37 2022] DELETE /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:25:37.339647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:37.340484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] [instance: eec28d1f-406c-4389-828f-b9f4fa78a6ac] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:37.356523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.357282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.358260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:37.358875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:37.404532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] HTTP exception thrown: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Request method failure captured: Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac HTTP/1.1 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aGzUb0kdvME9cxera5BsD8CCiRxu19iF0hWcb1L_2VkbYM5lp_It66UB6s6QHhztPKux-3G3WhdkQPIVTlQfbNKemVS4DlSCTTtuAUIq6iXt7bvZWY9TjDsh9zL6HN2xlt-bPC4SBps4T5EphjnRMNdtDBC9_bhSE9u6NCDiJ4nbq4 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.21 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ce4d73e8180d4d08b9f5698ae767d325", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce4d73e8180d4d08b9f5698ae767d325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ce4d73e8180d4d08b9f5698ae767d325 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-75028364 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 1284634867a44f298cfc85cce91c5f58 Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-InstanceActionsV221TestJSON-75028364-project Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'eec28d1f-406c-4389-828f-b9f4fa78a6ac'} Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.406086 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] Returning 404 to user: Instance eec28d1f-406c-4389-828f-b9f4fa78a6ac could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28821946-9f80-4a60-961a-efa4f41b4cee tempest-InstanceActionsV221TestJSON-75028364 tempest-InstanceActionsV221TestJSON-75028364-project] 10.222.0.17 "GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac" status: 404 len: 111 microversion: 2.21 time: 0.072451 Jul 30 21:25:37.415431 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2530/5010] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:25:37 2022] GET /compute/v2.1/servers/eec28d1f-406c-4389-828f-b9f4fa78a6ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:25:37.719764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:37.738130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-46569711-cd57-4d57-aa04-56f17b951f79 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.040594 Jul 30 21:25:37.738655 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2481/5011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:36 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:38.763809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:38.764377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:38.776940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:38.787580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:38.791474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:38.794614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:38.867786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:39.930469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:39.946366 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70282277-f741-4c33-94c9-6e09684089eb tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.187150 Jul 30 21:25:39.948866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2531/5012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:38 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:40.970013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:40.970646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:40.989851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:40.990250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:40.991072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:40.991559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:42.119271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:42.138543 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c590af97-0d72-45e2-b0b5-0c8362a9f2e0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.172537 Jul 30 21:25:42.139157 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2482/5013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:40 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:43.162801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:43.173210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:43.194518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:43.204102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:43.206991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:43.207666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:43.751166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:43.769353 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28e44ad2-2c49-40c3-b53a-29225d1d42e8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.611080 Jul 30 21:25:43.773605 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2532/5014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:43 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:44.796723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:44.798389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:44.811846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:44.820113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:44.821262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:44.821729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:45.266367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:45.275704 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd7a42d5-1edc-4c61-b296-21c2e257a2b2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.483093 Jul 30 21:25:45.276318 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2483/5015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:44 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:46.299783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:46.300457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:46.317332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:46.317875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:46.318679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:46.319124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:47.291163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:47.302652 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e92f35c3-4a6a-471d-9db8-efade09fb560 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.006270 Jul 30 21:25:47.325875 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2533/5016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:46 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:48.138610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:48.139165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:48.159353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:48.161376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:48.166538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:48.168976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:48.269374 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94108088-41db-4617-8b31-f216a9cfb249 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/ips" status: 200 len: 151 microversion: 2.1 time: 0.516793 Jul 30 21:25:48.271106 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2484/5017] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:25:47 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/ips => generated 151 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:48.328323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:48.328968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:48.356277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:48.360135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:48.361701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:48.363344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:49.596947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:49.618236 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0929b67f-4e9e-4250-86b3-e78d5878fbab tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 1.289286 Jul 30 21:25:49.619010 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2534/5018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:48 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:50.096931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:50.100154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:50.123013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:50.134485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:50.137064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:50.139921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:50.640309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "POST /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547526 Jul 30 21:25:50.641847 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2485/5019] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:25:50 2022] POST /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:50.643177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:50.643898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:50.653987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:50.654495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:50.655316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:50.655779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:51.318066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:51.343398 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82b94885-e343-43a5-bdee-3b0b7f985c2b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.702074 Jul 30 21:25:51.345893 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2535/5020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:50 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:25:52.369229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:52.369959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:52.404482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:52.412543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:52.420139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:52.420627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:53.216138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:53.253415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d83df5c5-4dd0-46bf-a858-ec5c98633993 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1508 microversion: 2.1 time: 0.889495 Jul 30 21:25:53.254035 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2486/5021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:52 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1508 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:54.278643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:54.279360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:54.290037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.292261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.296479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.296977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.428540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:54.429666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:54.444432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.445202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.447067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.449768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.623551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lazy-loading 'services' on Instance uuid 0825b3da-7fd0-46cd-959c-5c13ae860adb {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:25:54.669078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:54.766903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:54.775643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f637a61-52da-4a59-996a-f65f0ba79e19 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1505 microversion: 2.1 time: 0.501155 Jul 30 21:25:54.779057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2536/5022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:54 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:54.833761 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments/7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4" status: 202 len: 0 microversion: 2.1 time: 0.411564 Jul 30 21:25:54.834703 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2487/5023] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:25:54 2022] DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments/7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:25:54.843721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:54.846168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:54.855330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.857291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.858660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:54.859670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:54.923267 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ca4f4a8f-e685-476e-9b3d-cb178f4c23f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084171 Jul 30 21:25:54.947492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2537/5024] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:25:54 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:55.804827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:55.805743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:55.821273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:55.821762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:55.822864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:55.823176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:55.943090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:55.946050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:55.962382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:55.965949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:55.971706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:55.972812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:56.022705 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0479dcaf-d3f1-4fb1-b2c1-b579e2addace tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089137 Jul 30 21:25:56.023779 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2538/5025] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:25:55 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:25:56.127933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:56.128465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:56.139942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:56.140759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:56.141746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:56.143042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:56.247434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:25:56.377481 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61f128e7-c3af-4a76-9f15-2972b4138e8b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 204 len: 0 microversion: 2.1 time: 0.253265 Jul 30 21:25:56.382830 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2539/5026] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:25:56 2022] DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:25:56.389528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:56.390368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:56.400133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:56.400662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:56.401560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:56.403403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:56.647683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:56.657799 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-204732cb-9b79-4736-85c5-65ba56b49cd3 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1684 microversion: 2.1 time: 0.273327 Jul 30 21:25:56.667665 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2540/5027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:56 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1684 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:56.688045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:56.704381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2de5cd6a-ca28-468f-be73-8c7a10b32d7f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1505 microversion: 2.1 time: 0.905662 Jul 30 21:25:56.704994 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2488/5028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:55 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:56.948913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fcd4d9cf-44e7-4e3d-9970-203cd19f8888 req-4cdf5591-aa29-4b8b-8818-f0c489c53a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eda93f8-d7de-4d11-9632-9aeb8ad443da", "name": "network-vif-unplugged", "status": "completed", "tag": "a9b44af9-319e-4e40-88b9-e53bd2c10632"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:25:56.955461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:56.986216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fcd4d9cf-44e7-4e3d-9970-203cd19f8888 req-4cdf5591-aa29-4b8b-8818-f0c489c53a2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:56.987708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fcd4d9cf-44e7-4e3d-9970-203cd19f8888 req-4cdf5591-aa29-4b8b-8818-f0c489c53a2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:57.032859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fcd4d9cf-44e7-4e3d-9970-203cd19f8888 req-4cdf5591-aa29-4b8b-8818-f0c489c53a2f service nova] Creating event network-vif-unplugged:a9b44af9-319e-4e40-88b9-e53bd2c10632 for instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da on nch2-master-1 Jul 30 21:25:57.053154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fcd4d9cf-44e7-4e3d-9970-203cd19f8888 req-4cdf5591-aa29-4b8b-8818-f0c489c53a2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109051 Jul 30 21:25:57.060686 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2541/5029] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:25:57.690326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:57.691128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:57.703335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:57.709921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:57.713073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:57.713551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:57.729964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:57.731246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:57.745823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:57.746650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:57.749331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:57.750154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:58.290063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:58.300919 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-872f1f78-f6cf-4732-8de0-cc2090e15a6f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1684 microversion: 2.1 time: 0.618480 Jul 30 21:25:58.303514 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2489/5030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:57 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1684 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:59.066490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:59.100085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abd27fad-79e4-47ee-9bed-5c3902f17f0d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1505 microversion: 2.1 time: 1.374325 Jul 30 21:25:59.102950 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2542/5031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:57 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1505 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:25:59.328164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:25:59.333404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:25:59.345254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:59.350406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:59.351475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:59.352831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:25:59.354155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:25:59.588736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:25:59.598979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-96fba1f8-cd36-432f-8368-adfc34494890 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1684 microversion: 2.1 time: 0.277814 Jul 30 21:25:59.626501 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2490/5032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:25:59 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1684 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:00.142608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:00.143419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:00.167673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:00.167803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:00.172369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:00.174951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:00.623850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:00.625142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:00.635621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:00.636287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:00.637506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:00.641871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:00.884293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:00.897423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1836181-04a8-4a6b-9c30-17a4f439dba2 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1684 microversion: 2.1 time: 0.277521 Jul 30 21:26:00.898020 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2491/5033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:00 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1684 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:01.069099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:01.086491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80dfc2e4-e368-42c1-8b43-4243f35a3e4a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 200 len: 1448 microversion: 2.1 time: 0.953650 Jul 30 21:26:01.087326 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2543/5034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:00 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 1448 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:01.114184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:01.115647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:01.125845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.134679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:01.135942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.136503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:01.453354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:01.464882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6a01650f-fde0-4b79-a42a-eabb68e931ad tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.355258 Jul 30 21:26:01.468718 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2492/5035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:01 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:01.498579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:01.499837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:01.513697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.516061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:01.517099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.525987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:01.923155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:01.925440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:01.935695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.936172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:01.936958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:01.937406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:02.037577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:02.074691 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b89d6e2-4b08-4918-8b68-6b0ac778eb4d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1616 microversion: 2.1 time: 0.154357 Jul 30 21:26:02.077851 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2493/5036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:01 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1616 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:26:02.619513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:02.631869 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9665423a-6a63-443f-a65e-2c74a0611713 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.135193 Jul 30 21:26:02.633667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2544/5037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:01 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:02.653963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:02.654849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:02.664732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:02.665212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:02.666032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:02.666494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.087139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:03.110851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:03.113074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:03.131396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.132257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.132423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fecd63a8-41e7-4fc1-a9e8-9e91577fc21f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.482429 Jul 30 21:26:03.133597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.134305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.148065 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2494/5038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:02 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:03.157959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:03.158859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:03.166317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.167171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.168194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.168831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.428525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6896ccb6369541d5a552f3373f39c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5850a54af6204e2f83d8e61141a04013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:03.470373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c845d83e-3a7a-4db0-9d10-b40738c18740 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 200 len: 1616 microversion: 2.1 time: 0.367114 Jul 30 21:26:03.474151 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2545/5039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:03 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 1616 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:03.495177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4db89edb-6e3a-40ed-b069-9a909fa72300 req-3d58d2b0-eadb-4675-8e20-d818a5f63556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0825b3da-7fd0-46cd-959c-5c13ae860adb", "name": "network-vif-deleted", "tag": "8f88c0ac-5990-4c73-8fae-9a67f0098132"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:03.514403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4db89edb-6e3a-40ed-b069-9a909fa72300 req-3d58d2b0-eadb-4675-8e20-d818a5f63556 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.514871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4db89edb-6e3a-40ed-b069-9a909fa72300 req-3d58d2b0-eadb-4675-8e20-d818a5f63556 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.541836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4db89edb-6e3a-40ed-b069-9a909fa72300 req-3d58d2b0-eadb-4675-8e20-d818a5f63556 service nova] Creating event network-vif-deleted:8f88c0ac-5990-4c73-8fae-9a67f0098132 for instance 0825b3da-7fd0-46cd-959c-5c13ae860adb on nch1-master-1 Jul 30 21:26:03.556471 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4db89edb-6e3a-40ed-b069-9a909fa72300 req-3d58d2b0-eadb-4675-8e20-d818a5f63556 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072921 Jul 30 21:26:03.557550 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2546/5040] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:26:03.620096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:03.632749 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-24b5b7b1-9449-48d9-8d1c-64bdd0c0508a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.478581 Jul 30 21:26:03.633475 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2495/5041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:03 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:03.656113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb82a62e-002e-4cf1-a525-9b32dd8690c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:03.671236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb82a62e-002e-4cf1-a525-9b32dd8690c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.673282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb82a62e-002e-4cf1-a525-9b32dd8690c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.734831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb82a62e-002e-4cf1-a525-9b32dd8690c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Going to try to stop instance {{(pid=130984) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:26:03.786567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:03.825508 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb82a62e-002e-4cf1-a525-9b32dd8690c4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.173736 Jul 30 21:26:03.843368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:03.844954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:03.854478 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2547/5042] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:26:03 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:26:03.872613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.880317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:03.884749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:03.885960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:04.507380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:04.517917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:04.525120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:04.529466 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fea4dfce-894c-4f4f-aaa2-15ddf1aedf37 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.697794 Jul 30 21:26:04.546218 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2496/5043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:03 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:04.552394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:04.553105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:04.554091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:04.554717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:04.570126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb HTTP/1.1 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0825b3da-7fd0-46cd-959c-5c13ae860adb'} Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:04.572188 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:04.577889 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:04.580119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:04.581899 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d161a68c-1a9a-426a-a00b-a96bc211301b tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 404 len: 111 microversion: 2.1 time: 0.084322 Jul 30 21:26:04.583017 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2548/5044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:04 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:04.591757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a86011bd-24c3-441b-a262-96a801b5336d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '.version_select at 0x7fbb5cfb1700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:04.634332 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a86011bd-24c3-441b-a262-96a801b5336d tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140816002" status: 202 len: 0 microversion: 2.1 time: 0.046880 Jul 30 21:26:04.635392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2497/5045] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140816002 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:26:05.557292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:05.558100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:05.570730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:05.571204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:05.572058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:05.572517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:06.623993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:06.643507 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b3a3a2d-c727-46ae-9b4d-e1cbabc8c21b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 1.091339 Jul 30 21:26:06.649530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2549/5046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:05 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:07.677954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:07.679451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:07.693257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:07.694091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:07.705816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:07.706642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:08.341433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:08.356050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69f83a64-bb02-48d3-9c1b-201dab147631 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.683539 Jul 30 21:26:08.356735 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2498/5047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:07 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:09.386087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:09.386740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:09.411108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.411778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.412943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.413632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.570826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:09.572028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:09.581602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.582289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.585170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.585836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.619442 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb HTTP/1.1 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0825b3da-7fd0-46cd-959c-5c13ae860adb'} Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:09.624566 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.630353 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.633663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:09.637217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-698aec61-d678-439f-85ee-105f162c4737 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 404 len: 111 microversion: 2.1 time: 0.075677 Jul 30 21:26:09.638004 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2499/5048] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:09 2022] DELETE /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:26:09.649932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:09.652931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0825b3da-7fd0-46cd-959c-5c13ae860adb] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:09.666680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.673846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.674724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:09.675187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:09.702644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb HTTP/1.1 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0825b3da-7fd0-46cd-959c-5c13ae860adb'} Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:09.707628 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. Jul 30 21:26:09.712803 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:09.715421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0825b3da-7fd0-46cd-959c-5c13ae860adb could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:09.717780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b9b0478-42c2-403a-9ab6-02dcfe07181a tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb" status: 404 len: 111 microversion: 2.1 time: 0.074199 Jul 30 21:26:09.735487 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2500/5049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:09 2022] GET /compute/v2.1/servers/0825b3da-7fd0-46cd-959c-5c13ae860adb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:10.269187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:10.284707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f4953b6-7026-464e-9fe1-bc6b60150d3a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.902513 Jul 30 21:26:10.285666 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2550/5050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:09 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:10.991378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:10.991899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:11.001839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.007956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.009112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.009572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.055615 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 HTTP/1.1 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c26b1696-dd46-42b3-b3cb-fc676de68d31'} Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:11.057877 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.064230 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.072699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:11.074779 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8c025fbb-8528-4f7c-807e-6ecf8a033d8f tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 404 len: 111 microversion: 2.1 time: 0.087933 Jul 30 21:26:11.076153 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2501/5051] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:10 2022] DELETE /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:11.085240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:11.085861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: c26b1696-dd46-42b3-b3cb-fc676de68d31] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:11.104812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.105590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.106571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.107200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.134743 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 HTTP/1.1 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'c26b1696-dd46-42b3-b3cb-fc676de68d31'} Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.144354 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. Jul 30 21:26:11.149549 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.153410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance c26b1696-dd46-42b3-b3cb-fc676de68d31 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:11.159734 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18764b44-5fd4-4407-98c2-c6e87d61abf5 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31" status: 404 len: 111 microversion: 2.1 time: 0.074147 Jul 30 21:26:11.161109 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2551/5052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:11 2022] GET /compute/v2.1/servers/c26b1696-dd46-42b3-b3cb-fc676de68d31 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:11.171444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:11.171880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:11.180412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.181346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.182450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.183361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.205648 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 HTTP/1.1 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '75379208-09c6-4e01-aeda-2b121b343517'} Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:11.208177 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34886563-6e03-4881-9ded-1a887d13a7f1 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 404 len: 111 microversion: 2.1 time: 0.045268 Jul 30 21:26:11.212510 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2502/5053] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:11 2022] DELETE /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:11.222236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:11.223184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 75379208-09c6-4e01-aeda-2b121b343517] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:11.241008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.241786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.242824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.243605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.277340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 HTTP/1.1 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '75379208-09c6-4e01-aeda-2b121b343517'} Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:11.279363 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. Jul 30 21:26:11.284423 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:11.290754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 75379208-09c6-4e01-aeda-2b121b343517 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:11.291972 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5a31c364-d553-4142-abd8-18f94e8e3313 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517" status: 404 len: 111 microversion: 2.1 time: 0.074409 Jul 30 21:26:11.293088 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2552/5054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:11 2022] GET /compute/v2.1/servers/75379208-09c6-4e01-aeda-2b121b343517 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:11.322446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:11.323479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:11.349515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.350313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.354815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:11.355907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:11.828917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:11.838376 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e3f99ad0-584c-4ccd-9a2c-0134bf66f60f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 0.529037 Jul 30 21:26:11.852507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2503/5055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:11 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:12.595136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:12.596445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:12.605608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.606534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:12.607614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.608295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:12.634474 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 HTTP/1.1 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0fa909cf-9974-49fe-9b0e-285825175258'} Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:12.637893 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.642653 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.650267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:12.651399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-eec354c7-8442-48a0-8a40-d743c5826584 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 404 len: 111 microversion: 2.1 time: 0.060569 Jul 30 21:26:12.652482 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2553/5056] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:12 2022] DELETE /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:12.662654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:12.663324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] [instance: 0fa909cf-9974-49fe-9b0e-285825175258] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:12.678286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.678791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:12.679816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.680280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:12.718758 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] HTTP exception thrown: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Request method failure captured: Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 HTTP/1.1 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aCn5gPamYCz_GdnJMh1cxlxluY-Q7xDeOtkyMlUpcfe02v21Ju_shIOYVp4lUSXayFMFRPZ2vYMKiPgC_Jl0NGVLzknsGgj-uhE5I64JhGuImvq14xMu02jG14YX0km4YO4-tv06xdfd_6y6hYN7zQrPVNTdx1JvjoW9BSK5wZZ4Uo Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5850a54af6204e2f83d8e61141a04013", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5850a54af6204e2f83d8e61141a04013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5850a54af6204e2f83d8e61141a04013 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386881426 Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 6896ccb6369541d5a552f3373f39c64d Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeNegativeTest-1386881426-project Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0fa909cf-9974-49fe-9b0e-285825175258'} Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:12.721452 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] Returning 404 to user: Instance 0fa909cf-9974-49fe-9b0e-285825175258 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6660ab97-399e-4253-a44c-0832f3cdf306 tempest-AttachVolumeNegativeTest-1386881426 tempest-AttachVolumeNegativeTest-1386881426-project] 10.222.0.17 "GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258" status: 404 len: 111 microversion: 2.1 time: 0.066251 Jul 30 21:26:12.729888 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2504/5057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:12 2022] GET /compute/v2.1/servers/0fa909cf-9974-49fe-9b0e-285825175258 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:26:12.880667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:12.881426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:12.896057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.896740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:12.897625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:12.899812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:14.402671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:14.420489 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-901281da-acbe-47bb-9aaf-d3079ff9b072 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1677 microversion: 2.1 time: 1.541756 Jul 30 21:26:14.424037 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2554/5058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:12 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1677 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:15.447123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:15.448539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:15.468641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:15.469506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:15.470541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:15.473533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:16.668087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:16.685943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-62aab70e-70a5-43d8-bc57-6ed9f32ec7bc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1654 microversion: 2.1 time: 1.244486 Jul 30 21:26:16.687650 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2505/5059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:15 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1654 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:16.709327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b2d105e4-46bf-4273-a673-f60e2eae9245 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:16.726829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2d105e4-46bf-4273-a673-f60e2eae9245 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:16.731265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b2d105e4-46bf-4273-a673-f60e2eae9245 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:16.776679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b2d105e4-46bf-4273-a673-f60e2eae9245 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Going to try to start instance {{(pid=130984) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:26:16.893257 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b2d105e4-46bf-4273-a673-f60e2eae9245 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.189629 Jul 30 21:26:16.894353 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2555/5060] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:26:16 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:26:16.904549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:16.905781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:16.916476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:16.919319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:16.920836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:16.924410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:18.079588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:18.100612 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2024e503-249b-4ac9-a333-558dce70fe1c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1663 microversion: 2.1 time: 1.201881 Jul 30 21:26:18.102042 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2506/5061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:16 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1663 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:19.124053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:19.125477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:19.133391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:19.134154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:19.135069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:19.135748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:19.623023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:19.646811 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7ab2e10-d7cc-48c7-ba98-16f1808e1078 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1663 microversion: 2.1 time: 0.528136 Jul 30 21:26:19.663469 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2556/5062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:19 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1663 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:20.669534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:20.670792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:20.678817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:20.680012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:20.681646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:20.682270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:21.716714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:21.728461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6ab65342-83a0-4ffd-8d6a-9278bc64b994 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1663 microversion: 2.1 time: 1.063218 Jul 30 21:26:21.729616 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2507/5063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:20 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1663 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:22.751689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:22.752730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:22.767895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:22.780274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:22.783024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:22.783947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:23.162472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:23.178222 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6762faf5-7464-4041-a315-fa0cfa155348 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.428125 Jul 30 21:26:23.188911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2557/5064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:22 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:23.202315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:23.203554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:23.212461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:23.212969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:23.213771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:23.214233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:23.255476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:24.088869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:24.102126 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a77e5c4-c242-4090-b65d-7a2ffaae69fc tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.903769 Jul 30 21:26:24.103866 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2508/5065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:23 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:24.137501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:24.138858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:24.162352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:24.165797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:24.166986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:24.167651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:24.840789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:24.877414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ecae093-f070-4fb0-b49a-51553697d7a6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.743941 Jul 30 21:26:24.882070 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2558/5066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:24 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:24.904912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:24.906200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:24.922571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:24.923742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:24.924915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:24.927498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:25.989456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:26.067620 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0440e1f8-1a4c-4426-8c5a-34b43b092c22 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.161369 Jul 30 21:26:26.072172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2509/5067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:24 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:26.095013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:26.096383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:26.110716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:26.113153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:26.114469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:26.115144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:26.930747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:26.941797 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b9f612c-d3b9-4244-9865-64eb14ab9826 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.851990 Jul 30 21:26:26.942394 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2559/5068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:26 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:26.963100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:26.963930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:26.970511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:26.970872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:26.972495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:26.972890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:27.018343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lazy-loading 'flavor' on Instance uuid 4b930d1a-368c-43db-a27d-b93bdaa392ad {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:26:27.136411 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a75e5164-0248-4721-9ba5-4d4fbf1c299b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.173945 Jul 30 21:26:27.136411 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2510/5069] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:26:26 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:26:27.141656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:27.142282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:27.145205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=38 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:27.152614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:27.153151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:27.153956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:27.154534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:27.892405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:27.905496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a18c8d0-36e4-4ac7-83fc-95ad3fe3d7c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1675 microversion: 2.1 time: 0.767654 Jul 30 21:26:27.912105 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2560/5070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:27 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1675 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:28.939774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:28.940507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:28.958846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:28.959426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:28.960537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:28.961618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:29.588325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:29.604550 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbd0b453-ed1b-47e0-bbac-75b45e7417f2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1658 microversion: 2.1 time: 0.669911 Jul 30 21:26:29.606173 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2511/5071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:28 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1658 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:29.628067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:29.629055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:29.636613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:29.637090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:29.637893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:29.638533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:29.774576 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e67af8c-5233-44b8-aed4-ab8a4943d2b7 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action" status: 202 len: 0 microversion: 2.1 time: 0.152208 Jul 30 21:26:29.775240 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2561/5072] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:26:29 2022] POST /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:26:29.784151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:29.785378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:29.792881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:29.794949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:29.795657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:29.797157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:29.798023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:30.265769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:30.274292 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43b53455-0a6c-4181-82b3-a217a92662a8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1664 microversion: 2.1 time: 0.494456 Jul 30 21:26:30.281166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2512/5073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:29 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1664 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:31.303484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:31.304221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:31.319193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:31.320181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:31.320504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:31.320961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:31.798815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:31.810230 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a3133d65-93ea-4468-ac3f-89c881cb1c63 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1664 microversion: 2.1 time: 0.511735 Jul 30 21:26:31.811672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2562/5074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:31 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1664 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:32.832852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:32.833632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:32.844950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:32.844950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:32.850070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:32.862055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:33.433298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:33.448406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f15599de-5dcd-4f89-9382-615310638aac tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 0.619842 Jul 30 21:26:33.462164 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2513/5075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:32 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:33.480314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:33.481022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:33.497510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:33.500011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:33.501051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:33.510475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:35.162548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:35.164562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:35.183402 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a4ba5fa-109a-49d4-84bf-5b189faaadc6 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1667 microversion: 2.1 time: 1.705599 Jul 30 21:26:35.184296 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2563/5076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:33 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1667 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:35.210136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:35.211926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:35.243848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:35.245806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:35.247803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:35.250089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:35.352333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:26:35.365391 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Working on deleting snapshot 1f42d4cc-8577-4d9d-ac81-c472998dc471 from shelved instance... Jul 30 21:26:36.662409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Doing local delete in cell 03a3405d-a30a-427e-89b9-941a414efbcf(cell1) {{(pid=130983) _delete /opt/stack/nova/nova/compute/api.py:2491}} Jul 30 21:26:36.668409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:36.668895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:36.669580 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 30 21:26:36.677889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] deallocate_for_instance() {{(pid=130983) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 30 21:26:37.613974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-703738057", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "79dfdc7e-c445-4402-b7b6-c441ad6a51bf"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:37.756754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] validate_networks() for [('79dfdc7e-c445-4402-b7b6-c441ad6a51bf', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:26:38.441631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Updating instance_info_cache with network_info: [] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:26:38.933591 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a4d4c395-1009-4cb4-9a66-4604ef1937b8 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 204 len: 0 microversion: 2.1 time: 3.729487 Jul 30 21:26:38.934792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2514/5077] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:35 2022] DELETE /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 0 bytes in 3731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:26:39.350945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d89762eb-ac44-4c07-a596-b90c7c88bc41 req-2a8ca7de-d683-425d-b6cc-584bec613312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eda93f8-d7de-4d11-9632-9aeb8ad443da", "name": "network-vif-deleted", "tag": "a9b44af9-319e-4e40-88b9-e53bd2c10632"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:39.374076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d89762eb-ac44-4c07-a596-b90c7c88bc41 req-2a8ca7de-d683-425d-b6cc-584bec613312 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.378237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d89762eb-ac44-4c07-a596-b90c7c88bc41 req-2a8ca7de-d683-425d-b6cc-584bec613312 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.424084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.compute.server_external_events [req-d89762eb-ac44-4c07-a596-b90c7c88bc41 req-2a8ca7de-d683-425d-b6cc-584bec613312 service nova] Unable to find a host for instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da. Dropping event network-vif-deleted {{(pid=130983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 21:26:39.426785 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d89762eb-ac44-4c07-a596-b90c7c88bc41 req-2a8ca7de-d683-425d-b6cc-584bec613312 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.489041 Jul 30 21:26:39.429474 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2515/5078] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 494 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 30 21:26:39.440421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:39.444606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 9eda93f8-d7de-4d11-9632-9aeb8ad443da] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:39.459276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.460311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.461965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.462591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.489979 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da HTTP/1.1 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '9eda93f8-d7de-4d11-9632-9aeb8ad443da'} Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:39.493594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:39.499372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 404 to user: Instance 9eda93f8-d7de-4d11-9632-9aeb8ad443da could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:39.500313 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a1d76d3-8260-4d90-8987-aa6311ecc62b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da" status: 404 len: 111 microversion: 2.1 time: 0.067276 Jul 30 21:26:39.507567 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2516/5079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:39 2022] GET /compute/v2.1/servers/9eda93f8-d7de-4d11-9632-9aeb8ad443da => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:39.514054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:39.514824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:39.523789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.524691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.525715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.526499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.567987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:26:39.628620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:39.699834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83fbfb94-fcec-4c00-a848-38799db7d075 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 204 len: 0 microversion: 2.1 time: 0.189825 Jul 30 21:26:39.701703 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2517/5080] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:39 2022] DELETE /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:26:39.727757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:39.728576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:39.762471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.763174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.774199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:39.775068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:39.896034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:39.905872 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-97284e46-aed6-4623-9e16-09de3185796d tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1465 microversion: 2.1 time: 0.193021 Jul 30 21:26:39.907330 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2518/5081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:39 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:40.083476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:26:40.084160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:26:40.084744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:26:40.085555 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:26:40.086079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:26:40.105454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:40.106466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:40.108520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:40.108992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:40.156768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Getting quotas for project 57f5d9b72de745f8a1371bbaa0230212. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:26:40.167479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Getting quotas for user b0b7534856ad4817b1b15a2505a791dc and project 57f5d9b72de745f8a1371bbaa0230212. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:26:40.222792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:26:40.226710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:26:40.339170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-81a6616b-8095-4f25-abda-49a092b512db tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.950658 Jul 30 21:26:40.340195 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2564/5082] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:26:40.351490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe875a1e-4dc1-4462-a94c-6b47eb0c64a0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:40.352128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe875a1e-4dc1-4462-a94c-6b47eb0c64a0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:40.573093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe875a1e-4dc1-4462-a94c-6b47eb0c64a0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:40.582281 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe875a1e-4dc1-4462-a94c-6b47eb0c64a0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1227 microversion: 2.1 time: 0.234818 Jul 30 21:26:40.584125 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2519/5083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:40 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1227 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:40.928843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:40.929587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:40.942860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:40.945048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:40.947261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:40.950314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:41.342456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:41.356106 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4615df82-38c0-4e64-b0f3-b0f9834611c2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1465 microversion: 2.1 time: 0.432433 Jul 30 21:26:41.357256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2565/5084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:40 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1465 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:41.604618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:41.605930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:41.616209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:41.623888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:41.624857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:41.626165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:41.831577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:41.841053 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae01e461-1e7d-474e-b03a-86e4c01b26a8 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1231 microversion: 2.1 time: 0.239017 Jul 30 21:26:41.846830 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2520/5085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:41 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1231 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:42.379384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:42.380050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:42.395047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:42.396019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:42.398204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:42.400010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:42.641597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:42.663119 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e164b0c4-2c21-4559-bf2b-efff1935b248 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1465 microversion: 2.1 time: 0.289150 Jul 30 21:26:42.677550 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2566/5086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:42 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1465 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:42.867178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:42.868590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:42.891929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:42.895147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:42.898072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:42.898768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:43.072105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:43.087880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0f1dac7-06df-48cc-884f-bcf07a0fe678 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1285 microversion: 2.1 time: 0.225538 Jul 30 21:26:43.100626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2521/5087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:42 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:43.687564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:43.688175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:43.703769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:43.705150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:43.706767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:43.707547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:43.901879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e44829fd-c871-4b76-9517-e3cd1dbc3b55 req-e2f2de44-65da-4ba2-bc98-578d248d1521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a21a86-29f9-4123-a680-83141144b152", "name": "network-vif-deleted", "tag": "d513fb13-9ef8-4e93-bda1-968eaa462c92"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:43.921055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:43.930336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-103e162c-46d5-4464-8ee3-d987abac4640 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 200 len: 1465 microversion: 2.1 time: 0.246577 Jul 30 21:26:43.937840 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2567/5088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:43 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:43.944157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e44829fd-c871-4b76-9517-e3cd1dbc3b55 req-e2f2de44-65da-4ba2-bc98-578d248d1521 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:43.946584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e44829fd-c871-4b76-9517-e3cd1dbc3b55 req-e2f2de44-65da-4ba2-bc98-578d248d1521 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:43.990590 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e44829fd-c871-4b76-9517-e3cd1dbc3b55 req-e2f2de44-65da-4ba2-bc98-578d248d1521 service nova] Creating event network-vif-deleted:d513fb13-9ef8-4e93-bda1-968eaa462c92 for instance 31a21a86-29f9-4123-a680-83141144b152 on nch2-master-1 Jul 30 21:26:44.007082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e44829fd-c871-4b76-9517-e3cd1dbc3b55 req-e2f2de44-65da-4ba2-bc98-578d248d1521 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109719 Jul 30 21:26:44.009358 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2522/5089] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:26:44.113328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:44.114080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:44.133090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:44.134245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:44.135870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:44.138539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:44.261271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:44.280627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e575ddfe-47af-44bd-bd73-e71992756511 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1285 microversion: 2.1 time: 0.171910 Jul 30 21:26:44.283280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2568/5090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:44 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:44.961990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:44.963466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 31a21a86-29f9-4123-a680-83141144b152] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:44.972230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:44.973048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:44.974078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:44.974734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:44.989517 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 HTTP/1.1 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '31a21a86-29f9-4123-a680-83141144b152'} Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:44.991774 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. Jul 30 21:26:44.997061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:44.999654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 404 to user: Instance 31a21a86-29f9-4123-a680-83141144b152 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:45.001153 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1922aafa-741a-4e1c-8071-37a8bf6f17e2 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152" status: 404 len: 111 microversion: 2.1 time: 0.048808 Jul 30 21:26:45.007005 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2523/5091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:44 2022] GET /compute/v2.1/servers/31a21a86-29f9-4123-a680-83141144b152 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:45.014737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:45.015272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:45.036940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.039386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.042067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.043829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.098925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:26:45.282201 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49679bbf-31a6-47c0-ba62-bef0ba63cf6c tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 204 len: 0 microversion: 2.1 time: 0.273577 Jul 30 21:26:45.283464 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2569/5092] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:45 2022] DELETE /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:26:45.292290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:45.292868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:45.302827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.303327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.305703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:45.306668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:45.307660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.308307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.325911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.326434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.334384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:45.335262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:45.494119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:45.509650 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71cfa72c-7d3e-4b0e-8066-e6f9b52c28d6 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1285 microversion: 2.1 time: 0.209492 Jul 30 21:26:45.526458 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2570/5093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:45 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:45.952358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:45.963219 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da357a04-f3b1-4a78-8837-a7ef375984c9 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1507 microversion: 2.1 time: 0.675743 Jul 30 21:26:45.974935 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2524/5094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:45 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1507 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:46.531531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:46.532721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:46.546093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:46.549007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:46.550307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:46.556869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:47.005795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:47.006445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:47.031043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:47.031669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:47.037455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:47.039013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:49.140759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:49.152065 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1012e3cd-86ba-4afa-9dbb-ecea567e1488 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 2.624732 Jul 30 21:26:49.165592 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2571/5095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:46 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:49.194324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:49.204637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-db716951-3615-4570-b981-dfae24b10387 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1507 microversion: 2.1 time: 2.209842 Jul 30 21:26:49.224252 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2525/5096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:46 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1507 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:49.591485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-45568bd3-805c-4f01-b1a4-2fe2fd5a2e60 req-ee844a0b-0b3f-459a-8481-a7316dd4b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a4735b-a42a-42e2-9df6-5702e5218a03", "tag": "c164263a-8946-46c7-b437-518764b0d3d7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:49.624947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-45568bd3-805c-4f01-b1a4-2fe2fd5a2e60 req-ee844a0b-0b3f-459a-8481-a7316dd4b1e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:49.625531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-45568bd3-805c-4f01-b1a4-2fe2fd5a2e60 req-ee844a0b-0b3f-459a-8481-a7316dd4b1e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:49.641026 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-45568bd3-805c-4f01-b1a4-2fe2fd5a2e60 req-ee844a0b-0b3f-459a-8481-a7316dd4b1e7 service nova] Creating event network-changed:c164263a-8946-46c7-b437-518764b0d3d7 for instance f0a4735b-a42a-42e2-9df6-5702e5218a03 on nch2-master-1 Jul 30 21:26:49.648305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-45568bd3-805c-4f01-b1a4-2fe2fd5a2e60 req-ee844a0b-0b3f-459a-8481-a7316dd4b1e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062882 Jul 30 21:26:49.650562 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2572/5097] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:26:50.176196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:50.177450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:50.189273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:50.190276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:50.194124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:50.194933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:50.239488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:50.240222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:50.242648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:50.244133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:50.259877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:50.260359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:50.263612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:50.263884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:50.517754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:50.537434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29fad4ac-ea6e-4c77-8ce9-629f0166164f tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 200 len: 1465 microversion: 2.1 time: 0.300234 Jul 30 21:26:50.539228 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2573/5098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:50 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 1465 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:50.581132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:50.597184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:50.605441 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b9f24e1-6a42-4467-8d65-c6829e3a947a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.436421 Jul 30 21:26:50.619806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2526/5099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:50 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:51.096388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-619c8429-33c1-4b8c-abcc-49217b2a1185 req-b2694390-d1d9-453c-8fb0-49feb91233cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9044217-518c-4773-8903-dd8fcc3d94bc", "name": "network-vif-deleted", "tag": "925f2858-709f-4254-bc6b-3d3f3897de36"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:51.116461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-619c8429-33c1-4b8c-abcc-49217b2a1185 req-b2694390-d1d9-453c-8fb0-49feb91233cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.118530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-619c8429-33c1-4b8c-abcc-49217b2a1185 req-b2694390-d1d9-453c-8fb0-49feb91233cb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.149410 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-619c8429-33c1-4b8c-abcc-49217b2a1185 req-b2694390-d1d9-453c-8fb0-49feb91233cb service nova] Creating event network-vif-deleted:925f2858-709f-4254-bc6b-3d3f3897de36 for instance d9044217-518c-4773-8903-dd8fcc3d94bc on nch1-master-1 Jul 30 21:26:51.172155 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-619c8429-33c1-4b8c-abcc-49217b2a1185 req-b2694390-d1d9-453c-8fb0-49feb91233cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380473 Jul 30 21:26:51.173178 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2574/5100] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:26:51.563208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:51.564523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: d9044217-518c-4773-8903-dd8fcc3d94bc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:51.578928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.586485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.587473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.590670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.621271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc HTTP/1.1 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd9044217-518c-4773-8903-dd8fcc3d94bc'} Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:51.627009 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. Jul 30 21:26:51.634392 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:51.637162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:51.637930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:51.646114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 404 to user: Instance d9044217-518c-4773-8903-dd8fcc3d94bc could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:51.647131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-006e983f-3036-4412-8793-c73971055aed tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc" status: 404 len: 111 microversion: 2.1 time: 0.090251 Jul 30 21:26:51.660871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.661341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.662145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.662594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.664161 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2527/5101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:51 2022] GET /compute/v2.1/servers/d9044217-518c-4773-8903-dd8fcc3d94bc => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:51.671432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:51.672030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:51.685602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.687556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.689059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.689865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.744571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:26:51.927101 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-28fa6da9-a336-4826-97a3-0bfc71abe671 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 204 len: 0 microversion: 2.1 time: 0.261279 Jul 30 21:26:51.927865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2528/5102] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:51 2022] DELETE /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:26:51.981083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:51.982333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:51.995067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.995576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:51.996391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:51.996851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:52.206363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:52.223990 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e1ce701-131d-4a05-a527-d5b288037ffa tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.592461 Jul 30 21:26:52.239846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2575/5103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:51 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:26:53.203662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:53.216720 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77823d08-8c8d-4b58-906f-8e65230415b0 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1493 microversion: 2.1 time: 1.279195 Jul 30 21:26:53.217352 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2529/5104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:51 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1493 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:53.248521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:53.249383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:53.266917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:53.269308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:53.272401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:53.276257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:54.153792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:54.167717 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d82aa9c1-7b7e-4dc4-9d9c-f9bfb2d7022c tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.921730 Jul 30 21:26:54.169953 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2576/5105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:53 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:54.239691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:54.240328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:54.258191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:54.259137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:54.261905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:54.262800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:54.765627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:54.776222 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd86c396-87d1-4f10-9d5f-bb27a5ee5717 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 200 len: 1493 microversion: 2.1 time: 0.541462 Jul 30 21:26:54.784026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2530/5106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:54 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 1493 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:55.077681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bad6957e-4fb1-4aa3-8a27-3ff82d794c9c req-5a655463-1b5c-49a5-a10a-770a01bd1b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1dd28c-fd96-473e-9285-5fc7e3d185d9", "name": "network-vif-deleted", "tag": "55367a18-1117-4a82-8177-8734df153ee1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:55.117630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bad6957e-4fb1-4aa3-8a27-3ff82d794c9c req-5a655463-1b5c-49a5-a10a-770a01bd1b89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.120688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bad6957e-4fb1-4aa3-8a27-3ff82d794c9c req-5a655463-1b5c-49a5-a10a-770a01bd1b89 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.183490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bad6957e-4fb1-4aa3-8a27-3ff82d794c9c req-5a655463-1b5c-49a5-a10a-770a01bd1b89 service nova] Creating event network-vif-deleted:55367a18-1117-4a82-8177-8734df153ee1 for instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 on nch1-master-1 Jul 30 21:26:55.197475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:55.206159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:55.212301 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bad6957e-4fb1-4aa3-8a27-3ff82d794c9c req-5a655463-1b5c-49a5-a10a-770a01bd1b89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135132 Jul 30 21:26:55.214468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.215200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.215362 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2577/5107] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:26:55.216432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.217139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.801215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:55.810547 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8113f1ac-5de2-4182-a306-fca457d0b3b0 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.618442 Jul 30 21:26:55.813388 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2531/5108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:55 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:26:55.820125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:55.821023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: ea1dd28c-fd96-473e-9285-5fc7e3d185d9] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:55.831567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.832414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.833482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.835939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.857923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 HTTP/1.1 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'ea1dd28c-fd96-473e-9285-5fc7e3d185d9'} Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:26:55.860327 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. Jul 30 21:26:55.866779 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:26:55.868232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 404 to user: Instance ea1dd28c-fd96-473e-9285-5fc7e3d185d9 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:26:55.869311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de3f958e-5a82-47f9-a5d9-a3f74302820a tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9" status: 404 len: 111 microversion: 2.1 time: 0.054508 Jul 30 21:26:55.870733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2532/5109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:55 2022] GET /compute/v2.1/servers/ea1dd28c-fd96-473e-9285-5fc7e3d185d9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:26:55.881044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:55.881873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:55.889011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.889785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.891077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.891737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.922060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-96b4f018-b52a-4fff-9a01-2a73703efa48 req-717e3cf1-9ef6-4e77-8709-d95ddc5d6f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a4735b-a42a-42e2-9df6-5702e5218a03", "name": "network-vif-plugged", "status": "completed", "tag": "c164263a-8946-46c7-b437-518764b0d3d7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:26:55.933518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:26:55.935311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-96b4f018-b52a-4fff-9a01-2a73703efa48 req-717e3cf1-9ef6-4e77-8709-d95ddc5d6f4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:55.936294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-96b4f018-b52a-4fff-9a01-2a73703efa48 req-717e3cf1-9ef6-4e77-8709-d95ddc5d6f4d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:55.954877 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-96b4f018-b52a-4fff-9a01-2a73703efa48 req-717e3cf1-9ef6-4e77-8709-d95ddc5d6f4d service nova] Creating event network-vif-plugged:c164263a-8946-46c7-b437-518764b0d3d7 for instance f0a4735b-a42a-42e2-9df6-5702e5218a03 on nch2-master-1 Jul 30 21:26:55.963169 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-96b4f018-b52a-4fff-9a01-2a73703efa48 req-717e3cf1-9ef6-4e77-8709-d95ddc5d6f4d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446638 Jul 30 21:26:55.963950 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2578/5110] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:26:56.033798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:56.101019 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c5cb9bc-36d3-4127-b23e-d2096c193488 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 204 len: 0 microversion: 2.1 time: 0.224016 Jul 30 21:26:56.102244 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2533/5111] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:26:55 2022] DELETE /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:26:56.114082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:56.115700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:56.131553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:56.132390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:56.133951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:56.134632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:56.714951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:56.724986 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7ae24d6-e6fe-495b-a78c-26c46e22ce12 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1673 microversion: 2.1 time: 0.618359 Jul 30 21:26:56.730240 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2579/5112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:56 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1673 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:56.834620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:56.836235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:56.849814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:56.850502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:56.851827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:56.852486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:57.102511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:57.118402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ad6d4d3-ad08-4fd5-8a04-595aff290b9b tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.283797 Jul 30 21:26:57.120303 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2534/5113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:56 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:57.746609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:57.749560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:57.757273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:57.769845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:57.772688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:57.773797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:57.774865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:58.148561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:58.149953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:58.171060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:58.171508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:58.172812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:58.173487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:58.293371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:58.301813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49a5d0c0-4c4e-4597-abb5-700c4f41c1b4 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1673 microversion: 2.1 time: 0.559369 Jul 30 21:26:58.306120 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2580/5114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:57 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1673 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:26:58.531410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:58.546183 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b7039b0-fb1b-4297-892e-95bc67938fb7 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1327 microversion: 2.1 time: 0.407870 Jul 30 21:26:58.548330 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2535/5115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:58 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1327 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:26:59.330896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:59.332414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:59.360560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:59.362753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:59.366416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:59.368957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:59.571813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:26:59.572460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:26:59.584897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:59.585374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:59.586185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:26:59.586644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:26:59.924431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:26:59.941228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a8644fe8-e34b-4fb5-9103-a1a5a8f6fd33 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1673 microversion: 2.1 time: 0.616372 Jul 30 21:26:59.942019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2581/5116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:59 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1673 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:00.389614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:00.401415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ae71da0-4173-421b-aca4-7e2eddea9558 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1528 microversion: 2.1 time: 0.834447 Jul 30 21:27:00.402369 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2536/5117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:26:59 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1528 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:00.427209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:00.427946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:00.441976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:00.442987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:00.445511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:00.447035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:00.457052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:00.953245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-623c99c6-65e0-47be-a3cb-3fa2352c2ec4 req-4d09ded3-adfc-4b9c-b280-67339925a0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b930d1a-368c-43db-a27d-b93bdaa392ad", "name": "network-vif-deleted", "tag": "def32c9d-e0bb-4b75-8aab-a0f895d9bfa7"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:27:00.965610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:00.967833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:00.978030 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2e87d46-ee3d-4f7c-b626-c719c49bf61d tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1528 microversion: 2.1 time: 0.559000 Jul 30 21:27:00.991681 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2582/5118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:00 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:00.991751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-623c99c6-65e0-47be-a3cb-3fa2352c2ec4 req-4d09ded3-adfc-4b9c-b280-67339925a0aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:00.991751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-623c99c6-65e0-47be-a3cb-3fa2352c2ec4 req-4d09ded3-adfc-4b9c-b280-67339925a0aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.009999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:01.015857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:01.032560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.033046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.033486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-623c99c6-65e0-47be-a3cb-3fa2352c2ec4 req-4d09ded3-adfc-4b9c-b280-67339925a0aa service nova] Creating event network-vif-deleted:def32c9d-e0bb-4b75-8aab-a0f895d9bfa7 for instance 4b930d1a-368c-43db-a27d-b93bdaa392ad on nch2-master-1 Jul 30 21:27:01.033897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.034361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.043921 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-623c99c6-65e0-47be-a3cb-3fa2352c2ec4 req-4d09ded3-adfc-4b9c-b280-67339925a0aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096857 Jul 30 21:27:01.044538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2537/5119] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:01.376009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025e35fd22a4895a5d0301c1d5b0e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116c26d6b98641bb8ed5ff5dcdd966c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:01.390529 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f3aa174-460b-4690-b7a6-291eac1e3386 tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 200 len: 1322 microversion: 2.1 time: 0.405006 Jul 30 21:27:01.391152 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2583/5120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:00 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:01.422372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:01.423742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:01.437784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.443164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.444546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.445421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.484384 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] HTTP exception thrown: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Request method failure captured: Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 HTTP/1.1 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aINrFNSTwlLXhRf_blFQngdso2I7NU1Se_0TSZu2v8Tn29g_oh1KdN2p9t28MbP6xfg-8m-Tbjd5rhC9XLULLdSg2288lpn7jNr_33gKnuaN9-h3rY_0tZMzLFQnm_hD36ukm18oBW9RQujhx3Sl2Py2G_6MCYl5jfl7o1AsJsyQG0 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6ef7b4a99dfd4b92a73c3dbc9f03cd91 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef7b4a99dfd4b92a73c3dbc9f03cd91", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6ef7b4a99dfd4b92a73c3dbc9f03cd91 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1189745461-project Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a90fd14f0cf34e148935f79cf381f903 Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461-project Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f0a4735b-a42a-42e2-9df6-5702e5218a03'} Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:27:01.492028 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Returning 404 to user: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f82d9b01-fc98-4284-acbb-d60a5a862464 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 404 len: 111 microversion: 2.1 time: 0.444722 Jul 30 21:27:01.495409 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2538/5121] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:27:01 2022] DELETE /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 111 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:01.505295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:01.505951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:01.515915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.516396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:01.517206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:01.517712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.420487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:02.424458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] [instance: 4b930d1a-368c-43db-a27d-b93bdaa392ad] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:02.450899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.452041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.457428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.457956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.508924 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] HTTP exception thrown: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Request method failure captured: Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad HTTP/1.1 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aAUiERm9ET1N2GZJhG4852tUREi1_iZfnEpirdL0V1go453JLLM4S31FOKhlaTIm6PR2thTQ72VxCV15FqsPJvVe1c8Uab1xSUVKfc5r-NIfw8-Az-qkZlrSGHcImY8du-rffeybzC05i4LGXHMAnHnVMXg3k2mfMMswblYUxRMJwU Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_116c26d6b98641bb8ed5ff5dcdd966c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/116c26d6b98641bb8ed5ff5dcdd966c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 116c26d6b98641bb8ed5ff5dcdd966c8 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1193387773 Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c025e35fd22a4895a5d0301c1d5b0e8e Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1193387773-project Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '4b930d1a-368c-43db-a27d-b93bdaa392ad'} Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:02.511018 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. Jul 30 21:27:02.514878 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.518604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Returning 404 to user: Instance 4b930d1a-368c-43db-a27d-b93bdaa392ad could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:27:02.520536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2664652-bb29-466a-811a-4afc71f4b13e tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad" status: 404 len: 111 microversion: 2.1 time: 0.112430 Jul 30 21:27:02.526767 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2539/5122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:02 2022] GET /compute/v2.1/servers/4b930d1a-368c-43db-a27d-b93bdaa392ad => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:02.535916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7e0ec80b-fe5c-403f-b6d7-b4815f772b3b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] Calling method '.version_select at 0x7fbb5d2c29d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:02.575279 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7e0ec80b-fe5c-403f-b6d7-b4815f772b3b tempest-ServerActionsTestJSON-1193387773 tempest-ServerActionsTestJSON-1193387773-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958307668" status: 202 len: 0 microversion: 2.1 time: 0.045784 Jul 30 21:27:02.579040 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2540/5123] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958307668 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:27:02.832471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:02.847837 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4bc3c04b-9866-4e19-9dc5-f570cc752a67 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1528 microversion: 2.1 time: 1.345181 Jul 30 21:27:02.850726 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2584/5124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:01 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1528 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:02.873447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Action: 'update', calling method: >, body: {"server": {"name": "f0a4735b-a42a-42e2-9df6-5702e5218a03_new"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:27:02.880199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:02.892723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.894211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.895868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.896545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.927561 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] HTTP exception thrown: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Request method failure captured: Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: request: PUT /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 HTTP/1.1 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 64 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aINrFNSTwlLXhRf_blFQngdso2I7NU1Se_0TSZu2v8Tn29g_oh1KdN2p9t28MbP6xfg-8m-Tbjd5rhC9XLULLdSg2288lpn7jNr_33gKnuaN9-h3rY_0tZMzLFQnm_hD36ukm18oBW9RQujhx3Sl2Py2G_6MCYl5jfl7o1AsJsyQG0 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6ef7b4a99dfd4b92a73c3dbc9f03cd91 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef7b4a99dfd4b92a73c3dbc9f03cd91", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef7b4a99dfd4b92a73c3dbc9f03cd91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6ef7b4a99dfd4b92a73c3dbc9f03cd91 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1189745461-project Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: a90fd14f0cf34e148935f79cf381f903 Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1189745461-project Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: {"server": {"name": "f0a4735b-a42a-42e2-9df6-5702e5218a03_new"}} Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f0a4735b-a42a-42e2-9df6-5702e5218a03', 'body': {'server': {'name': 'f0a4735b-a42a-42e2-9df6-5702e5218a03_new'}}} Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 30 21:27:02.932221 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:02.935383 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:02.938673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] Returning 404 to user: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:27:02.940055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cdd9522-7dca-4e62-9abd-a0c43ede5b87 tempest-ServersNegativeTestMultiTenantJSON-1189745461 tempest-ServersNegativeTestMultiTenantJSON-1189745461-project] 10.222.0.17 "PUT /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 404 len: 111 microversion: 2.1 time: 0.073472 Jul 30 21:27:02.946593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2541/5125] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:27:02 2022] PUT /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:02.951948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:02.952494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:02.961115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.963435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:02.964320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:02.964784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:03.041984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:27:03.229859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-717a746e-190f-4cf5-83ab-9d1cb2e30c6a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 204 len: 0 microversion: 2.1 time: 0.281891 Jul 30 21:27:03.230769 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2585/5126] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:27:02 2022] DELETE /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:27:03.239474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:03.240180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:03.261267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:03.262549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:03.263579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:03.264191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:03.558452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:03.575754 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8c10d3c-49fb-48d6-9c8a-4af02bd46dbf tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1534 microversion: 2.1 time: 0.340789 Jul 30 21:27:03.581570 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2542/5127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:03 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1534 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:04.606035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:04.606765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:04.619953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:04.622280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:04.623330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:04.626275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:05.035596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:05.045923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2282d904-0b75-4929-9c41-05d0e93d9a72 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1534 microversion: 2.1 time: 0.444697 Jul 30 21:27:05.058729 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2586/5128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:04 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1534 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:06.082284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:06.083147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:06.122709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:06.124039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:06.128279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:06.130892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:07.015958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b7534856ad4817b1b15a2505a791dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f5d9b72de745f8a1371bbaa0230212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:07.040708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5dce1664-c044-452c-b54e-e2f620c0471a tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 200 len: 1534 microversion: 2.1 time: 0.961812 Jul 30 21:27:07.056689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2543/5129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:06 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 1534 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:07.077931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6a9ae5ad-07bd-45f1-b7ad-f7b9d5b76e95 req-3c45d329-f583-4f1b-9048-22fea101300b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a4735b-a42a-42e2-9df6-5702e5218a03", "name": "network-vif-deleted", "tag": "c164263a-8946-46c7-b437-518764b0d3d7"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:27:07.101655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6a9ae5ad-07bd-45f1-b7ad-f7b9d5b76e95 req-3c45d329-f583-4f1b-9048-22fea101300b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:07.103568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6a9ae5ad-07bd-45f1-b7ad-f7b9d5b76e95 req-3c45d329-f583-4f1b-9048-22fea101300b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:07.141903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6a9ae5ad-07bd-45f1-b7ad-f7b9d5b76e95 req-3c45d329-f583-4f1b-9048-22fea101300b service nova] Creating event network-vif-deleted:c164263a-8946-46c7-b437-518764b0d3d7 for instance f0a4735b-a42a-42e2-9df6-5702e5218a03 on nch2-master-1 Jul 30 21:27:07.151763 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6a9ae5ad-07bd-45f1-b7ad-f7b9d5b76e95 req-3c45d329-f583-4f1b-9048-22fea101300b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081040 Jul 30 21:27:07.152805 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2587/5130] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:08.067747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:08.069073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] [instance: f0a4735b-a42a-42e2-9df6-5702e5218a03] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:08.088084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:08.088922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:08.089932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:08.090600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:08.123266 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] HTTP exception thrown: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Request method failure captured: Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 HTTP/1.1 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aH1ONhrsUulKtVKP6zUlX2xuDCS440ezSu0g4PcTPPeJU2Jv8Mi-3WjZIqcQyy2yjMNmJH32u9vQMWJDZ7GxuFs52EJiIFJLqt2ee7ZAh_-yrEhLzZpKxNw8E80lGS4TBW5QskS5rl-5lkg5c3zGNUcMshea6SyoBIvJgKaebhAgdc Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 57f5d9b72de745f8a1371bbaa0230212 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2137587203 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/57f5d9b72de745f8a1371bbaa0230212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_57f5d9b72de745f8a1371bbaa0230212", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/57f5d9b72de745f8a1371bbaa0230212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/57f5d9b72de745f8a1371bbaa0230212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2137587203 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 57f5d9b72de745f8a1371bbaa0230212 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2137587203 Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2137587203-project Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: b0b7534856ad4817b1b15a2505a791dc Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2137587203-project Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f0a4735b-a42a-42e2-9df6-5702e5218a03'} Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:08.132988 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. Jul 30 21:27:08.136318 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:27:08.148205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] Returning 404 to user: Instance f0a4735b-a42a-42e2-9df6-5702e5218a03 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:27:08.149122 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-86fcaf7b-7c7e-4c48-9931-ad6c9ba13c18 tempest-ServersNegativeTestMultiTenantJSON-2137587203 tempest-ServersNegativeTestMultiTenantJSON-2137587203-project] 10.222.0.17 "GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03" status: 404 len: 111 microversion: 2.1 time: 0.085471 Jul 30 21:27:08.153122 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2544/5131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:08 2022] GET /compute/v2.1/servers/f0a4735b-a42a-42e2-9df6-5702e5218a03 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:27:42.013330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:42.014168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:42.638217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1159606956", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:27:42.716430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] validate_networks() for [('55b47edb-6a14-4bd0-b1ff-310f5e575d8b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:27:44.045042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-881aa6e7-e3ab-41d9-9119-30f71037cccb tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5cfe9160>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:44.063803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:44.074276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=40 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:44.189412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-881aa6e7-e3ab-41d9-9119-30f71037cccb tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c751bf64-0b4c-47f3-b45f-c3cb8b41c782" status: 200 len: 344 microversion: 2.1 time: 0.148702 Jul 30 21:27:44.202132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2545/5132] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:27:44 2022] GET /compute/v2.1/os-volumes/c751bf64-0b4c-47f3-b45f-c3cb8b41c782 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:44.806071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:27:44.808781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:27:44.816351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:27:44.817260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:27:44.817928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:27:44.850063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:44.850526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:44.851368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:44.851820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:44.917574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Getting quotas for project 837cee2339bd4feb9a571b38c0577add. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:27:44.937068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Getting quotas for user c5b99eba81444a7b9cc59e73898c65af and project 837cee2339bd4feb9a571b38c0577add. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:27:44.985971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:27:45.026670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:27:45.228078 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55d54602-0688-4c83-a644-b275c0d492e6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.218084 Jul 30 21:27:45.229252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2588/5133] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:27:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:27:45.249672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20b9cc56-4fe5-443d-8ffa-227241de7013 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:45.251550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20b9cc56-4fe5-443d-8ffa-227241de7013 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:45.672167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20b9cc56-4fe5-443d-8ffa-227241de7013 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:45.679875 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20b9cc56-4fe5-443d-8ffa-227241de7013 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1223 microversion: 2.1 time: 0.442964 Jul 30 21:27:45.680370 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2546/5134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:45 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1223 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:46.168154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b83f5b84-502e-4856-8106-092bd7f1efa2 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5d4ac790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:46.276104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b83f5b84-502e-4856-8106-092bd7f1efa2 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/373e4a57-dfc9-405d-bc87-7370130e3525" status: 200 len: 343 microversion: 2.1 time: 0.114386 Jul 30 21:27:46.276679 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2589/5135] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:27:46 2022] GET /compute/v2.1/os-volumes/373e4a57-dfc9-405d-bc87-7370130e3525 => generated 343 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:46.709344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:46.710012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:46.740650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:46.741134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:46.741957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:46.742416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:47.155995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:47.172280 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-32760352-2ae4-4689-8a27-205cc3c5bcda tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1219 microversion: 2.1 time: 0.470323 Jul 30 21:27:47.173171 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2547/5136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:46 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1219 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:48.195283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:48.196058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:48.235844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:48.238838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:48.243479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:48.246423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:48.286392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30ff1ce9-e143-4392-9b07-fcb6f5a47dc5 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5d031a60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:48.381491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30ff1ce9-e143-4392-9b07-fcb6f5a47dc5 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2c6698f7-455c-4068-81cb-295a0d620065" status: 200 len: 344 microversion: 2.1 time: 0.098358 Jul 30 21:27:48.382507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2548/5137] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/os-volumes/2c6698f7-455c-4068-81cb-295a0d620065 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:48.405047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43b33249-aaa7-4d3e-bfdb-3f8daee74033 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5d700700>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:48.501093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:48.521760 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3d74c97-0494-41db-850e-790e95435257 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1281 microversion: 2.1 time: 0.328574 Jul 30 21:27:48.522725 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2590/5138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:48.550420 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43b33249-aaa7-4d3e-bfdb-3f8daee74033 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.158984 Jul 30 21:27:48.551132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2549/5139] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:48.568848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20e2c496-b1d0-416a-a41a-5532ebb48a5d tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5d4ac940>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:48.771267 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20e2c496-b1d0-416a-a41a-5532ebb48a5d tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.206622 Jul 30 21:27:48.773607 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2591/5140] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:48.794242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-52866a1c-48dc-497a-b8ac-0e65f84b98d8 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5d0311f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:48.927477 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-52866a1c-48dc-497a-b8ac-0e65f84b98d8 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.144531 Jul 30 21:27:48.942246 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2550/5141] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:48.943104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bc79a77c-4cc0-4fd0-aea3-dcb9087d818f tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb4fdc6160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:49.105420 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bc79a77c-4cc0-4fd0-aea3-dcb9087d818f tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.166777 Jul 30 21:27:49.106006 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2592/5142] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Jul 30 21:27:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:49.122294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1279778e-91c3-4aaa-a204-8a8197455764 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5c5c9dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:49.313435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1279778e-91c3-4aaa-a204-8a8197455764 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.196213 Jul 30 21:27:49.316745 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2551/5143] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 30 21:27:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:49.335132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ba8453f-9d30-4273-8864-85d198a91a22 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb4fdc6ee0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:49.542287 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ba8453f-9d30-4273-8864-85d198a91a22 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.212117 Jul 30 21:27:49.542942 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2593/5144] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:27:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:49.558129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:49.558773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:49.583606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2502ea28-3640-4c56-a558-70448199302a tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb62921b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:49.583957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:49.584495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:49.585356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:49.585882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:49.816150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:49.831957 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23048100-9a3f-494c-99ae-85c8a5669dc9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1281 microversion: 2.1 time: 0.285629 Jul 30 21:27:49.836937 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2552/5145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:49 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:27:49.883079 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2502ea28-3640-4c56-a558-70448199302a tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.329548 Jul 30 21:27:49.896153 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2594/5146] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Jul 30 21:27:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:49.902397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0292160-fb1c-4683-9295-5e3202482e77 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] Calling method '.version_select at 0x7fbb5c4ef820>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:50.106819 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0292160-fb1c-4683-9295-5e3202482e77 tempest-VolumesTestJSON-202015161 tempest-VolumesTestJSON-202015161-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.210377 Jul 30 21:27:50.107531 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2553/5147] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:27:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:27:50.857645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:50.858285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:50.886669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:50.887205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:50.888662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:50.889344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:51.768440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:51.789495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-610b2cb3-403f-4ab2-994f-32e141efb776 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.935076 Jul 30 21:27:51.790551 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2595/5148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:50 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:52.618066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6f8ef6af-c9d0-4be9-86f6-fef5e186a341 req-aac85e90-cb9c-4a22-9d7d-f64d174ef1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:27:52.647826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f8ef6af-c9d0-4be9-86f6-fef5e186a341 req-aac85e90-cb9c-4a22-9d7d-f64d174ef1c5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:52.649492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6f8ef6af-c9d0-4be9-86f6-fef5e186a341 req-aac85e90-cb9c-4a22-9d7d-f64d174ef1c5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:52.673467 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6f8ef6af-c9d0-4be9-86f6-fef5e186a341 req-aac85e90-cb9c-4a22-9d7d-f64d174ef1c5 service nova] Creating event network-changed:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:27:52.680887 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6f8ef6af-c9d0-4be9-86f6-fef5e186a341 req-aac85e90-cb9c-4a22-9d7d-f64d174ef1c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068990 Jul 30 21:27:52.686340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2554/5149] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:27:52.811498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:52.812130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:52.840404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:52.842696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:52.843816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:52.845451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:53.470751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:53.488180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0512b3a7-53be-42c5-b5f7-19695e608907 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.681067 Jul 30 21:27:53.493100 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2596/5150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:52 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:54.519906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:54.521368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:54.536804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:54.537890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:54.541034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:54.541687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:54.974730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:54.996694 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-24fd322a-be4c-4728-a69a-707c79a974b5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.485464 Jul 30 21:27:54.997893 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2555/5151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:54 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:56.023679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:56.024399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:56.031150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:56.031899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:56.047176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:56.048548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:56.050609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:56.051263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:56.818299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:56.838464 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ed0ec82-1dcb-4f45-a205-13602aa644b2 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.817218 Jul 30 21:27:56.839264 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2597/5152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:56 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:57.862050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:57.862687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:57.875633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:57.889587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:57.890046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:57.903253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:57.903800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:58.248076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:58.266171 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-71ad5992-6df4-4ad8-a789-a9ffcb444fa3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.407993 Jul 30 21:27:58.267198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2556/5153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:57 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:27:59.287878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:27:59.288567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:27:59.300178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:59.300867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:59.302620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:27:59.303072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:27:59.685372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:27:59.697351 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2cef318-91ae-472e-ad74-91421f6023c6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.413250 Jul 30 21:27:59.698212 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2598/5154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:27:59 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:00.118192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-101d4366-b9d6-4115-a41d-a0403117914b req-b94496c5-d148-4e7e-aefa-9db45f297ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "name": "network-vif-plugged", "status": "completed", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:00.144754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-101d4366-b9d6-4115-a41d-a0403117914b req-b94496c5-d148-4e7e-aefa-9db45f297ffe service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:00.145215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-101d4366-b9d6-4115-a41d-a0403117914b req-b94496c5-d148-4e7e-aefa-9db45f297ffe service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:00.185225 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-101d4366-b9d6-4115-a41d-a0403117914b req-b94496c5-d148-4e7e-aefa-9db45f297ffe service nova] Creating event network-vif-plugged:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:00.199833 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-101d4366-b9d6-4115-a41d-a0403117914b req-b94496c5-d148-4e7e-aefa-9db45f297ffe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082641 Jul 30 21:28:00.200489 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2557/5155] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:00.723250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:00.724388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:00.737585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:00.738060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:00.738858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:00.740462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:01.040613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:01.050490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d46fc2a1-acaf-4a60-88b4-ff4f306a6897 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1323 microversion: 2.1 time: 0.335124 Jul 30 21:28:01.054380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2599/5156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:00 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:02.077605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:02.078861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:02.098499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.099387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.101836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.102971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.353678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:02.362562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-748bc84e-cbae-4d10-9d68-2904fa5f0a35 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1517 microversion: 2.1 time: 0.293102 Jul 30 21:28:02.363254 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2558/5157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:02 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:02.387482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:02.390839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:02.398764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.399575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.400447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.400976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.435593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lazy-loading 'flavor' on Instance uuid e02359bc-4b1b-45a4-8847-588408920293 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:28:02.533414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-74a1f7c0-6c8d-4ccd-9bba-a84c84a3ea9c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action" status: 200 len: 32 microversion: 2.1 time: 0.150467 Jul 30 21:28:02.534325 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2600/5158] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:28:02 2022] POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:28:02.543528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:02.544325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:02.551418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.551895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.552797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:02.553254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:02.805476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:02.817172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5197a24b-90ce-45e8-ba7f-a51106763d5e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.276999 Jul 30 21:28:02.818784 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2559/5159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:02 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:03.843569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:03.845386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:03.855408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:03.856340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:03.857511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:03.858181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:04.491120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:04.505568 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8046f66a-a585-4a81-8360-42d566ab4264 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.667116 Jul 30 21:28:04.521116 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2601/5160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:03 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:05.530357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:05.531755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:05.543948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:05.544852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:05.546949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:05.547891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:05.792936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:05.802067 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d67a2c08-b42e-4d5f-8252-fa1974aee79b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.276728 Jul 30 21:28:05.807871 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2560/5161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:05 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:06.833415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:06.834707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:06.871595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:06.873916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:06.879529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:06.880148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:07.482714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:07.498902 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-158f4cfd-0b27-443a-ab36-14e9f4e9877a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.666780 Jul 30 21:28:07.502741 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2602/5162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:06 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:08.522033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:08.522650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:08.537064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:08.537724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:08.538858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:08.539569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:09.027109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:09.043519 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e26f5886-f2bf-4bb6-b88a-092674f493f7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.521242 Jul 30 21:28:09.055606 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2561/5163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:08 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:10.068521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:10.069261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:10.080230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:10.082752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:10.085298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:10.085920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:10.598621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:10.608104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-357a6c9b-75cc-4ff6-a955-9fc0b93994a4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.544805 Jul 30 21:28:10.609682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2603/5164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:10 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:11.636127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:11.638060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:11.669240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:11.670343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:11.675002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:11.677353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:12.149587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:12.176129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5c189af-80fe-44c6-b2d5-34f8d8e0ac28 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.546293 Jul 30 21:28:12.185332 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2562/5165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:11 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:13.202157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:13.202795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:13.205272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:13.216873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:13.217345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:13.218199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:13.218654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:13.228021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:14.128968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:14.144058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bda0284e-462a-47b7-8800-47e342184ba3 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.945381 Jul 30 21:28:14.147923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2604/5166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:13 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:15.173374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:15.174586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:15.178383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=27 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:15.188656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:15.189504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:15.192428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:15.193133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:15.225780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=59 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:15.637324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:15.665190 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b77c668c-c996-4bb1-a328-82db88f84d93 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.495340 Jul 30 21:28:15.669142 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2563/5167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:15 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:16.690222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:16.690950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:16.699259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:16.700144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:16.701288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:16.701976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:17.049106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:17.065916 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-811c6736-b048-490e-b86b-71c298151690 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.379985 Jul 30 21:28:17.066933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2605/5168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:16 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:18.088220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:18.088745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:18.100396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:18.109598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:18.110803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:18.111277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:18.404248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:18.455560 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61e65999-5d03-4248-8e93-c690c8ee7ef8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.371122 Jul 30 21:28:18.458499 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2564/5169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:18 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:19.479709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:19.480930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:19.499710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:19.500101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:19.500899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:19.501355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:20.036368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:20.047996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ca82b911-4a1b-484f-9b84-09553094660f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.572569 Jul 30 21:28:20.051954 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2606/5170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:19 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:20.581042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1702703853", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "203e2966-206b-4408-89b3-245a5cd431b2"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:20.673633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] validate_networks() for [('203e2966-206b-4408-89b3-245a5cd431b2', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:28:21.073417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:21.077587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:21.088223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:21.088983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:21.090247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:21.090973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:21.547141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:28:21.548097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:28:21.548878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:28:21.549718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:28:21.550384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:28:21.560320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:21.560722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:21.562211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:21.562670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:21.607417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Getting quotas for project 418ff359f7a747e58ae4fdf0c4b7072a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:28:21.621466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Getting quotas for user db01f9802e8147b8bdabfc9bbbbd7bb3 and project 418ff359f7a747e58ae4fdf0c4b7072a. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:28:21.655913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:28:21.658367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:28:21.750310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0481fe28-1d09-4c8b-83e2-11e50b53c350 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377742 Jul 30 21:28:21.752282 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2565/5171] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:28:21.771949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb2874a4-b0a6-4028-96a7-deaf03669d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:21.772213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:21.772881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb2874a4-b0a6-4028-96a7-deaf03669d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:21.784813 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92554684-02db-45c5-9894-82f8507d9cc1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.716731 Jul 30 21:28:21.816659 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2607/5172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:21 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:21.914329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb2874a4-b0a6-4028-96a7-deaf03669d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:21.929448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb2874a4-b0a6-4028-96a7-deaf03669d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1214 microversion: 2.1 time: 0.169485 Jul 30 21:28:21.932692 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2566/5173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:21 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:22.816051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:22.829024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:22.865588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:22.868694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:22.869827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:22.871881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:22.960099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:22.962138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:22.982093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:22.983444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:22.984642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:22.985240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:23.224340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:23.239189 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8a9b6341-920c-4bc7-a150-34425a622c0c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1266 microversion: 2.1 time: 0.284032 Jul 30 21:28:23.241280 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2567/5174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:22 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:23.802497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:23.824206 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6d16051f-f8f2-4bf1-b3a3-250f0b24b4c1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 1.018301 Jul 30 21:28:23.840344 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2608/5175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:22 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:24.265503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:24.267016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:24.287021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:24.291194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:24.292375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:24.294181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:24.461776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:24.474293 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a366d5eb-e3c8-4b46-9b18-e6546cbdce01 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1272 microversion: 2.1 time: 0.215068 Jul 30 21:28:24.481809 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2568/5176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:24 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:24.850119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:24.851437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:24.874222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:24.874939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:24.876260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:24.876980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:25.381857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:25.393449 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25182fcc-c625-4d06-b64d-e91664a0e43a tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.547787 Jul 30 21:28:25.395862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2609/5177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:24 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:25.503548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:25.504910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:25.513472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:25.514759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:25.515803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:25.516488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:25.594823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:25.604601 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1352db4-1e7a-4e81-b548-b4f863215df8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1272 microversion: 2.1 time: 0.106149 Jul 30 21:28:25.605801 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2569/5178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:25 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:26.417021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:26.417998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:26.429998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:26.438372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:26.440182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:26.440897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:26.628676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:26.629311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:26.636377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:26.637237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:26.638308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:26.639992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:26.798414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:26.807845 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-265b3923-77eb-40d1-87e2-791649386219 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 0.183141 Jul 30 21:28:26.808496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2570/5179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:26 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:27.161509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:27.170236 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee7761f7-9089-41ed-9202-baa7c5e40128 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.757163 Jul 30 21:28:27.176672 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2610/5180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:26 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:27.658948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-54a48d18-5e6b-49f3-af81-0d26e58c0490 req-17067cd8-3b94-47e9-9977-2c10c73819c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42ff5b5-402f-4eba-ba75-6fe636f6aaf7", "tag": "b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:27.699478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-54a48d18-5e6b-49f3-af81-0d26e58c0490 req-17067cd8-3b94-47e9-9977-2c10c73819c7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:27.700284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-54a48d18-5e6b-49f3-af81-0d26e58c0490 req-17067cd8-3b94-47e9-9977-2c10c73819c7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:27.718388 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-54a48d18-5e6b-49f3-af81-0d26e58c0490 req-17067cd8-3b94-47e9-9977-2c10c73819c7 service nova] Creating event network-changed:b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6 for instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 on nch1-master-1 Jul 30 21:28:27.742491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-54a48d18-5e6b-49f3-af81-0d26e58c0490 req-17067cd8-3b94-47e9-9977-2c10c73819c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088042 Jul 30 21:28:27.748528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2571/5181] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:27.830990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:27.832320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:27.851362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:27.854676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:27.856267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:27.860062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:28.206136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:28.207325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:28.241951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:28.242676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:28.247186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:28.254337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:28.262286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:28.273133 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a0c9b2e-8a77-428c-a265-2aa389236e25 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 0.447523 Jul 30 21:28:28.276669 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2611/5182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:27 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:28.598283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:28.612227 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07d875b8-2d43-47a7-a784-5f8e08c60d66 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.417519 Jul 30 21:28:28.612843 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2572/5183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:28 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:29.301299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:29.302700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:29.314560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:29.316894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:29.317976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:29.319940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:29.644235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:29.651935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:29.666760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:29.667728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:29.668920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:29.669544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:29.812613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:29.826015 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b76f427-8557-4ba2-859f-7a0b29062d5e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 0.528818 Jul 30 21:28:29.827625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2612/5184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:29 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:29.919121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:29.932304 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd4d6e38-4f5a-4315-abde-fd52b69290d9 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1523 microversion: 2.1 time: 0.301076 Jul 30 21:28:29.943452 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2573/5185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:29 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:30.850169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:30.850820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:30.886808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:30.887677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:30.889554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:30.890247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:30.954663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:30.956022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:30.968787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:30.969443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:30.970556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:30.971148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:31.245452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:31.254888 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4d0a1e4-e2fc-409c-af5b-68e216bc6f62 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 0.409510 Jul 30 21:28:31.256758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:31.259006 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2613/5186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:30 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:31.269249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8cda90d5-2543-45d3-8240-d04457121276 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1503 microversion: 2.1 time: 0.316900 Jul 30 21:28:31.272756 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2574/5187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:30 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:31.298907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-01680b4c-8502-4ba4-a7cb-6af9e2dc52a5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'create', calling method: .version_select at 0x7fbb4fe8d4c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-351504229", "description": "tempest-description-398021364"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:31.553692 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-01680b4c-8502-4ba4-a7cb-6af9e2dc52a5 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.259378 Jul 30 21:28:31.565311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2614/5188] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Jul 30 21:28:31 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:31.569030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-351504229"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:31.569650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:31.579351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:31.579831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:31.580669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:31.581123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:31.605420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:31.749671 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Adding security group 2fcca0bf-50cd-451b-8a30-3ede6e0ef444 to port 6969752c-afb9-477f-9a07-172243359b48 Jul 30 21:28:31.926651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:32.198213 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-38b24b91-bba3-45b9-bc7a-1ba1f674d90c tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action" status: 202 len: 0 microversion: 2.1 time: 0.634261 Jul 30 21:28:32.199795 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2575/5189] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:28:31 2022] POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:28:32.208631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-351504229"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:32.210053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:32.218541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aee84b68-4b69-48f8-91b6-f12f8372c9a6 req-3aff4a5e-c9c8-492f-9463-c3cd3cb90116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:32.231405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:32.238278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:32.239090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:32.239583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:32.252788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aee84b68-4b69-48f8-91b6-f12f8372c9a6 req-3aff4a5e-c9c8-492f-9463-c3cd3cb90116 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:32.253256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aee84b68-4b69-48f8-91b6-f12f8372c9a6 req-3aff4a5e-c9c8-492f-9463-c3cd3cb90116 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:32.286283 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aee84b68-4b69-48f8-91b6-f12f8372c9a6 req-3aff4a5e-c9c8-492f-9463-c3cd3cb90116 service nova] Creating event network-changed:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:32.299326 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aee84b68-4b69-48f8-91b6-f12f8372c9a6 req-3aff4a5e-c9c8-492f-9463-c3cd3cb90116 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084404 Jul 30 21:28:32.299956 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2576/5190] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:28:32.322557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:32.323318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:32.336624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:32.339057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:32.348929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:32.349543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:32.620092 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.network.security_group_api [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Removing security group 2fcca0bf-50cd-451b-8a30-3ede6e0ef444 from port 6969752c-afb9-477f-9a07-172243359b48 Jul 30 21:28:33.343744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:33.370218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-249114da-fb92-425e-9d9b-12b2f80388c8 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 1.053918 Jul 30 21:28:33.370908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2577/5191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:32 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:33.781823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7ce6f36-13c2-4ddf-bd66-93d377449587 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action" status: 202 len: 0 microversion: 2.1 time: 1.577352 Jul 30 21:28:33.783322 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2615/5192] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:28:32 2022] POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action => generated 0 bytes in 1579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:28:33.793830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92861b36-0cd4-442a-a916-81d9bfa2125f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'create', calling method: .version_select at 0x7fbb62ac8d30>, body: {"pool": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:33.858946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-975ce5de-ca15-4e55-aaa7-227ed5242911 req-1a6260fe-4093-46fa-ab6e-15c7fe1ef74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42ff5b5-402f-4eba-ba75-6fe636f6aaf7", "name": "network-vif-plugged", "status": "completed", "tag": "b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:33.882940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-975ce5de-ca15-4e55-aaa7-227ed5242911 req-1a6260fe-4093-46fa-ab6e-15c7fe1ef74c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:33.885587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-975ce5de-ca15-4e55-aaa7-227ed5242911 req-1a6260fe-4093-46fa-ab6e-15c7fe1ef74c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:33.929588 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-975ce5de-ca15-4e55-aaa7-227ed5242911 req-1a6260fe-4093-46fa-ab6e-15c7fe1ef74c service nova] Creating event network-vif-plugged:b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6 for instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 on nch1-master-1 Jul 30 21:28:33.943972 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-975ce5de-ca15-4e55-aaa7-227ed5242911 req-1a6260fe-4093-46fa-ab6e-15c7fe1ef74c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092804 Jul 30 21:28:33.946744 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2616/5193] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:28:33.997447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e33c0fc7-88fd-4d0b-9fb2-71f3436c1ce7 req-c36b6c4e-159e-4e26-a92d-ff91c8a72b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:34.029804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e33c0fc7-88fd-4d0b-9fb2-71f3436c1ce7 req-c36b6c4e-159e-4e26-a92d-ff91c8a72b1a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:34.030672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e33c0fc7-88fd-4d0b-9fb2-71f3436c1ce7 req-c36b6c4e-159e-4e26-a92d-ff91c8a72b1a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:34.059561 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e33c0fc7-88fd-4d0b-9fb2-71f3436c1ce7 req-c36b6c4e-159e-4e26-a92d-ff91c8a72b1a service nova] Creating event network-changed:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:34.076428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e33c0fc7-88fd-4d0b-9fb2-71f3436c1ce7 req-c36b6c4e-159e-4e26-a92d-ff91c8a72b1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125267 Jul 30 21:28:34.079602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2617/5194] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:34.394491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:34.395446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:34.414417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:34.415325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:34.416287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:34.416742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:35.053193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:35.064113 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-336443ce-d1e3-4096-92c9-ad85a70ee17e tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1314 microversion: 2.1 time: 0.673120 Jul 30 21:28:35.065285 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2618/5195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:34 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:36.093096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:36.094576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:36.113281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:36.124936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:36.130497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:36.130869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:36.814131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:36.827525 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7505a72e-a358-415f-b64a-d944a4c2eba6 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1497 microversion: 2.1 time: 0.738104 Jul 30 21:28:36.828170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2619/5196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:36 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1497 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:28:37.259266 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92861b36-0cd4-442a-a916-81d9bfa2125f tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.469307 Jul 30 21:28:37.260859 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2578/5197] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Jul 30 21:28:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:37.273349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.230"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:37.276875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:37.304015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:37.304485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:37.305283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:37.305735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:37.386767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Acquired lock "refresh_cache-e02359bc-4b1b-45a4-8847-588408920293" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:28:40.407451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Building network info cache for instance {{(pid=130984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:28:40.421105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-556e4409-6cb5-457a-8e9b-09e0cbb5c401 req-555284e5-a870-49ed-8623-860bb3ad4f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:40.450453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-556e4409-6cb5-457a-8e9b-09e0cbb5c401 req-555284e5-a870-49ed-8623-860bb3ad4f9c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:40.451572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-556e4409-6cb5-457a-8e9b-09e0cbb5c401 req-555284e5-a870-49ed-8623-860bb3ad4f9c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:40.486237 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-556e4409-6cb5-457a-8e9b-09e0cbb5c401 req-555284e5-a870-49ed-8623-860bb3ad4f9c service nova] Creating event network-changed:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:40.501486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-556e4409-6cb5-457a-8e9b-09e0cbb5c401 req-555284e5-a870-49ed-8623-860bb3ad4f9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086063 Jul 30 21:28:40.512658 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2579/5198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:40.572813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:40.573693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:40.601748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:40.605491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:40.606903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:40.607626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:40.693318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:28:40.886909 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-575f6f2a-e447-4b09-8f41-52e77d0e3a77 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 204 len: 0 microversion: 2.1 time: 0.323368 Jul 30 21:28:40.891078 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2580/5199] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:28:40 2022] DELETE /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:28:40.912292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:40.918694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:40.934586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:40.938095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:40.942969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:40.943764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:41.778741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:41.790217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-55219e8c-8bb3-4cc0-aed6-081c49fb9c04 tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1503 microversion: 2.1 time: 0.896373 Jul 30 21:28:41.790829 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2581/5200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:40 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1503 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:42.142111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Updating instance_info_cache with network_info: [{"id": "6969752c-afb9-477f-9a07-172243359b48", "address": "fa:16:3e:ff:17:f9", "network": {"id": "55b47edb-6a14-4bd0-b1ff-310f5e575d8b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-245617125-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "837cee2339bd4feb9a571b38c0577add", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6969752c-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:28:42.164978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Releasing lock "refresh_cache-e02359bc-4b1b-45a4-8847-588408920293" {{(pid=130984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:28:42.166202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f03dc624-1928-48a6-b011-6abb6cb63ca7 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action" status: 202 len: 0 microversion: 2.1 time: 4.896843 Jul 30 21:28:42.167414 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2620/5201] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:28:37 2022] POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action => generated 0 bytes in 4898 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 30 21:28:42.176152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.230"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:42.817259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:42.818171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:42.836846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:42.837362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:42.838225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:42.838646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:43.324267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:43.334850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:43.336345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:43.338151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:43.339499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:43.417303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db01f9802e8147b8bdabfc9bbbbd7bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418ff359f7a747e58ae4fdf0c4b7072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:43.424020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:43.430639 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b52219d1-620b-49dc-aac6-7c65e61860ce tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 200 len: 1503 microversion: 2.1 time: 0.617740 Jul 30 21:28:43.433308 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2621/5202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:42 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 1503 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:43.453797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e83b1240-7939-4f55-9d60-cc18b635076b req-b2109950-4a3e-4e61-817a-b998e1d1aa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42ff5b5-402f-4eba-ba75-6fe636f6aaf7", "name": "network-vif-deleted", "tag": "b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:43.464319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=34 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:43.466274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e83b1240-7939-4f55-9d60-cc18b635076b req-b2109950-4a3e-4e61-817a-b998e1d1aa8f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:43.466865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e83b1240-7939-4f55-9d60-cc18b635076b req-b2109950-4a3e-4e61-817a-b998e1d1aa8f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:43.515336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e83b1240-7939-4f55-9d60-cc18b635076b req-b2109950-4a3e-4e61-817a-b998e1d1aa8f service nova] Creating event network-vif-deleted:b6f3d091-f0e4-4f1c-83ed-219f9c9ac3a6 for instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 on nch1-master-1 Jul 30 21:28:43.532323 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e83b1240-7939-4f55-9d60-cc18b635076b req-b2109950-4a3e-4e61-817a-b998e1d1aa8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083119 Jul 30 21:28:43.535200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2622/5203] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:44.245151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Acquired lock "refresh_cache-e02359bc-4b1b-45a4-8847-588408920293" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 21:28:44.455575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:44.457019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] [instance: d42ff5b5-402f-4eba-ba75-6fe636f6aaf7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:44.506156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:44.506672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:44.510416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:44.510930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:44.536720 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] HTTP exception thrown: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Request method failure captured: Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 HTTP/1.1 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aJxugKaZtm4-dWvVhb-qEGwUJtAD3J2SZ7__PSPfC-lsls4A8jTgMG8htlG-49pMfMeMPcZJsGvm5xqwNQmrzWrQp1TqemhXGooVZIip7fJOmqbnRTzwvlqXL-wXuTen2j8VRZIgbox7U6uLoJsyqAOQUM0HDD8lBcDpLI6KnoWYCw Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 418ff359f7a747e58ae4fdf0c4b7072a Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesActionsTest-1856691178 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/418ff359f7a747e58ae4fdf0c4b7072a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_418ff359f7a747e58ae4fdf0c4b7072a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/418ff359f7a747e58ae4fdf0c4b7072a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/418ff359f7a747e58ae4fdf0c4b7072a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesActionsTest-1856691178 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 418ff359f7a747e58ae4fdf0c4b7072a Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesActionsTest-1856691178 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesActionsTest-1856691178-project Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: db01f9802e8147b8bdabfc9bbbbd7bb3 Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesActionsTest-1856691178-project Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'd42ff5b5-402f-4eba-ba75-6fe636f6aaf7'} Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:28:44.539127 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. Jul 30 21:28:44.545621 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:44.546910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] Returning 404 to user: Instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:28:44.548616 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-133245b5-edca-493c-b5ac-9d4114e83c1c tempest-VolumesActionsTest-1856691178 tempest-VolumesActionsTest-1856691178-project] 10.222.0.17 "GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7" status: 404 len: 111 microversion: 2.1 time: 0.098093 Jul 30 21:28:44.549689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2623/5204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:44 2022] GET /compute/v2.1/servers/d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:28:45.312964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Building network info cache for instance {{(pid=130983) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 30 21:28:45.320400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:45.324809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6d03eda9-a976-4d3c-962c-6f1364fdb6e6 req-a2d9485e-78a6-4261-8112-642c1dfaa0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:45.343653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d03eda9-a976-4d3c-962c-6f1364fdb6e6 req-a2d9485e-78a6-4261-8112-642c1dfaa0a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:45.344396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6d03eda9-a976-4d3c-962c-6f1364fdb6e6 req-a2d9485e-78a6-4261-8112-642c1dfaa0a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:45.360159 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6d03eda9-a976-4d3c-962c-6f1364fdb6e6 req-a2d9485e-78a6-4261-8112-642c1dfaa0a7 service nova] Creating event network-changed:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:45.366918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6d03eda9-a976-4d3c-962c-6f1364fdb6e6 req-a2d9485e-78a6-4261-8112-642c1dfaa0a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047819 Jul 30 21:28:45.368829 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2624/5205] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:46.636170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Updating instance_info_cache with network_info: [{"id": "6969752c-afb9-477f-9a07-172243359b48", "address": "fa:16:3e:ff:17:f9", "network": {"id": "55b47edb-6a14-4bd0-b1ff-310f5e575d8b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-245617125-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "837cee2339bd4feb9a571b38c0577add", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6969752c-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130983) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 30 21:28:46.662212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Releasing lock "refresh_cache-e02359bc-4b1b-45a4-8847-588408920293" {{(pid=130983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 21:28:46.663143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5a77130-f1d4-456b-b742-57be3bc6e392 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action" status: 202 len: 0 microversion: 2.1 time: 4.491714 Jul 30 21:28:46.664008 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2582/5206] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:28:42 2022] POST /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293/action => generated 0 bytes in 4493 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 30 21:28:46.677836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4db37b07-1e36-46b8-ac8a-c154edd0c9b4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '.version_select at 0x7fbb5ce2d430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:49.574472 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4db37b07-1e36-46b8-ac8a-c154edd0c9b4 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/75e5d24c-b703-4c6f-ac5e-4deb727264c8" status: 202 len: 0 microversion: 2.1 time: 2.905648 Jul 30 21:28:49.575121 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2625/5207] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Jul 30 21:28:46 2022] DELETE /compute/v2.1/os-floating-ips/75e5d24c-b703-4c6f-ac5e-4deb727264c8 => generated 0 bytes in 2907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:28:49.587414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3913f311-6a48-4772-be81-1f7ef76014b1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '.version_select at 0x7fbb5d6b40d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:49.991422 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3913f311-6a48-4772-be81-1f7ef76014b1 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2fcca0bf-50cd-451b-8a30-3ede6e0ef444" status: 202 len: 0 microversion: 2.1 time: 0.411107 Jul 30 21:28:50.005690 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2583/5208] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 21:28:49 2022] DELETE /compute/v2.1/os-security-groups/2fcca0bf-50cd-451b-8a30-3ede6e0ef444 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:28:50.016983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:50.018584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:50.035942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:50.036788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:50.038016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:50.038930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:50.085271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:28:50.268654 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b34f84f-4d4c-47e6-bf1b-d94a452e86cb tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 204 len: 0 microversion: 2.1 time: 0.268903 Jul 30 21:28:50.271544 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2626/5209] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:28:49 2022] DELETE /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:28:50.286387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:50.286817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:50.288830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:50.307030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:50.307030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:50.307030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:50.307030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:50.625953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:50.644489 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7d5f97f-6d82-442a-88b9-daf21c37540b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1509 microversion: 2.1 time: 0.365345 Jul 30 21:28:50.645871 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2584/5210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:50 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1509 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:51.670421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:51.672263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:51.688854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:51.692397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:51.693819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:51.694341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:52.009392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:52.021357 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d6311d5-50e7-4aaf-a121-1961bfd631a6 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1509 microversion: 2.1 time: 0.358284 Jul 30 21:28:52.023028 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2627/5211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:51 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:53.047149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:53.048766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:53.068532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:53.070513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:53.072416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:53.073094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:54.076814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:54.091104 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-735a5b02-9f32-470c-9896-8b0676298e2e tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1509 microversion: 2.1 time: 1.051308 Jul 30 21:28:54.095629 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2585/5212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:53 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1509 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:55.037245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-03f0bf40-85bb-4dc8-bfbd-f70ad05f08ce req-a8f80501-8b4b-4004-8871-c6d6f81d72b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02359bc-4b1b-45a4-8847-588408920293", "name": "network-vif-deleted", "tag": "6969752c-afb9-477f-9a07-172243359b48"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:28:55.080767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-03f0bf40-85bb-4dc8-bfbd-f70ad05f08ce req-a8f80501-8b4b-4004-8871-c6d6f81d72b6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:55.081750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-03f0bf40-85bb-4dc8-bfbd-f70ad05f08ce req-a8f80501-8b4b-4004-8871-c6d6f81d72b6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:55.104732 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-03f0bf40-85bb-4dc8-bfbd-f70ad05f08ce req-a8f80501-8b4b-4004-8871-c6d6f81d72b6 service nova] Creating event network-vif-deleted:6969752c-afb9-477f-9a07-172243359b48 for instance e02359bc-4b1b-45a4-8847-588408920293 on nch2-master-1 Jul 30 21:28:55.111791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-03f0bf40-85bb-4dc8-bfbd-f70ad05f08ce req-a8f80501-8b4b-4004-8871-c6d6f81d72b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079308 Jul 30 21:28:55.112998 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2628/5213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:28:55.139426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:55.150674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:55.177067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:55.177992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:55.179281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:55.180265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:55.337300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b99eba81444a7b9cc59e73898c65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cee2339bd4feb9a571b38c0577add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:28:55.346430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b9ad8eae-2b82-42eb-9e21-c027ad71bc7b tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 200 len: 1294 microversion: 2.1 time: 0.230128 Jul 30 21:28:55.359736 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2586/5214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:55 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 1294 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:28:56.370433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:28:56.371158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] [instance: e02359bc-4b1b-45a4-8847-588408920293] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:28:56.396628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:56.404067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:56.405197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:28:56.405658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:28:56.451871 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] HTTP exception thrown: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Request method failure captured: Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 HTTP/1.1 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aJNo2bOwlKv6xuEV6ZEGFSsKQnDs9CZ4OAXOohyN4Dvz6RfdENBg0MAb3AaTBbg0M8iRqjoarCXLxCMUJ0PIrItZUw70fegFj2XmATGGGNCj5aV29fHVM3OF-r4QU2ExlwTT19nnmVt1zhRE9WrNaa61tj4Fcrg05zkq1xvrXqpzdk Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 837cee2339bd4feb9a571b38c0577add Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2124216302 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/837cee2339bd4feb9a571b38c0577add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_837cee2339bd4feb9a571b38c0577add", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/837cee2339bd4feb9a571b38c0577add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/837cee2339bd4feb9a571b38c0577add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2124216302 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 837cee2339bd4feb9a571b38c0577add Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2124216302 Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerRescueTestJSONUnderV235-2124216302-project Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c5b99eba81444a7b9cc59e73898c65af Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2124216302-project Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e02359bc-4b1b-45a4-8847-588408920293'} Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:56.462230 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:28:56.465947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] Returning 404 to user: Instance e02359bc-4b1b-45a4-8847-588408920293 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:28:56.467317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0aaff51-b2cd-4031-8cd3-ee06210093a8 tempest-ServerRescueTestJSONUnderV235-2124216302 tempest-ServerRescueTestJSONUnderV235-2124216302-project] 10.222.0.17 "GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293" status: 404 len: 111 microversion: 2.1 time: 0.100975 Jul 30 21:28:56.474739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2629/5215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:28:56 2022] GET /compute/v2.1/servers/e02359bc-4b1b-45a4-8847-588408920293 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:29:14.733446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=5 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:14.734215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=21,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:15.098616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0de5347-d0fb-476a-98ae-e9535cc30f2f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: .version_select at 0x7fbb5d78ac10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1122464873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqpXrZ3KaOKaEOXKZBStznkeKm2twwRtFej1xoXXVF3fDev9RdG4bo5GdxWFAFW1OFe3mhEst1XhOzhx8ck3vF70rzV/8VZf/LVMzGj1h3K8qvNSSVeLQR44I4/uA9j/A=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:15.143961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a0de5347-d0fb-476a-98ae-e9535cc30f2f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:29:15.162164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-a0de5347-d0fb-476a-98ae-e9535cc30f2f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:29:15.219912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0de5347-d0fb-476a-98ae-e9535cc30f2f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.491897 Jul 30 21:29:15.220876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2587/5216] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:29:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:29:22.856810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:22.857570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:23.102184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-899414067", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b11f0dc3-39a6-41da-8dc0-6a660423fe58"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:23.221606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] validate_networks() for [('b11f0dc3-39a6-41da-8dc0-6a660423fe58', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:29:24.491637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:29:24.492219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:29:24.492701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:29:24.493207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:29:24.493667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:29:24.536462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:24.537072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:24.538020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:24.538483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:24.586048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Getting quotas for project d54b597e808b4b8594adb5db00e45030. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:29:24.603859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Getting quotas for user f1b1a5390fd6434f86e89125cd4b324c and project d54b597e808b4b8594adb5db00e45030. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:29:24.639946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:29:24.644154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:29:24.821960 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e1ca7c2b-b461-4e55-adf1-ad13d30846d7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.965738 Jul 30 21:29:24.823137 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2630/5217] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 30 21:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 21:29:24.836358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:24.837008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:25.045187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:25.066198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:25.076635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:25.083834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-49f112c6-6cca-4480-b234-4057be3139f6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1261 microversion: 2.26 time: 0.253028 Jul 30 21:29:25.087522 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2588/5218] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:24 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:26.116017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:26.116835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:26.138076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:26.139601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:26.140797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:26.142400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:26.454580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:26.468604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:26.474693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:26.474693 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1f4774f-b71f-4284-81e7-d1a6df944f69 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1257 microversion: 2.26 time: 0.362336 Jul 30 21:29:26.476606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2631/5219] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:26 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1257 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:27.505778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:27.507017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:27.534725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:27.535199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:27.536258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:27.536735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:27.845311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:27.875010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:27.887186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:27.898598 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b29c378d-7c58-485b-a2a0-3a41421a5ffe tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1319 microversion: 2.26 time: 0.397729 Jul 30 21:29:27.901979 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2589/5220] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:27 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:28.928426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:28.929059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:28.941139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:28.941616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:28.942430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:28.942891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:29.179909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:29.191685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:29.199915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:29.201559 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3701f1ed-9205-4109-bebe-7c5ed36a0fb3 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1319 microversion: 2.26 time: 0.277117 Jul 30 21:29:29.202626 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2632/5221] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:28 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:30.224539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:30.225305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:30.255248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:30.255776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:30.256669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:30.257170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:31.302678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:31.333278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:31.340629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:31.341902 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5a90ee7-a79b-47dc-8518-c9369fb2379c tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 1.121216 Jul 30 21:29:31.345023 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2590/5222] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:30 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:32.365867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:32.366602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:32.378481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:32.378952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:32.379859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:32.380317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:32.756976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aec18d66-f8db-49b5-b49c-758345fbae17 req-d9d8f03b-5d50-4a03-bbff-c7bf599ef869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de7660a-1da4-4c52-a776-b3df24b5bfbc", "tag": "1376c914-3677-4e73-9f06-273be147d1ea"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:32.798239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aec18d66-f8db-49b5-b49c-758345fbae17 req-d9d8f03b-5d50-4a03-bbff-c7bf599ef869 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:32.816927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aec18d66-f8db-49b5-b49c-758345fbae17 req-d9d8f03b-5d50-4a03-bbff-c7bf599ef869 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:32.861101 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aec18d66-f8db-49b5-b49c-758345fbae17 req-d9d8f03b-5d50-4a03-bbff-c7bf599ef869 service nova] Creating event network-changed:1376c914-3677-4e73-9f06-273be147d1ea for instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc on nch2-master-1 Jul 30 21:29:32.879520 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aec18d66-f8db-49b5-b49c-758345fbae17 req-d9d8f03b-5d50-4a03-bbff-c7bf599ef869 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122680 Jul 30 21:29:32.890566 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2591/5223] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:29:32.969418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:33.001168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:33.010116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:33.017144 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57bc8f3e-d2de-46ca-b824-9a9fa827dcb4 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 0.652145 Jul 30 21:29:33.019314 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2633/5224] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:32 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:34.046106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:34.046840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:34.062300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:34.062812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:34.063648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:34.064743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:34.744563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:34.760563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:34.770655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:34.777274 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-391f6679-eb4f-4f90-97b6-73219e480d34 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 0.736908 Jul 30 21:29:34.780984 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2592/5225] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:34 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:35.810059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:35.811911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:35.820942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:35.824339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:35.840537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:35.841337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:35.842545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:35.844365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:36.244705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:36.257593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:36.260021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:36.262627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-368eab2c-fae5-4f8d-8316-d371ac44b722 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 0.460036 Jul 30 21:29:36.271691 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2634/5226] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:35 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:36.609297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-303991560", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "e4c38103-46a8-4d78-89ba-d9e0add08b69"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1122464873", "security_groups": [{"name": "tempest-secgroup-smoke-654096317"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:36.621837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:37.060161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] validate_networks() for [('e4c38103-46a8-4d78-89ba-d9e0add08b69', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:29:37.285777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:37.287269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:37.300972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:37.301607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:37.302523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:37.304714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:37.762571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:37.777033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:37.778939 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:37.780918 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-07137762-6e9f-4793-a781-769de7bb5b98 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 0.499030 Jul 30 21:29:37.799236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2635/5227] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:37 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 21:29:38.066300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:29:38.066823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:29:38.067211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:29:38.067685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:29:38.068116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:29:38.080786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:38.081251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:38.082075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:38.082553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:38.174203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:29:38.186033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:29:38.221288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:29:38.226343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:29:38.312077 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eaf3522e-c77f-4c33-9785-4a8a75800319 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.707471 Jul 30 21:29:38.321557 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2593/5228] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:29:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:29:38.331252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8510064-15e5-46dc-bdc1-808d52a65ced tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:38.332424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8510064-15e5-46dc-bdc1-808d52a65ced tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:38.613088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b56a6865-4552-473f-92d6-4708ca6f1a80 req-4b4544fc-9a7f-4adb-a0cf-9075aaa77496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de7660a-1da4-4c52-a776-b3df24b5bfbc", "name": "network-vif-plugged", "status": "completed", "tag": "1376c914-3677-4e73-9f06-273be147d1ea"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:38.633582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c8510064-15e5-46dc-bdc1-808d52a65ced tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:38.646374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b56a6865-4552-473f-92d6-4708ca6f1a80 req-4b4544fc-9a7f-4adb-a0cf-9075aaa77496 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:38.654380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b56a6865-4552-473f-92d6-4708ca6f1a80 req-4b4544fc-9a7f-4adb-a0cf-9075aaa77496 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:38.661175 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8510064-15e5-46dc-bdc1-808d52a65ced tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1266 microversion: 2.1 time: 0.335807 Jul 30 21:29:38.668227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2636/5229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:38 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:38.684311 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b56a6865-4552-473f-92d6-4708ca6f1a80 req-4b4544fc-9a7f-4adb-a0cf-9075aaa77496 service nova] Creating event network-vif-plugged:1376c914-3677-4e73-9f06-273be147d1ea for instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc on nch2-master-1 Jul 30 21:29:38.691421 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b56a6865-4552-473f-92d6-4708ca6f1a80 req-4b4544fc-9a7f-4adb-a0cf-9075aaa77496 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085653 Jul 30 21:29:38.692068 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2594/5230] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:29:38.809807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:38.812177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:38.832136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:38.844262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:38.848353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:38.867935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:39.376146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:39.401479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:39.407980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:39.411911 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fadcca1c-74af-4922-ab45-ac66f46effc1 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1361 microversion: 2.26 time: 0.608505 Jul 30 21:29:39.415049 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2637/5231] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:38 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1361 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:39.689035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:39.689753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:39.702580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:39.703065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:39.708236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:39.708849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:39.912203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:39.924259 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e7b0be7-2dbc-4c46-a093-a1d0ee142680 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1318 microversion: 2.1 time: 0.239459 Jul 30 21:29:39.924880 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2595/5232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:39 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:40.440803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:40.443692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:40.460616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:40.461088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:40.461897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:40.462352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:40.948831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:40.950275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:40.961890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:40.964722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:40.967147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:40.968652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.081542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:41.092484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:41.094299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:41.096299 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0eb164d0-fd6e-46b8-b83f-cb6a40d8897a tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1544 microversion: 2.26 time: 0.662482 Jul 30 21:29:41.097040 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2638/5233] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:40 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1544 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:41.120384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5c655dc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:41.131267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:41.132773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.133446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:41.141139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:41.141692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.142531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:41.143172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.184771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:41.185444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.209279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:41.209788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:41.214112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:41.228040 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e48d6a7e-9720-42ae-83ba-2cbe6e2da405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1324 microversion: 2.1 time: 0.284618 Jul 30 21:29:41.230289 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2596/5234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:40 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:41.271438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:41.312775 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [80e8d282-07b1-46e7-bcd1-da916266dcd9] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 21:29:42.258977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.260654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:42.272504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.275911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.281445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.282102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.324991 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [80e8d282-07b1-46e7-bcd1-da916266dcd9] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38436. Jul 30 21:29:42.331947 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28c9870f-8f80-4a7b-809d-e41eddef4455 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-2115502191" status: 201 len: 0 microversion: 2.26 time: 1.216118 Jul 30 21:29:42.336952 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2639/5235] 10.222.0.17 () {62 vars in 1380 bytes} [Sat Jul 30 21:29:41 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-2115502191 => generated 0 bytes in 1218 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 30 21:29:42.343391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-204c82d5-377b-45fc-9ee6-a8f9e0dba93b tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fec8160>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.372863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204c82d5-377b-45fc-9ee6-a8f9e0dba93b tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.379061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-204c82d5-377b-45fc-9ee6-a8f9e0dba93b tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.414214 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-204c82d5-377b-45fc-9ee6-a8f9e0dba93b tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-2115502191" status: 204 len: 0 microversion: 2.26 time: 0.075736 Jul 30 21:29:42.419315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2640/5236] 10.222.0.17 () {60 vars in 1361 bytes} [Sat Jul 30 21:29:42 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-2115502191 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:42.429796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fe8daf0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.442487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.449019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.451437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:42.461643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.464841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.466865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.467428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.517902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.519162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.544818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:42.567832 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55d7b289-a3bd-46e4-95c9-314175d198ff tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 204 len: 0 microversion: 2.26 time: 0.143965 Jul 30 21:29:42.569929 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2641/5237] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Jul 30 21:29:42 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 30 21:29:42.582187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-36c3244d-6a6d-4f2c-94b0-94e9245aee10 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fec8e50>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.600139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c3244d-6a6d-4f2c-94b0-94e9245aee10 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.600933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36c3244d-6a6d-4f2c-94b0-94e9245aee10 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.624721 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-36c3244d-6a6d-4f2c-94b0-94e9245aee10 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 12 microversion: 2.26 time: 0.049122 Jul 30 21:29:42.627390 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2642/5238] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Jul 30 21:29:42 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:42.639943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fe8d940>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.653242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.654076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.655508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:42.663258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.663958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.665446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.665933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.672070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:42.686120 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fcfd40e8-8720-4751-a90c-97c6221d605c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.431150 Jul 30 21:29:42.687364 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2597/5239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:42 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:42.718328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.718903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.731853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.733337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.773725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:42.800336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21cfd16e-b1c7-4ec3-b5a8-fd3f56e24cee tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1663203158" status: 201 len: 0 microversion: 2.26 time: 0.166037 Jul 30 21:29:42.802076 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2643/5240] 10.222.0.17 () {62 vars in 1380 bytes} [Sat Jul 30 21:29:42 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1663203158 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 30 21:29:42.813249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d28a1701-3429-4c51-9377-9a68ddc9f120 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d6a6940>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.826314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28a1701-3429-4c51-9377-9a68ddc9f120 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.826893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d28a1701-3429-4c51-9377-9a68ddc9f120 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.860196 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d28a1701-3429-4c51-9377-9a68ddc9f120 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 36 microversion: 2.26 time: 0.051983 Jul 30 21:29:42.862307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2598/5241] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Jul 30 21:29:42 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 36 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:42.880954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb62883a60>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:42.904004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.905280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.908596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:42.921658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.922230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.923239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.923761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.967807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:42.968668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:42.980400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:43.031960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.052420 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b9c4e5a-7be4-48c2-9354-a32e93aefda5 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1663203158" status: 204 len: 0 microversion: 2.26 time: 0.183452 Jul 30 21:29:43.053988 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2644/5242] 10.222.0.17 () {60 vars in 1364 bytes} [Sat Jul 30 21:29:42 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1663203158 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:43.062847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a97ec51-0d5a-4ef7-a2c1-72b15290ab65 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d7349d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.070724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a97ec51-0d5a-4ef7-a2c1-72b15290ab65 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.071265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a97ec51-0d5a-4ef7-a2c1-72b15290ab65 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.082363 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a97ec51-0d5a-4ef7-a2c1-72b15290ab65 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 12 microversion: 2.26 time: 0.023835 Jul 30 21:29:43.083080 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2599/5243] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Jul 30 21:29:43 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:43.101760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d6d1430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.112032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.112543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.113759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.121458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.121644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.122337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.123009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.153822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.156338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.179648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.212449 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-029cf6d7-bef1-4294-a064-f98ff1d760ac tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 204 len: 0 microversion: 2.26 time: 0.119034 Jul 30 21:29:43.216167 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2645/5244] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Jul 30 21:29:43 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:43.228567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d656a60>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.256763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.257262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.258775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.268697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.269844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.270683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.271607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.306692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.307437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.338358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.341134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.392083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.415003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c1bbf826-4afb-41af-8d86-84d47dfa5cf6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1313696000" status: 201 len: 0 microversion: 2.26 time: 0.191255 Jul 30 21:29:43.416604 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2600/5245] 10.222.0.17 () {62 vars in 1380 bytes} [Sat Jul 30 21:29:43 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-1313696000 => generated 0 bytes in 194 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 30 21:29:43.430144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fe3cca0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.445844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.446776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.447543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.455932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.456469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.457279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.457895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.494523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.494997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.506457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.506929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.533949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.551145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6dde48ee-c152-476b-9413-c0da0ef5aafa tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-724948598" status: 201 len: 0 microversion: 2.26 time: 0.126389 Jul 30 21:29:43.551886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2646/5246] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Jul 30 21:29:43 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-724948598 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 30 21:29:43.568249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5da573a0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.581269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.582020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.583166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.591458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.592248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.593453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.594397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.631094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.631643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.653629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.671696 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-acf37e97-d41e-48da-9a72-858a166bb3ed tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 204 len: 0 microversion: 2.26 time: 0.112517 Jul 30 21:29:43.672419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2601/5247] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Jul 30 21:29:43 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:43.686216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-670f9032-8b2a-490f-b63f-639da87d02e6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fe3c280>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.701713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-670f9032-8b2a-490f-b63f-639da87d02e6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.702189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-670f9032-8b2a-490f-b63f-639da87d02e6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.711928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.712865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.714752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-670f9032-8b2a-490f-b63f-639da87d02e6 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 12 microversion: 2.26 time: 0.036233 Jul 30 21:29:43.716023 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2647/5248] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Jul 30 21:29:43 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:43.729564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb4fe3c4c0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.745675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.746274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.746788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.756706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.757176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.758571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.758796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.759026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.759362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.760292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.761984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.799943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.799943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.822929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:43.858249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dccd558c-2a96-4970-a82d-26c2a6125c52 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 204 len: 0 microversion: 2.26 time: 0.136335 Jul 30 21:29:43.858926 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2648/5249] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Jul 30 21:29:43 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 30 21:29:43.871192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb62883820>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:43.890820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.898014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.898667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:43.905016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.905560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.906637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.907327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.938309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.939012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.949371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:43.950064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:43.991337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:44.047442 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-05226578-7069-45a4-9550-cb562a7ebbe7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-266635493" status: 201 len: 0 microversion: 2.26 time: 0.180752 Jul 30 21:29:44.048309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2649/5250] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Jul 30 21:29:43 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-266635493 => generated 0 bytes in 182 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 30 21:29:44.059711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d3895e0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:44.085965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.086714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.087225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:44.094240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.094810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.095990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.096571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.097946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:44.110074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-485288c8-7e00-4999-b51d-aef0ebd36268 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.402999 Jul 30 21:29:44.115809 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2602/5251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:43 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:44.200778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.201254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.219222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.219791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.264177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:44.285899 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27dc79ce-31c4-4927-9d5f-5874bdffabbd tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-975081412" status: 201 len: 0 microversion: 2.26 time: 0.231756 Jul 30 21:29:44.286649 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2650/5252] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Jul 30 21:29:44 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags/tempest-tag-975081412 => generated 0 bytes in 233 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 30 21:29:44.302922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Action: 'update_all', calling method: .version_select at 0x7fbb5d6b48b0>, body: {"tags": ["tempest-tag-1253013712", "tempest-tag-1901434926"]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:44.337592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.338360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.340546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:44.357113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.360333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.362420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.364662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.440656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.441206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.489036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:44.494402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-48fa7dd8-4615-4fc6-9e64-49b22b35e1ee req-da829c7e-fadf-4385-9a6b-f417cf94f6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:44.530376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-48fa7dd8-4615-4fc6-9e64-49b22b35e1ee req-da829c7e-fadf-4385-9a6b-f417cf94f6c9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.530890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-48fa7dd8-4615-4fc6-9e64-49b22b35e1ee req-da829c7e-fadf-4385-9a6b-f417cf94f6c9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.539074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ff15de7-c477-4893-a991-8677d27a607f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 62 microversion: 2.26 time: 0.246456 Jul 30 21:29:44.540265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2603/5253] 10.222.0.17 () {62 vars in 1312 bytes} [Sat Jul 30 21:29:44 2022] PUT /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 62 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:44.557666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4628b491-5597-4555-a2cb-0e273819612f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d1620d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:44.585340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4628b491-5597-4555-a2cb-0e273819612f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.585340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4628b491-5597-4555-a2cb-0e273819612f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.603484 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-48fa7dd8-4615-4fc6-9e64-49b22b35e1ee req-da829c7e-fadf-4385-9a6b-f417cf94f6c9 service nova] Creating event network-changed:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch1-master-1 Jul 30 21:29:44.604964 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4628b491-5597-4555-a2cb-0e273819612f tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 200 len: 62 microversion: 2.26 time: 0.057727 Jul 30 21:29:44.611157 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2604/5254] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Jul 30 21:29:44 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 62 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:44.615598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-48fa7dd8-4615-4fc6-9e64-49b22b35e1ee req-da829c7e-fadf-4385-9a6b-f417cf94f6c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125297 Jul 30 21:29:44.616500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2651/5255] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:29:44.624942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '.version_select at 0x7fbb5d7e3550>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:44.633309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.633790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.634296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:44.650579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.651041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.652963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.653426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.693764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.694482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.711568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:44.732800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'flavor' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:44.751697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8b33849-02f0-4891-b75b-0d93849cce82 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags" status: 204 len: 0 microversion: 2.26 time: 0.138186 Jul 30 21:29:44.752643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2605/5256] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Jul 30 21:29:44 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc/tags => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:44.763614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:44.764055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:44.770755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.771485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.772862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.773742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.805008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:29:44.914303 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7161755-c2b8-482a-b28d-4c17f7637c94 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 204 len: 0 microversion: 2.26 time: 0.155696 Jul 30 21:29:44.915163 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2652/5257] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 30 21:29:44 2022] DELETE /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 21:29:44.924496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:44.926181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:44.929678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:44.936782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.938689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:44.940155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:44.941090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:45.145821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:45.146586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:45.183441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:45.184299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:45.190177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:45.192459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:45.222790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:45.239918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:45.244467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:45.250346 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67cc806f-9470-4344-8069-baae9e492684 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1550 microversion: 2.26 time: 0.328885 Jul 30 21:29:45.252327 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2606/5258] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:44 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1550 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:45.509448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:45.517845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:45.531476 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7a752b2-d33b-4dae-a2f8-1bda681636a2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.402093 Jul 30 21:29:45.532585 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2653/5259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:45 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:46.275941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:46.277896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:46.287179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:46.291681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:46.292968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:46.293692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:46.555999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:46.559563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:46.578890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:46.579481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:46.582273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:46.585349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:46.801426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:46.817142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:46.821548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:46.824546 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02fc34d7-b02b-4c57-a58f-cbe8959d2ca7 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1550 microversion: 2.26 time: 0.552458 Jul 30 21:29:46.826246 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2607/5260] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:46 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1550 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:46.871859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:46.881752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd4c9be3-67ec-4d7f-975e-3a79b9c51a33 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.331757 Jul 30 21:29:46.882982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2654/5261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:46 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:47.556713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9dfec131-57dc-4e24-9f9c-6969a0fbd300 req-b2963b39-aebc-4a47-8635-6510745141fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de7660a-1da4-4c52-a776-b3df24b5bfbc", "name": "network-vif-deleted", "tag": "1376c914-3677-4e73-9f06-273be147d1ea"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:47.583465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9dfec131-57dc-4e24-9f9c-6969a0fbd300 req-b2963b39-aebc-4a47-8635-6510745141fb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:47.583934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9dfec131-57dc-4e24-9f9c-6969a0fbd300 req-b2963b39-aebc-4a47-8635-6510745141fb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:47.629408 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9dfec131-57dc-4e24-9f9c-6969a0fbd300 req-b2963b39-aebc-4a47-8635-6510745141fb service nova] Creating event network-vif-deleted:1376c914-3677-4e73-9f06-273be147d1ea for instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc on nch2-master-1 Jul 30 21:29:47.655059 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9dfec131-57dc-4e24-9f9c-6969a0fbd300 req-b2963b39-aebc-4a47-8635-6510745141fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101973 Jul 30 21:29:47.656214 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2608/5262] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:29:47.853332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:47.854052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:47.872864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:47.874522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:47.876861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:47.878466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:47.905686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:47.906646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:47.924393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:47.924880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:47.930938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:47.931444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:48.019867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:48.020421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:48.020918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lazy-loading 'fault' on Instance uuid 0de7660a-1da4-4c52-a776-b3df24b5bfbc {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:29:48.131157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:48.134149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.152410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:48.159807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1b1a5390fd6434f86e89125cd4b324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54b597e808b4b8594adb5db00e45030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:48.168154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6c13e0bf-3e56-40b2-b2fa-e197d41e8070 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 200 len: 1351 microversion: 2.26 time: 0.320767 Jul 30 21:29:48.175725 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2655/5263] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:47 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 1351 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 21:29:48.208408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:48.326091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:48.334771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f7195ae-a97d-4c17-b172-ce5c0d1ddf3c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.436367 Jul 30 21:29:48.336130 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2609/5264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:47 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:49.198609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:49.199864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] [instance: 0de7660a-1da4-4c52-a776-b3df24b5bfbc] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:49.203068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:49.218600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:49.219082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:49.228483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:49.231121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:49.280921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] HTTP exception thrown: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Request method failure captured: Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc HTTP/1.1 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aKyL9DfAmCEY0EAZuuWRfQQaHpVp2NWzAjyPMtDiAN3zyylXnXT6HG3U5QEuNVmVlnntmAk3kbuqyAv1vzXMJgIaq_xeyh9-rVyssjCZuf8ry88t6NQ5Izbro9MTbfLEgJJYHu0ANT35EmYgTDWwgZ2EMJl3YaXFdef_uEN7URc_eo Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Openstack-Nova-Api-Version: 2.26 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d54b597e808b4b8594adb5db00e45030 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerTagsTestJSON-1514943693 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d54b597e808b4b8594adb5db00e45030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d54b597e808b4b8594adb5db00e45030", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d54b597e808b4b8594adb5db00e45030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d54b597e808b4b8594adb5db00e45030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerTagsTestJSON-1514943693 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d54b597e808b4b8594adb5db00e45030 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerTagsTestJSON-1514943693 Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerTagsTestJSON-1514943693-project Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: f1b1a5390fd6434f86e89125cd4b324c Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerTagsTestJSON-1514943693-project Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0de7660a-1da4-4c52-a776-b3df24b5bfbc'} Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:29:49.282792 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:29:49.288061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] Returning 404 to user: Instance 0de7660a-1da4-4c52-a776-b3df24b5bfbc could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:29:49.289290 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af6ff497-f74f-412e-a8f0-f960b536a233 tempest-ServerTagsTestJSON-1514943693 tempest-ServerTagsTestJSON-1514943693-project] 10.222.0.17 "GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc" status: 404 len: 111 microversion: 2.26 time: 0.095943 Jul 30 21:29:49.290315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2656/5265] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 30 21:29:49 2022] GET /compute/v2.1/servers/0de7660a-1da4-4c52-a776-b3df24b5bfbc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:29:49.356976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:49.357947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:49.372267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:49.375065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:49.376826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:49.378422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:49.596179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8ab39b79-acbc-483b-a80c-899c6760c64e req-e8d2d0d5-0fbd-40dd-9024-5eef82750fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "name": "network-vif-plugged", "status": "completed", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:49.614858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ab39b79-acbc-483b-a80c-899c6760c64e req-e8d2d0d5-0fbd-40dd-9024-5eef82750fb2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:49.617508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8ab39b79-acbc-483b-a80c-899c6760c64e req-e8d2d0d5-0fbd-40dd-9024-5eef82750fb2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:49.639974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8ab39b79-acbc-483b-a80c-899c6760c64e req-e8d2d0d5-0fbd-40dd-9024-5eef82750fb2 service nova] Creating event network-vif-plugged:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch1-master-1 Jul 30 21:29:49.659271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8ab39b79-acbc-483b-a80c-899c6760c64e req-e8d2d0d5-0fbd-40dd-9024-5eef82750fb2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067421 Jul 30 21:29:49.661232 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2657/5266] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:29:49.680885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:49.713848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-12df4e41-712a-408f-aa5e-69d782241091 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.347991 Jul 30 21:29:49.720328 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2610/5267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:49 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:50.739895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:50.741018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:50.748226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:50.754775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:50.761706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:50.773232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:50.783999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:51.210017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-198011089", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:51.280128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:51.292776 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f98285ef-58e4-446d-be4b-6bae93737945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1391 microversion: 2.1 time: 0.559755 Jul 30 21:29:51.298811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2658/5268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:50 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1391 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:51.299183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:29:52.061048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:29:52.062067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:29:52.062769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:29:52.063380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:29:52.063817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:29:52.086928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.087453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:52.089522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.089990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:52.152801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Getting quotas for project 2430c3036ed74cea9b3d1a20b61f780e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:29:52.163714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Getting quotas for user 87902729a01b4918a07d61589f9c84da and project 2430c3036ed74cea9b3d1a20b61f780e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:29:52.196032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:29:52.199799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:29:52.281576 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-23acb8b9-6477-41c6-901a-f1273c271320 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076286 Jul 30 21:29:52.285384 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2611/5269] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:29:52.297550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c7d8a85-e3a2-4e9d-8607-625b707b6e94 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:52.298843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c7d8a85-e3a2-4e9d-8607-625b707b6e94 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:52.313449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:52.314490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:52.326194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.326790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:52.336183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.342028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:52.441603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c7d8a85-e3a2-4e9d-8607-625b707b6e94 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:52.449216 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c7d8a85-e3a2-4e9d-8607-625b707b6e94 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1214 microversion: 2.1 time: 0.156334 Jul 30 21:29:52.449813 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2659/5270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:52 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:52.709781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:52.719565 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-adcbb819-aa61-427e-a939-41618654ed0c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1564 microversion: 2.1 time: 0.409935 Jul 30 21:29:52.720152 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2612/5271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:52 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1564 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:52.747722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:52.748478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:52.772208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.773155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:52.776682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:52.777777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:53.145934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:53.158690 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26f30371-4e86-4e11-a2ad-623ad5896470 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1564 microversion: 2.1 time: 0.418982 Jul 30 21:29:53.160016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2660/5272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:52 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1564 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:53.471249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:53.471982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:53.482608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:53.486508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:53.489089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:53.490360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:53.659645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:53.667694 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-584d6370-cd91-4fb5-806d-e85009d61fcf tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1266 microversion: 2.1 time: 0.201288 Jul 30 21:29:53.668281 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2613/5273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:53 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:54.693287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:54.697188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:54.718897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:54.719481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:54.720358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:54.724626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:54.884199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:54.894195 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aad4818c-99d7-41e1-a3e9-f294b0080b18 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1272 microversion: 2.1 time: 0.208793 Jul 30 21:29:54.895399 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2661/5274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:54 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:55.917667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:55.918164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:55.940263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:55.941094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:55.942215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:55.942820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:56.314851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:56.339425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b843c08-c78a-49f0-9075-1d52ecb72c96 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.423814 Jul 30 21:29:56.340895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2614/5275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:55 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:29:56.412321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:56.412995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:56.433084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3c92ff55-1fd1-444a-9472-88484f3ddc56 req-1b0df62f-2ecc-4a4c-8ab6-0eab56c2620d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:56.464924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:56.465419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:56.474000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3c92ff55-1fd1-444a-9472-88484f3ddc56 req-1b0df62f-2ecc-4a4c-8ab6-0eab56c2620d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:56.480236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:56.481385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:56.488213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3c92ff55-1fd1-444a-9472-88484f3ddc56 req-1b0df62f-2ecc-4a4c-8ab6-0eab56c2620d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:56.522912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3c92ff55-1fd1-444a-9472-88484f3ddc56 req-1b0df62f-2ecc-4a4c-8ab6-0eab56c2620d service nova] Creating event network-changed:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch1-master-1 Jul 30 21:29:56.532003 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3c92ff55-1fd1-444a-9472-88484f3ddc56 req-1b0df62f-2ecc-4a4c-8ab6-0eab56c2620d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105241 Jul 30 21:29:56.532989 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2615/5276] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:29:57.053812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:57.066560 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-66c88d63-5e15-4e10-b463-e9a39fe09f1c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1564 microversion: 2.1 time: 0.659346 Jul 30 21:29:57.084750 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2662/5277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:56 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1564 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:57.367916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:57.368891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:57.384295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:57.386588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:57.387844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:57.390700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:58.232908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:58.246158 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-483a6b81-ea91-4b68-9616-3c02d4632f89 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.884532 Jul 30 21:29:58.247793 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2616/5278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:57 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:29:58.427022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fde3553b-9e72-4960-983e-5e84e3841e17 req-b1c8b2b2-420f-449c-9f77-b918cf2ab7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fee270-0753-4d1c-8117-1abf519ba14f", "tag": "26b2f461-9f4f-4eec-acf6-2824d02422b9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:29:58.456121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fde3553b-9e72-4960-983e-5e84e3841e17 req-b1c8b2b2-420f-449c-9f77-b918cf2ab7d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:58.458029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fde3553b-9e72-4960-983e-5e84e3841e17 req-b1c8b2b2-420f-449c-9f77-b918cf2ab7d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:58.486049 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fde3553b-9e72-4960-983e-5e84e3841e17 req-b1c8b2b2-420f-449c-9f77-b918cf2ab7d9 service nova] Creating event network-changed:26b2f461-9f4f-4eec-acf6-2824d02422b9 for instance 25fee270-0753-4d1c-8117-1abf519ba14f on nch2-master-1 Jul 30 21:29:58.503444 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fde3553b-9e72-4960-983e-5e84e3841e17 req-b1c8b2b2-420f-449c-9f77-b918cf2ab7d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079191 Jul 30 21:29:58.506465 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2663/5279] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:29:59.270087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:29:59.271061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:29:59.279071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:59.279568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:59.280370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:29:59.285034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:29:59.471564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:29:59.484550 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-90be3943-f775-4865-9e36-da3fa63ebac0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.217555 Jul 30 21:29:59.487545 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2617/5280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:29:59 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:00.508686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:00.509429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:00.522193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:00.522700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:00.523543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:00.524001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:00.748595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:00.762251 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e77f29e2-034e-4ecf-a347-81ef15fbca59 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.259417 Jul 30 21:30:00.763128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2664/5281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:00 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:01.785768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:01.786396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:01.797280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:01.801586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:01.802585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:01.804093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:02.072237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:02.085102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae4723f7-0d50-492d-9100-31c8d4b309e6 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.303123 Jul 30 21:30:02.109143 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2618/5282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:01 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:02.459704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-70667a12-74cd-4a83-bc1c-4a7f509b9cae req-15a936c3-0c9d-405f-a94b-6f309b8a212e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fee270-0753-4d1c-8117-1abf519ba14f", "name": "network-vif-plugged", "status": "completed", "tag": "26b2f461-9f4f-4eec-acf6-2824d02422b9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:02.506704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:02.513037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70667a12-74cd-4a83-bc1c-4a7f509b9cae req-15a936c3-0c9d-405f-a94b-6f309b8a212e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:02.514020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-70667a12-74cd-4a83-bc1c-4a7f509b9cae req-15a936c3-0c9d-405f-a94b-6f309b8a212e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:02.539234 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-70667a12-74cd-4a83-bc1c-4a7f509b9cae req-15a936c3-0c9d-405f-a94b-6f309b8a212e service nova] Creating event network-vif-plugged:26b2f461-9f4f-4eec-acf6-2824d02422b9 for instance 25fee270-0753-4d1c-8117-1abf519ba14f on nch2-master-1 Jul 30 21:30:02.552893 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-70667a12-74cd-4a83-bc1c-4a7f509b9cae req-15a936c3-0c9d-405f-a94b-6f309b8a212e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098288 Jul 30 21:30:02.556193 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2665/5283] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:03.107480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:03.109960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:03.118171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:03.121892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:03.125996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:03.127499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:03.129295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:03.130250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:03.663629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:03.672360 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f4de08b-23f7-46d2-92b0-81b6e3894244 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1314 microversion: 2.1 time: 0.569487 Jul 30 21:30:03.674047 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2619/5284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:03 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:30:04.695977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:04.696876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:04.716273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:04.716754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:04.720705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:04.721209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:05.178415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:05.189740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1347d495-7e8b-4db8-9424-7f672c5943a0 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1463 microversion: 2.1 time: 0.497140 Jul 30 21:30:05.191386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2666/5285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:04 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1463 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:05.267467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:05.269106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:05.288580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:05.289935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:05.295138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:05.296003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:05.328628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:30:05.484794 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53b8becb-fd67-4eef-9a65-5f04cde9f949 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "DELETE /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 204 len: 0 microversion: 2.1 time: 0.229801 Jul 30 21:30:05.485942 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2620/5286] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:30:05 2022] DELETE /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:30:05.504648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:05.505532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:05.513750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:05.515898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:05.517068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:05.517857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:05.800875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:05.810723 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d74b64be-17c6-4c3a-b4cd-57d870572e76 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1469 microversion: 2.1 time: 0.318105 Jul 30 21:30:05.811783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2667/5287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:05 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:06.834571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:06.836201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:06.853110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:06.855484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:06.859401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:06.862908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:07.240494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:07.254050 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3c0fecd-7ec8-4913-94e0-f453113211c3 tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1469 microversion: 2.1 time: 0.420930 Jul 30 21:30:07.268006 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2621/5288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:06 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:07.989986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f65ea844-940a-41a7-b6a0-900da8619ad4 req-ded42c81-1949-4c2b-b335-900667d66b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fee270-0753-4d1c-8117-1abf519ba14f", "name": "network-vif-deleted", "tag": "26b2f461-9f4f-4eec-acf6-2824d02422b9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:08.003735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f65ea844-940a-41a7-b6a0-900da8619ad4 req-ded42c81-1949-4c2b-b335-900667d66b28 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:08.005953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f65ea844-940a-41a7-b6a0-900da8619ad4 req-ded42c81-1949-4c2b-b335-900667d66b28 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:08.016590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:08.034848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f65ea844-940a-41a7-b6a0-900da8619ad4 req-ded42c81-1949-4c2b-b335-900667d66b28 service nova] Creating event network-vif-deleted:26b2f461-9f4f-4eec-acf6-2824d02422b9 for instance 25fee270-0753-4d1c-8117-1abf519ba14f on nch2-master-1 Jul 30 21:30:08.041806 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f65ea844-940a-41a7-b6a0-900da8619ad4 req-ded42c81-1949-4c2b-b335-900667d66b28 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055175 Jul 30 21:30:08.047104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2622/5289] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:30:08.131036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c099d16f-bed9-4747-b72e-6ad3283bb530 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: .version_select at 0x7fbb4fc79700>, body: {"keypair": {"name": "tempest-keypair-302981942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdYVTpOPD368/nrS5XLMpxsXoQrz2mTRrsbFft047n00KYyNV0jkQ+cBS1BKiSGkBEcwh8Oh15vEERXUgut5DtunymygP/rs/ywz+50Ga3c9qkd00GWEQgHI79iXqXR/A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:08.188785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c099d16f-bed9-4747-b72e-6ad3283bb530 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:30:08.197976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c099d16f-bed9-4747-b72e-6ad3283bb530 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for user 5a6da0171fac41fb934ed2b294081531 and project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:30:08.238295 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c099d16f-bed9-4747-b72e-6ad3283bb530 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.720079 Jul 30 21:30:08.239307 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2668/5290] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:30:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:08.280286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:08.281160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:08.292690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:08.293200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:08.294004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:08.294457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:08.341658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:08.342332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:08.343026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lazy-loading 'fault' on Instance uuid 25fee270-0753-4d1c-8117-1abf519ba14f {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:30:08.406148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87902729a01b4918a07d61589f9c84da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430c3036ed74cea9b3d1a20b61f780e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:08.423741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b6b2689-9eaf-47cf-9901-31e8c15bb03c tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 200 len: 1304 microversion: 2.1 time: 0.147724 Jul 30 21:30:08.427757 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2623/5291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:08 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:09.452959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:09.453546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] [instance: 25fee270-0753-4d1c-8117-1abf519ba14f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:09.470089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:09.470759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:09.473026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:09.474561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:09.525927 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] HTTP exception thrown: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Request method failure captured: Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f HTTP/1.1 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLMlFBz7qK6V3-JbN89n-5b0Kd7BcmAEC46SHxL9Rv7tT582ep9Ka5zXKuKVBzcwZyFzOYzvp3IKGK_TgpSxeiNZrau5F2VJzm35VIoiamtFb1zznlLI-2_2q_uKLE245gOuF4d-QVSt3NZv7kq6Tku_0ySuNyfBWGM5bodr09qED4 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 2430c3036ed74cea9b3d1a20b61f780e Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesNegativeTest-1438286119 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2430c3036ed74cea9b3d1a20b61f780e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2430c3036ed74cea9b3d1a20b61f780e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2430c3036ed74cea9b3d1a20b61f780e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2430c3036ed74cea9b3d1a20b61f780e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesNegativeTest-1438286119 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 2430c3036ed74cea9b3d1a20b61f780e Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesNegativeTest-1438286119 Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesNegativeTest-1438286119-project Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 87902729a01b4918a07d61589f9c84da Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesNegativeTest-1438286119-project Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '25fee270-0753-4d1c-8117-1abf519ba14f'} Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:30:09.527803 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. Jul 30 21:30:09.531937 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:30:09.534844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] Returning 404 to user: Instance 25fee270-0753-4d1c-8117-1abf519ba14f could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:30:09.536265 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e1e938ca-d567-43c1-9280-5eb93e1cecdb tempest-VolumesNegativeTest-1438286119 tempest-VolumesNegativeTest-1438286119-project] 10.222.0.17 "GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f" status: 404 len: 111 microversion: 2.1 time: 0.093544 Jul 30 21:30:09.538614 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2669/5292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:09 2022] GET /compute/v2.1/servers/25fee270-0753-4d1c-8117-1abf519ba14f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:30:10.974197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1178681416", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f372ffef-6c6a-4f4d-bcab-1b2fc3684d65"}], "security_groups": [{"name": "tempest-securitygroup--1610316178"}], "key_name": "tempest-keypair-302981942", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:11.212004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] validate_networks() for [('f372ffef-6c6a-4f4d-bcab-1b2fc3684d65', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:30:11.923663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:30:11.924138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:30:11.924802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:30:11.925221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:30:11.925796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:30:11.936731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:11.937200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:11.938019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:11.938467 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:11.959908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:30:11.966715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for user 5a6da0171fac41fb934ed2b294081531 and project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:30:11.982933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:30:11.985311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:30:12.100860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-356c1256-068e-4135-b26b-7f81a4918b8a tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.131844 Jul 30 21:30:12.108340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2624/5293] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:30:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:30:12.115321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94e4d8c8-68a5-4a5b-a07d-c9939138aaaa tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:12.120039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94e4d8c8-68a5-4a5b-a07d-c9939138aaaa tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:12.246990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94e4d8c8-68a5-4a5b-a07d-c9939138aaaa tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:12.257483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94e4d8c8-68a5-4a5b-a07d-c9939138aaaa tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1237 microversion: 2.1 time: 0.147873 Jul 30 21:30:12.264479 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2670/5294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:12 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:13.287704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:13.291468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:13.315907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:13.316486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:13.324262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:13.324755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:13.431220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:13.441669 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ff9726e6-85f3-4058-9b72-d20fcc74caba tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1289 microversion: 2.1 time: 0.158801 Jul 30 21:30:13.441974 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2625/5295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:13 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:14.463947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:14.464518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:14.484412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:14.485183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:14.494447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:14.495887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:14.700076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:14.716611 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1bb1892-895a-4128-86c9-8e7b7fc142ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1295 microversion: 2.1 time: 0.258236 Jul 30 21:30:14.717207 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2671/5296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:14 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1295 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:15.782539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:15.783194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:15.798758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:15.800701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:15.801404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:15.813449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:15.815981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:16.206490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:16.227449 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7d6f080-72cd-46d4-823d-854dbd87a222 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.491381 Jul 30 21:30:16.232151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2626/5297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:15 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:16.335692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3f0e5d5a-28c3-472c-a769-c96b0af5590b req-6afef07c-acb1-4717-b7d7-0b83b5129dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c28cc18-83ac-4376-bab3-01c3219dbf21", "tag": "42f107b4-42d7-4512-b542-7ee43883ca3a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:16.363712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3f0e5d5a-28c3-472c-a769-c96b0af5590b req-6afef07c-acb1-4717-b7d7-0b83b5129dd3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:16.363712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3f0e5d5a-28c3-472c-a769-c96b0af5590b req-6afef07c-acb1-4717-b7d7-0b83b5129dd3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:16.390701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3f0e5d5a-28c3-472c-a769-c96b0af5590b req-6afef07c-acb1-4717-b7d7-0b83b5129dd3 service nova] Creating event network-changed:42f107b4-42d7-4512-b542-7ee43883ca3a for instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 on nch2-master-1 Jul 30 21:30:16.409622 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3f0e5d5a-28c3-472c-a769-c96b0af5590b req-6afef07c-acb1-4717-b7d7-0b83b5129dd3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081557 Jul 30 21:30:16.411712 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2672/5298] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:16.494968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:16.498774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:16.514800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:16.516690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:16.521054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:16.521587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:16.595880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4d44181-7931-4c53-8865-ef054e6f9968 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action" status: 200 len: 24567 microversion: 2.1 time: 0.105507 Jul 30 21:30:16.597035 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2627/5299] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:30:16 2022] POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action => generated 24567 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:30:17.253794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:17.254667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:17.262093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:17.262571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:17.263421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:17.263888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:17.281108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=76 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:17.424124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:17.433245 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-985b5c24-8039-46e4-be2f-98e4b83b14bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.184357 Jul 30 21:30:17.433812 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2673/5300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:17 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:18.455326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:18.456058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:18.464465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:18.465010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:18.465869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:18.466531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:18.669011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:18.680571 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebaf9168-8fbb-482c-a3fb-8e47782b8be3 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.229822 Jul 30 21:30:18.681204 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2628/5301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:18 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:19.703422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:19.703422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:19.714027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:19.714492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:19.716826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:19.717289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:19.885865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:19.895022 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b53bd5d-6d36-42b0-879c-ac00f2d9f46d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.195601 Jul 30 21:30:19.899795 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2674/5302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:19 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:20.902588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-555c8d2b-8941-4987-a854-96e2210c5526 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Action: 'create', calling method: .version_select at 0x7fbb5cef48b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-431975755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3vR5M05zNwnmcrheXx0VOlVxTWmsc278C800Puap4XNvQgb4W67TPbZZ1gNpl2tfqio4J7+Zqk6jIQxKQ9diP2RDnvbUz5pSXliMokCjH/jL+mAvqhvdOUouBrPuZb3w=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:20.916756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:20.917472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:20.920490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-555c8d2b-8941-4987-a854-96e2210c5526 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for project 434fef0893984988a8acc8b251efdddc. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:30:20.925401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:20.926419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-555c8d2b-8941-4987-a854-96e2210c5526 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for user 67db2c00c71f469f9a7a871ed28e97e4 and project 434fef0893984988a8acc8b251efdddc. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:30:20.927399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:20.928176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:20.929071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:20.930066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:20.952848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-555c8d2b-8941-4987-a854-96e2210c5526 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.290766 Jul 30 21:30:20.953793 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2629/5303] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:30:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:21.089169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:21.099237 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f05aab08-b14e-4ab7-9e11-a9131c83dcb7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.186444 Jul 30 21:30:21.099904 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2675/5304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:20 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:22.122319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:22.124178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:22.134775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:22.138087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:22.138636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:22.139518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:22.140290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:22.185233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4dba40bb-4926-4c6d-bbd1-9d2a0a8841ee req-09cfe769-7236-4ed9-addc-7f763780843b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c28cc18-83ac-4376-bab3-01c3219dbf21", "name": "network-vif-plugged", "status": "completed", "tag": "42f107b4-42d7-4512-b542-7ee43883ca3a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:22.201812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4dba40bb-4926-4c6d-bbd1-9d2a0a8841ee req-09cfe769-7236-4ed9-addc-7f763780843b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:22.202206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4dba40bb-4926-4c6d-bbd1-9d2a0a8841ee req-09cfe769-7236-4ed9-addc-7f763780843b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:22.215317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4dba40bb-4926-4c6d-bbd1-9d2a0a8841ee req-09cfe769-7236-4ed9-addc-7f763780843b service nova] Creating event network-vif-plugged:42f107b4-42d7-4512-b542-7ee43883ca3a for instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 on nch2-master-1 Jul 30 21:30:22.220726 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4dba40bb-4926-4c6d-bbd1-9d2a0a8841ee req-09cfe769-7236-4ed9-addc-7f763780843b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040522 Jul 30 21:30:22.222417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2676/5305] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:22.439700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:22.448711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a94f13f-3b6f-4552-bc37-f43ef3717ea4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.332594 Jul 30 21:30:22.449415 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2630/5306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:22 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:22.971176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:22.991841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:22.995389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:23.016633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.018103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.020697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.022410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.470552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:23.472164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:23.482619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.483177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.484218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.484918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.548165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd475852-8f18-4a93-8b73-4a6e181a677a tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1833 microversion: 2.1 time: 0.579708 Jul 30 21:30:23.548775 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2677/5307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:22 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1833 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:23.573573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:23.574471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:23.581672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.582423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.583445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.584063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.683569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:23.693616 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-76a1fb47-ff42-4e94-a628-761e2374eda8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1363 microversion: 2.1 time: 0.227239 Jul 30 21:30:23.695264 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2631/5308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:23 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:23.783553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:23.796105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73dd15ee-07cd-45ed-aa7d-60200f05c5f6 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1682 microversion: 2.1 time: 0.227505 Jul 30 21:30:23.796907 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2678/5309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:23 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:23.929344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:23.934353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:23.957639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.958120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:23.958931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:23.959416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.043758 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7b6ebfc-68a9-42aa-b203-1f58479b41c7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action" status: 200 len: 32634 microversion: 2.1 time: 0.118170 Jul 30 21:30:24.052652 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2632/5310] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:30:23 2022] POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action => generated 32634 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:30:24.269163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:24.269810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:24.287839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.288348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.292203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.293639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.364814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fa0bf58ed064372805f230f0b35e42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152c660df7e349ad86665647d6b3bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:24.365836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] flavor_id is None. Assuming migration. {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 30 21:30:24.372079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:30:24.716117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:24.717600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:24.729942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.731620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.739064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.739601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.872386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1a1261cb-17c2-491c-95fe-d843597d7541 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action" status: 202 len: 0 microversion: 2.1 time: 0.607131 Jul 30 21:30:24.876120 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2679/5311] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:30:24 2022] POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:30:24.894592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:24.895265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:24.933632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.936501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:24.938083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:24.939746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:25.092138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:25.106750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5512e98-4f67-479d-9179-b1680ff3d9c0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1549 microversion: 2.1 time: 0.395861 Jul 30 21:30:25.107273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2633/5312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:24 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1549 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:25.134854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:25.135762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:25.148820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:25.153862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:25.156893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:25.157402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:25.323849 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6b47650-6751-4bdb-9417-b43bff4015eb tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194869 Jul 30 21:30:25.328249 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2634/5313] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:30:25 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:30:25.339144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:25.348392 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e6f4661-5b75-4705-bb7d-e3991b7191a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1691 microversion: 2.1 time: 0.468092 Jul 30 21:30:25.349709 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2680/5314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:24 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1691 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:26.378444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:26.379865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:26.407125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:26.408355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:26.410562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:26.411680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:26.946004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:26.970415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e77a6b29-5acd-4e45-b520-c02ded02bb5e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1691 microversion: 2.1 time: 0.599416 Jul 30 21:30:26.973784 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2635/5315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:26 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1691 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:27.466652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c9596dee-c1e3-48bc-8dfb-30bd44d3f789 req-92b282c3-c953-4b35-9759-c17860ceea6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c28cc18-83ac-4376-bab3-01c3219dbf21", "tag": "42f107b4-42d7-4512-b542-7ee43883ca3a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:27.501487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c9596dee-c1e3-48bc-8dfb-30bd44d3f789 req-92b282c3-c953-4b35-9759-c17860ceea6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:27.504205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c9596dee-c1e3-48bc-8dfb-30bd44d3f789 req-92b282c3-c953-4b35-9759-c17860ceea6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:27.547040 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c9596dee-c1e3-48bc-8dfb-30bd44d3f789 req-92b282c3-c953-4b35-9759-c17860ceea6e service nova] Creating event network-changed:42f107b4-42d7-4512-b542-7ee43883ca3a for instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 on nch2-master-1 Jul 30 21:30:27.557258 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c9596dee-c1e3-48bc-8dfb-30bd44d3f789 req-92b282c3-c953-4b35-9759-c17860ceea6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091323 Jul 30 21:30:27.558231 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2681/5316] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:27.995510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:27.997625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:28.038862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:28.039598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:28.040646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:28.047361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:28.825413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:28.838924 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-19efc90a-fe8a-4987-ba93-c3950abd6d4f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1691 microversion: 2.1 time: 0.848093 Jul 30 21:30:28.857233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2636/5317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:27 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1691 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:29.866618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:29.868313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:29.886254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:29.887609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:29.893776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:29.894443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:30.762494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:30.776414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7473224b-5973-4516-85f0-f64810c0f31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1691 microversion: 2.1 time: 0.915979 Jul 30 21:30:30.778263 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2682/5318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:29 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1691 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:31.804743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:31.805415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:31.809496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:31.825846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:31.826716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:31.827571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:31.829423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:33.105956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:33.126740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-451858ea-3cdd-46ba-bfc4-ccd6c8bd9e6d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 1.329667 Jul 30 21:30:33.132374 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2637/5319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:31 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:34.152982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:34.154414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:34.168765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:34.169233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:34.177904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:34.180006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:34.537817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:34.550883 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5696a7a6-4235-4a86-91f2-30cccc4503de tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.404388 Jul 30 21:30:34.553084 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2683/5320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:34 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:34.651068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-89145644-access_point-1241796788", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "16a5be75-597c-46e3-b88e-976e5dba0e60"}], "key_name": "tempest-TestSecurityGroupsBasicOps-431975755", "security_groups": [{"name": "tempest-secgroup_access--728250760"}, {"name": "tempest-secgroup_general--1253994490"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:34.989528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] validate_networks() for [('16a5be75-597c-46e3-b88e-976e5dba0e60', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:30:35.580279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:35.584309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:35.603483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:35.609175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:35.610616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:35.612755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:35.820463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:30:35.820942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:30:35.821422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:30:35.821852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:30:35.822275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:30:35.839914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:35.841284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:35.844405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:35.845029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:35.897748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for project 434fef0893984988a8acc8b251efdddc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:30:35.923648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for user 67db2c00c71f469f9a7a871ed28e97e4 and project 434fef0893984988a8acc8b251efdddc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:30:35.923920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:35.939151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22f43026-3658-4384-8f9a-d62a3f8b7a88 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.366124 Jul 30 21:30:35.940140 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2684/5321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:35 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:35.946126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:30:35.948385 ncdv-master-1 devstack@n-api.service[130983]: WARNING nova.utils [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-89145644-access_point-1241796788 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-89145644-acce Jul 30 21:30:35.949375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:30:36.044446 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f61eae23-75a2-4537-bfd9-bbd2d5c538ce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.398457 Jul 30 21:30:36.045112 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2638/5322] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:30:34 2022] POST /compute/v2.1/servers => generated 457 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:30:36.056983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e6f0acd-b025-44a6-84e0-39802e3f2ade tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:36.057631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2e6f0acd-b025-44a6-84e0-39802e3f2ade tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:36.131127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2e6f0acd-b025-44a6-84e0-39802e3f2ade tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:36.139770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e6f0acd-b025-44a6-84e0-39802e3f2ade tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1292 microversion: 2.1 time: 0.087151 Jul 30 21:30:36.154969 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2685/5323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:36 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:36.962610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:36.963256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:36.987647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:36.988942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:36.989766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:36.994395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:37.167080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:37.170079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:37.177709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:37.178177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:37.179129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:37.181615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:37.576187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:37.593229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a42dc203-6cbc-459f-a037-099534d3aed4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.635991 Jul 30 21:30:37.596316 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2639/5324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:36 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:37.646885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:37.667068 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ab35dd5-a4a9-4ed9-9e2a-4e318dbf6101 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1296 microversion: 2.1 time: 0.507709 Jul 30 21:30:37.674309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2686/5325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:37 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1296 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:38.618862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:38.620663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:38.670043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:38.677664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:38.679578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:38.680251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:38.703917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:38.705459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:38.730017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=85 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:38.740263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:38.740263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:38.740996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:38.741560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:39.089886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:39.106583 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9564972f-b613-46d4-90e3-d70ba5d5f39e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.492955 Jul 30 21:30:39.118302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2640/5326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:38 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:39.434301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:39.442620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ad4d0aeb-63fc-4e9b-86d6-18793523219c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1350 microversion: 2.1 time: 0.747538 Jul 30 21:30:39.443219 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2687/5327] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:38 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1350 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:40.138695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:40.139535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:40.151952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:40.153083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:40.155908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:40.157105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:40.400111 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:40.413884 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-871133f0-c228-4ce2-91da-2dfb10ccaa74 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.286485 Jul 30 21:30:40.416094 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2641/5328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:40 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:40.481637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:40.483228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:40.507841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:40.508761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:40.510241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:40.510778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:40.848621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:40.862073 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d452f17-abd1-4489-9b67-d8f1b3fafb9b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.395743 Jul 30 21:30:40.863276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2688/5329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:40 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:40.983989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c266f1b7-373c-4f3c-8b27-2014d609f0f9 req-56990ebf-219e-40f1-b26f-1186f2e77518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8161b8-c374-4519-96fd-1aacab5b7d2c", "tag": "764f845c-a47d-4735-ad56-6157e1652c88"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:40.997677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c266f1b7-373c-4f3c-8b27-2014d609f0f9 req-56990ebf-219e-40f1-b26f-1186f2e77518 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:40.999676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c266f1b7-373c-4f3c-8b27-2014d609f0f9 req-56990ebf-219e-40f1-b26f-1186f2e77518 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:41.013768 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c266f1b7-373c-4f3c-8b27-2014d609f0f9 req-56990ebf-219e-40f1-b26f-1186f2e77518 service nova] Creating event network-changed:764f845c-a47d-4735-ad56-6157e1652c88 for instance ae8161b8-c374-4519-96fd-1aacab5b7d2c on nch1-master-1 Jul 30 21:30:41.020326 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c266f1b7-373c-4f3c-8b27-2014d609f0f9 req-56990ebf-219e-40f1-b26f-1186f2e77518 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040646 Jul 30 21:30:41.021821 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2642/5330] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:41.438559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:41.439586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:41.451096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:41.452118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:41.454519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:41.455584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:41.884825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:41.885706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:41.896864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:41.903491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:41.904456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:41.905027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:42.248039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:42.256855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-353d6613-daf7-445f-8dc2-b9f199b31486 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.823966 Jul 30 21:30:42.257900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2689/5331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:41 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:42.357824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:42.366469 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2eef200-ef70-4241-a128-afbe3da31922 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.487028 Jul 30 21:30:42.367253 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2643/5332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:41 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:43.279952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:43.280591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:43.287754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:43.288429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:43.289398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:43.290046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:43.317465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:43.389549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:43.390874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:43.404760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:43.405596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:43.406606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:43.407590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:43.476048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:43.486450 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf51900d-f132-4847-87e0-f740ac2757a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1696 microversion: 2.1 time: 0.210219 Jul 30 21:30:43.489999 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2690/5333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:43 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:43.611362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:43.620249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-642aa294-de0a-4212-912f-f043e72bf6bc tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.234721 Jul 30 21:30:43.621056 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2644/5334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:43 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:44.519986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:44.521414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:44.541554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:44.543692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:44.546650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:44.571210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:44.657872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:44.661742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:44.674622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:44.675527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:44.676549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:44.677136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:44.863997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:44.873733 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7c542ff-74e5-4527-a4a0-0bebc5174980 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1695 microversion: 2.1 time: 0.361328 Jul 30 21:30:44.874864 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2691/5335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:44 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1695 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:45.269174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:45.282703 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bb4ebca7-32c8-4622-bf1b-a3390b2f9739 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.641415 Jul 30 21:30:45.283826 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2645/5336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:44 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:30:45.439912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "name": "network-vif-unplugged", "status": "completed", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:45.461401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:45.462247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:45.482338 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] Creating event network-vif-unplugged:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch2-master-1 Jul 30 21:30:45.497720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] Instance eb3393e8-259b-450f-960c-571c6b6b2723 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:30:45.514219 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c8b3c339-d6cd-471e-8f39-b697ab1b2264 req-868927d0-b3e9-41e0-9e4a-642d8bad4938 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078625 Jul 30 21:30:45.522471 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2692/5337] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:45.900674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:45.910397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:45.916027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:45.916797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:45.921530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:45.922015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:45.922929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:45.923269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:45.949202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:46.270562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:46.287963 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5899f2e2-4f60-4d17-94ad-3026c20f369c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1695 microversion: 2.1 time: 0.393410 Jul 30 21:30:46.288674 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2646/5338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:45 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1695 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:46.306573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:46.312132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:46.313216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:46.329374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:46.330565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:46.331677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:46.332334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:46.643873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:46.657672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5db56d0f-3981-46d6-8eba-59733a5a689b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.352973 Jul 30 21:30:46.659048 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2693/5339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:46 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:47.315040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:47.316355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:47.325527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:47.329485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:47.331643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:47.332267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:47.556907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:47.575776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:47.576558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:47.581030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:47.602912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9486aa41-2073-4221-855e-09f4e1c19372 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1693 microversion: 2.1 time: 0.292261 Jul 30 21:30:47.604787 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2647/5340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:47 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1693 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:47.605965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] Creating event network-changed:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch2-master-1 Jul 30 21:30:47.613015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] Instance eb3393e8-259b-450f-960c-571c6b6b2723 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:30:47.625218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-16f2469a-3be0-4383-bfdf-51d52fb3ed66 req-767d4fcc-8cba-4861-9bed-ff98290bf3e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072338 Jul 30 21:30:47.626342 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2694/5341] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:30:47.690408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:47.692550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:47.706490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:47.707399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:47.708495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:47.708958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:47.957145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:47.980026 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4cce5b5b-9fd8-4765-ba6c-226398b91429 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.301298 Jul 30 21:30:47.981286 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2648/5342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:47 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:48.653487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:48.655525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:48.663046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:48.663547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:48.665006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:48.665733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:48.988815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:49.001584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:49.005506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:49.015584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5b05bbd6-8bd6-427e-81f4-af5a43d32405 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1693 microversion: 2.1 time: 0.379082 Jul 30 21:30:49.019167 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2695/5343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:48 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1693 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:49.032635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:49.041284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:49.053646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:49.055872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:49.516921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:49.545259 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-501d5b89-43a1-41b5-85e4-66e74190b513 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.547671 Jul 30 21:30:49.546484 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2649/5344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:48 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:49.940381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-556c91de-abb3-4e1f-a216-960fbe7ef295 req-f5b151be-dff2-4360-a4d0-3c64a97ca7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8161b8-c374-4519-96fd-1aacab5b7d2c", "name": "network-vif-plugged", "status": "completed", "tag": "764f845c-a47d-4735-ad56-6157e1652c88"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:49.969787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-556c91de-abb3-4e1f-a216-960fbe7ef295 req-f5b151be-dff2-4360-a4d0-3c64a97ca7a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:49.971951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-556c91de-abb3-4e1f-a216-960fbe7ef295 req-f5b151be-dff2-4360-a4d0-3c64a97ca7a2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:49.994740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-556c91de-abb3-4e1f-a216-960fbe7ef295 req-f5b151be-dff2-4360-a4d0-3c64a97ca7a2 service nova] Creating event network-vif-plugged:764f845c-a47d-4735-ad56-6157e1652c88 for instance ae8161b8-c374-4519-96fd-1aacab5b7d2c on nch1-master-1 Jul 30 21:30:50.008630 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-556c91de-abb3-4e1f-a216-960fbe7ef295 req-f5b151be-dff2-4360-a4d0-3c64a97ca7a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072053 Jul 30 21:30:50.010225 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2696/5345] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:50.042809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:50.044517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:50.073806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.074634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.075681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.076335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.535063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:50.559167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7876ee29-bb02-4d51-a5fd-38ba42bdb23f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1690 microversion: 2.1 time: 0.521434 Jul 30 21:30:50.566526 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2650/5346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:50 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1690 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:50.571592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:50.572475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:50.585480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.585973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.589539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.592325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.597328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:50.602142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:50.612030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.614743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.616154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.618528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.731851 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f3ec906b-9fb3-4937-b0b2-f9e3c6980469 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action" status: 204 len: 0 microversion: 2.1 time: 0.140691 Jul 30 21:30:50.732936 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2651/5347] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:30:50 2022] POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:30:50.742854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:50.745595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:50.756330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.758630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.760130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:50.760765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:50.921343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:50.934395 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a615e8f6-4a5e-4412-a9ab-0ccc5db58d62 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1469 microversion: 2.1 time: 0.367878 Jul 30 21:30:50.935009 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2697/5348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:50 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:30:51.370570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:51.384938 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4041f89a-75ad-4860-8791-eb156a20a37a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1690 microversion: 2.1 time: 0.646777 Jul 30 21:30:51.385730 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2652/5349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:50 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1690 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:51.965560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:51.967617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:51.978215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=50 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:51.981862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:51.982859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:51.985481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:51.986692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.298208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:52.313074 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c2b7b8b-b4cd-4ede-8e95-93e0657dd692 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1642 microversion: 2.1 time: 0.354756 Jul 30 21:30:52.314377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2698/5350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:51 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1642 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:52.351861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:52.354265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:52.373734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.374386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.375040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.375653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.408981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:52.410074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:52.421425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.427017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.432541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.433299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.769427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:52.785030 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be54e971-5ef8-4f1c-bef2-0d52b5ae0543 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1642 microversion: 2.1 time: 0.440736 Jul 30 21:30:52.785985 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2653/5351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:52 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1642 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:30:52.792274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "name": "network-vif-plugged", "status": "completed", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:52.807530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.808233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:52.809448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.821292 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80cd414a-8ed7-4863-b6d5-f10b52c97945 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1690 microversion: 2.1 time: 0.416164 Jul 30 21:30:52.821900 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2699/5352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:52 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1690 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:52.827791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:52.828976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:52.831249 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] Creating event network-vif-plugged:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch2-master-1 Jul 30 21:30:52.838024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.839176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.840312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] Instance eb3393e8-259b-450f-960c-571c6b6b2723 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:30:52.840793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:52.841741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:52.857026 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6c41cd3e-da19-4b61-b839-1f049e2040c1 req-dee95a40-40d2-4ed4-a01c-786504736439 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069207 Jul 30 21:30:52.862501 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2654/5353] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:53.242631 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4df3cbf7-47a0-46bb-b545-73550b182cba tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1793 microversion: 2.1 time: 0.418409 Jul 30 21:30:53.246179 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2700/5354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:52 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1793 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:53.846686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:53.848648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:53.862855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:53.864333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:53.866202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:53.867053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:54.136452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:54.149407 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e20a271-c4c9-42ad-9489-80c624f982b4 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1682 microversion: 2.1 time: 0.308938 Jul 30 21:30:54.150099 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2655/5355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:53 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:30:56.360477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ed2fbb0e-435a-4ffd-a536-af343b7d2246 req-b781a525-1d8d-4a03-acce-fa6bfb88b4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8161b8-c374-4519-96fd-1aacab5b7d2c", "tag": "764f845c-a47d-4735-ad56-6157e1652c88"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:56.376537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ed2fbb0e-435a-4ffd-a536-af343b7d2246 req-b781a525-1d8d-4a03-acce-fa6bfb88b4d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:56.377150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ed2fbb0e-435a-4ffd-a536-af343b7d2246 req-b781a525-1d8d-4a03-acce-fa6bfb88b4d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:56.395120 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ed2fbb0e-435a-4ffd-a536-af343b7d2246 req-b781a525-1d8d-4a03-acce-fa6bfb88b4d3 service nova] Creating event network-changed:764f845c-a47d-4735-ad56-6157e1652c88 for instance ae8161b8-c374-4519-96fd-1aacab5b7d2c on nch1-master-1 Jul 30 21:30:56.413331 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ed2fbb0e-435a-4ffd-a536-af343b7d2246 req-b781a525-1d8d-4a03-acce-fa6bfb88b4d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052818 Jul 30 21:30:56.422956 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2701/5356] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:30:58.400965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-729350292", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "87506bc5-4984-4aaa-a9f0-dcc00644b77f"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:30:58.487981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] validate_networks() for [('87506bc5-4984-4aaa-a9f0-dcc00644b77f', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:30:58.951475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:30:58.951475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:30:58.952046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:30:58.952545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:30:58.953047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:30:58.966279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:58.967061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:58.968381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:30:58.974033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:30:58.996589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Getting quotas for project 86550d66e9144788967e5b514cda82d7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:30:59.003556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Getting quotas for user 937935818cda4a6e8b9104d38aa3a8b1 and project 86550d66e9144788967e5b514cda82d7. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:30:59.035834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:30:59.041010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:30:59.145699 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87e235ac-1e70-43c2-b175-29490a81ce0a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751029 Jul 30 21:30:59.146999 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2656/5357] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:30:59.160176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e3d6d54c-f7fc-44a0-87f2-b556474f0a76 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:30:59.161532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e3d6d54c-f7fc-44a0-87f2-b556474f0a76 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:30:59.280351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e3d6d54c-f7fc-44a0-87f2-b556474f0a76 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:30:59.288271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e3d6d54c-f7fc-44a0-87f2-b556474f0a76 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1218 microversion: 2.1 time: 0.132735 Jul 30 21:30:59.292774 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2702/5358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:30:59 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:00.239653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2028459737", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b1163f83-1612-4565-98cb-787ca27d6fe3"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:00.310493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:00.311127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:00.311707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] validate_networks() for [('b1163f83-1612-4565-98cb-787ca27d6fe3', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:31:00.325793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:00.326375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:00.327471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:00.327963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:00.449640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:00.475221 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf1e633e-0a8e-4908-9368-717538c276c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1270 microversion: 2.1 time: 0.168682 Jul 30 21:31:00.475862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2703/5359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:00 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:00.523670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:00.524737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:00.538436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:00.540032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:00.543192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:00.544916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:00.587787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e5492e1-2b85-4815-a17d-0fe84e02aacd tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/ips" status: 200 len: 146 microversion: 2.1 time: 0.068604 Jul 30 21:31:00.606923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2704/5360] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:31:00 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:01.120255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:31:01.121032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:31:01.123577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:31:01.124511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:31:01.125151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:31:01.143556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:01.144408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:01.146342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:01.147517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:01.167494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:01.181091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Getting quotas for project d3d6725c617b4a29a437ea385e84a684. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:01.194627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Getting quotas for user 0114359ded1f4ac588c8b1f0f31737ff and project d3d6725c617b4a29a437ea385e84a684. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:01.213167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:31:01.216003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:31:01.283218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-efb3ba0c-5b0e-4f14-8ff8-16ed0ea1e913 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049337 Jul 30 21:31:01.285434 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2657/5361] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:31:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:31:01.297409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa631f3f-ac8f-49f8-ba1f-830989f84825 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:01.298540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-aa631f3f-ac8f-49f8-ba1f-830989f84825 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:01.387255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-aa631f3f-ac8f-49f8-ba1f-830989f84825 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:01.399536 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa631f3f-ac8f-49f8-ba1f-830989f84825 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1214 microversion: 2.1 time: 0.105439 Jul 30 21:31:01.408587 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2705/5362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:01 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:01.500295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:01.501380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:01.518129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:01.522007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:01.523558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:01.524413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:01.850702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:01.866777 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21d913ea-8587-455f-9e5f-75a7bc3e0008 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 0.371440 Jul 30 21:31:01.868502 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2658/5363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:01 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:02.421826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:02.422465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:02.434827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:02.449390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:02.450303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:02.450774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:02.710191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-20e752eb-9bbe-455f-93d0-6d383f49e81f req-c78e56e5-1a0a-4f78-86fd-93bd7c5606b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8876225f-c2f8-4ea2-a781-5af8be7552f7", "tag": "78eb11de-c7d6-4613-b17a-944348c6e06e"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:02.724161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:02.738069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-20e752eb-9bbe-455f-93d0-6d383f49e81f req-c78e56e5-1a0a-4f78-86fd-93bd7c5606b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:02.738469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-20e752eb-9bbe-455f-93d0-6d383f49e81f req-c78e56e5-1a0a-4f78-86fd-93bd7c5606b9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:02.741042 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d4930f9-e201-45bb-abb6-3306060a1814 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1266 microversion: 2.1 time: 0.323083 Jul 30 21:31:02.741896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2706/5364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:02 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:02.759262 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-20e752eb-9bbe-455f-93d0-6d383f49e81f req-c78e56e5-1a0a-4f78-86fd-93bd7c5606b9 service nova] Creating event network-changed:78eb11de-c7d6-4613-b17a-944348c6e06e for instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 on nch1-master-1 Jul 30 21:31:02.773271 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-20e752eb-9bbe-455f-93d0-6d383f49e81f req-c78e56e5-1a0a-4f78-86fd-93bd7c5606b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068241 Jul 30 21:31:02.774220 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2659/5365] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:02.889877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:02.890700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:02.904976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:02.906439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:02.907377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:02.909493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:03.196453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:03.215663 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb794bbc-84b2-4738-ac55-db73e4594686 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 0.323352 Jul 30 21:31:03.229432 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2707/5366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:02 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:03.475706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "600fb7d5-259f-4c12-a1f9-57e6e59664cd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:03.492717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:03.507913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:03.512747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:03.513819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:03.514445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:03.770912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:03.771733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:03.784526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:03.787099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:03.791709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:03.792430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:03.995488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511184 Jul 30 21:31:04.005265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2660/5367] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:31:03 2022] POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:04.254472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:04.255456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:04.279848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:04.283948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:04.284829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:04.285300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:04.644420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:04.658967 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-95c8dbf8-a163-4835-a20b-a964013ee9ea tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.898700 Jul 30 21:31:04.659605 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2708/5368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:03 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:05.223550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:05.242295 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d2f408e-0554-4a78-813a-2847a4eb2273 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 1.003517 Jul 30 21:31:05.242910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2661/5369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:04 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:05.682154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:05.683439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:05.698157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:05.701830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:05.702874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:05.703574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:06.139198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c0bb1718-9d12-4bcd-bcb1-fb4aed02c1c7 req-da4300b3-a4a4-4886-868a-65a97161fd8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d84983-d687-4119-97a2-c27a55ab6c0f", "tag": "83934ba2-2e3e-4537-b1ce-402adf7eb224"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:06.163507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c0bb1718-9d12-4bcd-bcb1-fb4aed02c1c7 req-da4300b3-a4a4-4886-868a-65a97161fd8a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:06.164620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c0bb1718-9d12-4bcd-bcb1-fb4aed02c1c7 req-da4300b3-a4a4-4886-868a-65a97161fd8a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:06.202912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c0bb1718-9d12-4bcd-bcb1-fb4aed02c1c7 req-da4300b3-a4a4-4886-868a-65a97161fd8a service nova] Creating event network-changed:83934ba2-2e3e-4537-b1ce-402adf7eb224 for instance 36d84983-d687-4119-97a2-c27a55ab6c0f on nch2-master-1 Jul 30 21:31:06.219026 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c0bb1718-9d12-4bcd-bcb1-fb4aed02c1c7 req-da4300b3-a4a4-4886-868a-65a97161fd8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084332 Jul 30 21:31:06.231304 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2662/5370] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:06.264968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:06.265944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:06.275083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:06.281480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:06.284155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:06.287584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:06.372874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:06.384441 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-25827775-d4dc-4c3f-97ca-bc392754c1eb tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.706311 Jul 30 21:31:06.402808 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2709/5371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:05 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:06.660165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:06.669143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a564424-38c6-468c-8aa8-ac59df2fd175 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 0.408373 Jul 30 21:31:06.683776 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2663/5372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:06 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:07.425109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:07.426514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:07.436643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:07.437183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:07.438262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:07.438785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:07.699437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:07.700172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:07.709674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:07.710248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:07.711707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:07.712234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:07.754202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:07.763769 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7b21584-c164-4149-a8d4-cccc46492a50 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.341983 Jul 30 21:31:07.786562 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2710/5373] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:07 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:07.885188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:07.893877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6be52335-57c3-4534-81af-a094dd9d0fb4 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 0.199438 Jul 30 21:31:07.895149 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2664/5374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:07 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:08.519149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d57779fd-8bde-473e-a3ce-661905f96b32 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1236274118", "availability_zone": "foo_zone"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:08.523530 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:08.523530 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:31:08.525032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.aggregate [None req-d57779fd-8bde-473e-a3ce-661905f96b32 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Generated uuid 7c0ee3ed-733e-4a55-a12b-472cb83da22a for aggregate {{(pid=130984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 30 21:31:08.568582 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d57779fd-8bde-473e-a3ce-661905f96b32 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.217685 Jul 30 21:31:08.570353 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2711/5375] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 30 21:31:08 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:08.581562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39b0a4ce-f449-4d60-8192-236e6d4fcc55 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:08.584637 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:08.584637 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:08.618164 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39b0a4ce-f449-4d60-8192-236e6d4fcc55 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.040343 Jul 30 21:31:08.619107 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2665/5376] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:31:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:08.633058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:08.636386 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:08.636386 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:31:08.638684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:08.639231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:08.640872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:08.641398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:08.675609 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-02efe1d5-3cdd-4fb1-a882-9e2e61d269ee tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046777 Jul 30 21:31:08.676975 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2712/5377] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 30 21:31:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:08.688551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d90d9d44-cb28-4bdc-91c4-bbe337836db1 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:08.689321 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:08.689321 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:08.697383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d90d9d44-cb28-4bdc-91c4-bbe337836db1 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012484 Jul 30 21:31:08.699409 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2666/5378] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 30 21:31:08 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:08.709716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9308764e-3d94-41f9-bbbe-10c643cc1ab7 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:08.713070 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:08.713070 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:31:08.721435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9308764e-3d94-41f9-bbbe-10c643cc1ab7 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:08.721908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9308764e-3d94-41f9-bbbe-10c643cc1ab7 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:08.724090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:08.786986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:08.791999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:08.806570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:08.807041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:08.808503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:08.809153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.006358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9308764e-3d94-41f9-bbbe-10c643cc1ab7 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.300752 Jul 30 21:31:09.007053 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2713/5379] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:31:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.012161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:09.015597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:09.022527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.023567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.024441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.024902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.036700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:09.045901 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6d1798dc-98df-433e-9245-da601222adaa tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.262986 Jul 30 21:31:09.046501 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2667/5380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:08 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:09.051402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2b1da65-3f76-4cae-91b9-517db1da3746 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:09.052504 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.052504 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:09.066569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2b1da65-3f76-4cae-91b9-517db1da3746 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.018127 Jul 30 21:31:09.066569 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2668/5381] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:31:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.078763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d26baa9b-6698-4654-a0a4-38c3fc27ab95 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-362073912", "availability_zone": "foo_zone"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:09.158130 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.158130 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:09.191917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:09.201708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d26baa9b-6698-4654-a0a4-38c3fc27ab95 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.126689 Jul 30 21:31:09.202533 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2669/5382] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 30 21:31:09 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.202650 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0beb6b5d-49b5-4e9f-a5ae-5759d960a1b8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1322 microversion: 2.1 time: 0.193791 Jul 30 21:31:09.203010 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2714/5383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:09 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:09.216531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7fada26d-5f5a-40c5-8fd6-355f4783764f tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:09.219175 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.219175 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:09.242107 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7fada26d-5f5a-40c5-8fd6-355f4783764f tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.028815 Jul 30 21:31:09.242719 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2670/5384] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:31:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.254287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87b749ab-bd46-4d72-9ccd-c6d430e7db94 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:09.255194 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.255194 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:31:09.263775 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87b749ab-bd46-4d72-9ccd-c6d430e7db94 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.013980 Jul 30 21:31:09.264368 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2715/5385] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 30 21:31:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.275923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-07cc4c4a-d8d2-4bb1-8071-0d41dbe765e5 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:09.278859 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.278859 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:09.288059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cc4c4a-d8d2-4bb1-8071-0d41dbe765e5 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.289062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-07cc4c4a-d8d2-4bb1-8071-0d41dbe765e5 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.490132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:09.503729 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-07cc4c4a-d8d2-4bb1-8071-0d41dbe765e5 tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.231840 Jul 30 21:31:09.504611 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2671/5386] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 30 21:31:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:09.516615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67eea504-9207-4e3b-ad60-35c3a788b0ed tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:09.517639 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:09.517639 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:31:09.543991 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67eea504-9207-4e3b-ad60-35c3a788b0ed tempest-TestAggregatesBasicOps-330170908 tempest-TestAggregatesBasicOps-330170908-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.031754 Jul 30 21:31:09.545417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2716/5387] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 30 21:31:09 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 30 21:31:09.678149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f62a208b-1527-429f-b394-0440f1f6b18e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:09.686817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f62a208b-1527-429f-b394-0440f1f6b18e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.687592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f62a208b-1527-429f-b394-0440f1f6b18e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.714228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f62a208b-1527-429f-b394-0440f1f6b18e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:31:09.771193 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f62a208b-1527-429f-b394-0440f1f6b18e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action" status: 202 len: 0 microversion: 2.1 time: 0.097589 Jul 30 21:31:09.772657 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2672/5388] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:31:09 2022] POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:31:09.782986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:09.783665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:09.795051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.795963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:09.798269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:09.799500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.068456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:10.069282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:10.076105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:10.077044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.077684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:10.078312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.104246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:10.121488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-09fe0ecd-2f54-4b08-9161-be6451b1f0ed tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.342603 Jul 30 21:31:10.122713 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2717/5389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:09 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:10.165595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-83b4975c-83de-47f0-baf3-f4eb4393e149 req-298a846f-045b-41d8-8c25-e9d59d7a8b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8876225f-c2f8-4ea2-a781-5af8be7552f7", "name": "network-vif-plugged", "status": "completed", "tag": "78eb11de-c7d6-4613-b17a-944348c6e06e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:10.175546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-83b4975c-83de-47f0-baf3-f4eb4393e149 req-298a846f-045b-41d8-8c25-e9d59d7a8b9a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:10.176034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-83b4975c-83de-47f0-baf3-f4eb4393e149 req-298a846f-045b-41d8-8c25-e9d59d7a8b9a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.191368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-83b4975c-83de-47f0-baf3-f4eb4393e149 req-298a846f-045b-41d8-8c25-e9d59d7a8b9a service nova] Creating event network-vif-plugged:78eb11de-c7d6-4613-b17a-944348c6e06e for instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 on nch1-master-1 Jul 30 21:31:10.198066 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-83b4975c-83de-47f0-baf3-f4eb4393e149 req-298a846f-045b-41d8-8c25-e9d59d7a8b9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036497 Jul 30 21:31:10.199447 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2718/5390] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:10.225086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:10.227658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:10.240685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:10.243859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.244866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:10.245908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:10.277477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:10.287221 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74125249-c166-4221-9492-99a3886e3337 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.224751 Jul 30 21:31:10.287860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2673/5391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:10 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:10.853325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:10.861248 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f1443fc-aa2e-448a-959b-8f3d845dbdff tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1318 microversion: 2.1 time: 0.641285 Jul 30 21:31:10.861968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2719/5392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:10 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:11.144745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:11.146210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:11.154009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.154477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:11.155311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.155962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:11.172861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:11.203863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:11.312611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:11.313704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:11.328108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.328903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:11.329718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.330196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:11.374580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:11.384489 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c06989c-7496-4c01-a933-31a2f98415f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.245117 Jul 30 21:31:11.394928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:11.400003 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2674/5393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:11 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:11.657357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:11.667267 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-695c0dfa-288c-48b4-a73c-cf47513f8779 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.358494 Jul 30 21:31:11.668133 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2720/5394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:11 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:11.882516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:11.886796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:11.890291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.890957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:11.891968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:11.892592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.118508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:12.127379 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7db209ca-54b9-4cf9-8140-46da05250a5f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1507 microversion: 2.1 time: 0.248811 Jul 30 21:31:12.127967 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2675/5395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:11 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:12.413404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:12.414605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:12.444081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:12.446417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.450163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:12.451317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.524891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-baec6222-5124-4d29-8973-17ab12ac85b9 req-17773eed-4e50-447e-98ff-a923d644af7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d84983-d687-4119-97a2-c27a55ab6c0f", "name": "network-vif-plugged", "status": "completed", "tag": "83934ba2-2e3e-4537-b1ce-402adf7eb224"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:12.543341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-baec6222-5124-4d29-8973-17ab12ac85b9 req-17773eed-4e50-447e-98ff-a923d644af7d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:12.543812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-baec6222-5124-4d29-8973-17ab12ac85b9 req-17773eed-4e50-447e-98ff-a923d644af7d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.568990 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-baec6222-5124-4d29-8973-17ab12ac85b9 req-17773eed-4e50-447e-98ff-a923d644af7d service nova] Creating event network-vif-plugged:83934ba2-2e3e-4537-b1ce-402adf7eb224 for instance 36d84983-d687-4119-97a2-c27a55ab6c0f on nch2-master-1 Jul 30 21:31:12.581193 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-baec6222-5124-4d29-8973-17ab12ac85b9 req-17773eed-4e50-447e-98ff-a923d644af7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060513 Jul 30 21:31:12.588459 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2676/5396] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:12.688817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:12.689549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:12.705135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:12.705608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.706419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:12.706877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:12.870008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:12.889179 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48f778e2-e23e-499a-9581-c2356c3945ae tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.482496 Jul 30 21:31:12.895138 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2721/5397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:12 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:13.026361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:13.056850 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26f98b90-7fc6-4c18-ba08-23d80d1f6312 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.365198 Jul 30 21:31:13.058082 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2677/5398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:12 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:13.930393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:13.931107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:13.966634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:13.967502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:13.968532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:13.969156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:14.080704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:14.081760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:14.098826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:14.099486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:14.101108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:14.101844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:14.448316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:14.476533 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-58e402fd-5393-46bb-a576-3e7573448a9c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.550757 Jul 30 21:31:14.481040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:14.490287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8791d27a-c417-4639-9f77-1b2cca7b2bf2 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1314 microversion: 2.1 time: 0.415773 Jul 30 21:31:14.491003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2722/5399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:13 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:14.492313 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2678/5400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:14 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:15.098007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a0555a8-f248-41c2-b23f-fd458dbd282b", "device": "/dev/sdb"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:15.100549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:15.108346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.108813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.109604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.110063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.349216 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b4f61a2-3b8c-4539-831f-0551c5563059 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "POST /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255029 Jul 30 21:31:15.350164 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2723/5401] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:31:15 2022] POST /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:15.502984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:15.508041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:15.514858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:15.517127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:15.519226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.519846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.520773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.522450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.528833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.529303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.530092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:15.530524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:15.552073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:15.775860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:15.785032 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d774001-2ed8-41a6-b66a-435839c620fe tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1497 microversion: 2.1 time: 0.275641 Jul 30 21:31:15.785830 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2724/5402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:15 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:15.827130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:15.835568 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b8ccb7a-98a8-47e4-b8fe-df0338a16c1f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.339894 Jul 30 21:31:15.848352 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2679/5403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:15 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:16.340036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:16.340873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:16.349725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.350250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.351734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.352507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.390601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:31:16.433514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:16.438440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:16.457096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.458121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.460581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.464272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.559061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-615e9b49-0987-48b3-89b3-d9a8e37d7737 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 204 len: 0 microversion: 2.1 time: 0.240014 Jul 30 21:31:16.560254 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2725/5404] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:31:16 2022] DELETE /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:31:16.573331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:16.574089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:16.592970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.593373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.594186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.594643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.885401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:16.894313 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7aeb4cc3-4053-47e2-a273-aad5716877cc tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1503 microversion: 2.1 time: 0.325597 Jul 30 21:31:16.905473 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2726/5405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:16 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:16.905473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:16.905473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:16.910486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.911409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:16.912298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:16.912821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:17.142158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:17.152740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d903ada9-183a-4e7d-ae5d-5dd60f94da0c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.255992 Jul 30 21:31:17.153438 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2727/5406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:16 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:17.805989 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fef68aa3-b4b1-4743-95b1-1dc8844a5647 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action" status: 200 len: 24579 microversion: 2.1 time: 1.379063 Jul 30 21:31:17.807011 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2680/5407] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:31:16 2022] POST /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723/action => generated 24579 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:31:17.917059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:17.917704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:17.924859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:17.925271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:17.926126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:17.926524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:18.115882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:18.127089 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0142a95-63f2-4454-ab02-514737e76bf9 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1503 microversion: 2.1 time: 0.214458 Jul 30 21:31:18.128288 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2728/5408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:17 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:18.175425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:18.176078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:18.183180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:18.183675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:18.184472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:18.184926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:18.529484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:18.540722 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da0cb21a-bdcb-46ea-8b7d-f4fb112822dc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.369055 Jul 30 21:31:18.552046 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2681/5409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:18 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:19.056763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-87561eda-a33e-45b6-b682-9a9479785e75 req-92835494-45d5-4c23-a990-eebd3ee3e38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d84983-d687-4119-97a2-c27a55ab6c0f", "name": "network-vif-deleted", "tag": "83934ba2-2e3e-4537-b1ce-402adf7eb224"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:19.066863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:19.069786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-87561eda-a33e-45b6-b682-9a9479785e75 req-92835494-45d5-4c23-a990-eebd3ee3e38f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.070544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-87561eda-a33e-45b6-b682-9a9479785e75 req-92835494-45d5-4c23-a990-eebd3ee3e38f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.088501 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-87561eda-a33e-45b6-b682-9a9479785e75 req-92835494-45d5-4c23-a990-eebd3ee3e38f service nova] Creating event network-vif-deleted:83934ba2-2e3e-4537-b1ce-402adf7eb224 for instance 36d84983-d687-4119-97a2-c27a55ab6c0f on nch2-master-1 Jul 30 21:31:19.096320 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-87561eda-a33e-45b6-b682-9a9479785e75 req-92835494-45d5-4c23-a990-eebd3ee3e38f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044345 Jul 30 21:31:19.097817 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2729/5410] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:19.148719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:19.149339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:19.157283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.157998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.158786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.159427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.197717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.197717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.197717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lazy-loading 'fault' on Instance uuid 36d84983-d687-4119-97a2-c27a55ab6c0f {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:31:19.246441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:19.254353 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-425ccb85-3a9d-4e09-a110-ec96c2773ee4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 200 len: 1304 microversion: 2.1 time: 0.109525 Jul 30 21:31:19.254934 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2682/5411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:19 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:19.567535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:19.568412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:19.579812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.580768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.582004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:19.583229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:19.606845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:19.751971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:19.761128 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-781797d0-848d-4b7a-87e6-595aa71fd850 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1724 microversion: 2.1 time: 0.200762 Jul 30 21:31:19.761713 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2730/5412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:19 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:20.274809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:20.275609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 36d84983-d687-4119-97a2-c27a55ab6c0f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:20.282821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.283304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.284117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.284761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.298723 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] HTTP exception thrown: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Request method failure captured: Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f HTTP/1.1 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aMSSHVomn4o2mq_efNXogMTAaceTv437G856a5i7I-poEtZwYrYRmQ_XatOKtVFv7-EzeET7PDExtxptDPZsLi4n-vG2bhf_YaiatB9sPAoXrR2DNb6CBiR9bwI54s0rb4J4aIZzyViaWDK8E0ZheWxS7wuF3y4_9uH6K7zO_ilmqU Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d3d6725c617b4a29a437ea385e84a684 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3d6725c617b4a29a437ea385e84a684", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d3d6725c617b4a29a437ea385e84a684 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesActionsTest-1001371749-project Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 0114359ded1f4ac588c8b1f0f31737ff Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesActionsTest-1001371749-project Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '36d84983-d687-4119-97a2-c27a55ab6c0f'} Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:20.300469 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Returning 404 to user: Instance 36d84983-d687-4119-97a2-c27a55ab6c0f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-abd12bff-7b07-478f-ba87-92d7c3fbcb47 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f" status: 404 len: 111 microversion: 2.1 time: 0.031061 Jul 30 21:31:20.306301 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2683/5413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:20 2022] GET /compute/v2.1/servers/36d84983-d687-4119-97a2-c27a55ab6c0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:31:20.404593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-789180533", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b1163f83-1612-4565-98cb-787ca27d6fe3"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:20.470710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] validate_networks() for [('b1163f83-1612-4565-98cb-787ca27d6fe3', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:31:20.782452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:20.783194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:20.792171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.792748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.793640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.794324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.896132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:31:20.896857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:31:20.898016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:31:20.898668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:31:20.899322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:31:20.904532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:20.911414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.912024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.913968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.914626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:20.941316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Getting quotas for project d3d6725c617b4a29a437ea385e84a684. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:20.949490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Getting quotas for user 0114359ded1f4ac588c8b1f0f31737ff and project d3d6725c617b4a29a437ea385e84a684. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:20.950572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:20.960301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-250e4408-d9c8-44fa-8af6-7f8cfe82fcf9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1701 microversion: 2.1 time: 0.181609 Jul 30 21:31:20.960920 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2684/5414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:20 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1701 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:20.966673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:31:20.969594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:31:20.986855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa8dddd5-ade5-4846-ab0f-b15893602693 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:20.997279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8dddd5-ade5-4846-ab0f-b15893602693 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:20.998199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8dddd5-ade5-4846-ab0f-b15893602693 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:21.029710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa8dddd5-ade5-4846-ab0f-b15893602693 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Going to try to start instance {{(pid=130983) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:31:21.045329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b09f7e81-b66e-489b-832e-5417c4eacc3b tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644579 Jul 30 21:31:21.052328 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2731/5415] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:31:21.058147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e365fe46-67df-401e-b136-1d70fe04ff5c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:21.059150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e365fe46-67df-401e-b136-1d70fe04ff5c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:21.086955 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa8dddd5-ade5-4846-ab0f-b15893602693 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action" status: 202 len: 0 microversion: 2.1 time: 0.108430 Jul 30 21:31:21.088363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2685/5416] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:31:20 2022] POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:31:21.099646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:21.101799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:21.109139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:21.110042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:21.111793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:21.112425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:21.116094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e365fe46-67df-401e-b136-1d70fe04ff5c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:21.124480 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e365fe46-67df-401e-b136-1d70fe04ff5c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1213 microversion: 2.1 time: 0.069246 Jul 30 21:31:21.124480 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2732/5417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:21 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:21.350932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:21.364842 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3caefae3-a9a6-4d10-bc80-2aeeac0137f4 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1710 microversion: 2.1 time: 0.271162 Jul 30 21:31:21.366369 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2686/5418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:21 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1710 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:22.143693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:22.144875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:22.153864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:22.154325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:22.155275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:22.155757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:22.217310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:22.225904 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ecc999e6-4e2b-4a4e-85c7-79ae07a7b1d6 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1265 microversion: 2.1 time: 0.085885 Jul 30 21:31:22.226496 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2733/5419] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:22 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:22.387167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:22.387862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:22.395080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:22.395821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:22.396685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:22.397144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:22.736311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:22.752743 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11def36e-48fd-4fb8-beb5-a0d8653149ab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1710 microversion: 2.1 time: 0.369440 Jul 30 21:31:22.753678 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2687/5420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:22 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1710 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:23.248369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:23.249613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:23.258420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:23.259353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:23.269999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:23.270511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:23.549208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:23.562640 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b0b1aeb0-3084-4e46-9834-a651778d7a00 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.319258 Jul 30 21:31:23.565956 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2734/5421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:23 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:23.775210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:23.776792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:23.793450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:23.794401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:23.795470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:23.796374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:24.019098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:24.020080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:24.026808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:24.027574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:24.028610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:24.029069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:24.284162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:24.295304 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b58ea5b-3dce-49c8-85bb-84f603ce5f38 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1833 microversion: 2.1 time: 0.279946 Jul 30 21:31:24.296949 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2735/5422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:24 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1833 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:24.302543 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7016ef4-4596-4c94-bd44-923d00d6681e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1714 microversion: 2.1 time: 0.530063 Jul 30 21:31:24.306798 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2688/5423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:23 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1714 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:24.593863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:24.595044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:24.602165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:24.603013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:24.604303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:24.605017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:24.969211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1903b86b-347b-439c-a2ad-698ee8dd8520 req-a00e491d-d1b6-47f0-9551-081a4488028b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b2128f-7455-4215-a480-cc4345a10e17", "tag": "cd9fbdbb-e56f-4215-a0e6-c6cdb5612506"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:25.017664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1903b86b-347b-439c-a2ad-698ee8dd8520 req-a00e491d-d1b6-47f0-9551-081a4488028b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:25.018428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1903b86b-347b-439c-a2ad-698ee8dd8520 req-a00e491d-d1b6-47f0-9551-081a4488028b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:25.030990 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1903b86b-347b-439c-a2ad-698ee8dd8520 req-a00e491d-d1b6-47f0-9551-081a4488028b service nova] Creating event network-changed:cd9fbdbb-e56f-4215-a0e6-c6cdb5612506 for instance 78b2128f-7455-4215-a480-cc4345a10e17 on nch1-master-1 Jul 30 21:31:25.037412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1903b86b-347b-439c-a2ad-698ee8dd8520 req-a00e491d-d1b6-47f0-9551-081a4488028b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081063 Jul 30 21:31:25.038607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2689/5424] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:25.042718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:25.050504 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f89694d4-bcc6-4ef2-bf13-d3d445756d8a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.460613 Jul 30 21:31:25.051642 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2736/5425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:24 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:26.073936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:26.075261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:26.082587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.083260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.084269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.084997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.236204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:26.245076 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fff69f41-40de-4047-b692-bdd392d8b438 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.176837 Jul 30 21:31:26.246314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2690/5426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:26 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:26.402007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:26.402611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:26.410243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-70240e2c-e75a-4566-b0a1-ac8e995b6937 req-b5bd0846-20f0-4c90-bad1-c3876551256c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:26.414028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.414489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.415384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.415762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.447110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-70240e2c-e75a-4566-b0a1-ac8e995b6937 req-b5bd0846-20f0-4c90-bad1-c3876551256c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.448354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-70240e2c-e75a-4566-b0a1-ac8e995b6937 req-b5bd0846-20f0-4c90-bad1-c3876551256c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.452366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:31:26.477297 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-70240e2c-e75a-4566-b0a1-ac8e995b6937 req-b5bd0846-20f0-4c90-bad1-c3876551256c service nova] Creating event network-changed:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch2-master-1 Jul 30 21:31:26.484305 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-70240e2c-e75a-4566-b0a1-ac8e995b6937 req-b5bd0846-20f0-4c90-bad1-c3876551256c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080590 Jul 30 21:31:26.490721 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2691/5427] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:26.601976 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-92205174-393a-4e78-8c3b-093d9d47fc22 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 204 len: 0 microversion: 2.1 time: 0.203941 Jul 30 21:31:26.603182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2737/5428] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:31:26 2022] DELETE /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:31:26.612599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:26.613830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:26.623540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.624280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:26.625629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:26.626444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:27.041954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:27.050698 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aecb43c6-de98-49ed-b3a3-7bf461afdf9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1688 microversion: 2.1 time: 0.443001 Jul 30 21:31:27.054702 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2692/5429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:26 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1688 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:27.267268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:27.268032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:27.284600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:27.285355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:27.290351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:27.291048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:27.554689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:27.566930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a30f8bc-13c3-4988-9c94-57d6dc934849 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.303992 Jul 30 21:31:27.579923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2738/5430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:27 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:28.077358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:28.078631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:28.088277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:28.088747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:28.089556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:28.090073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:28.472921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:28.485014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a0677ae-69f0-4ab1-b8ee-fe352bceee9e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 200 len: 1688 microversion: 2.1 time: 0.412091 Jul 30 21:31:28.487712 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2693/5431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:28 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 1688 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:28.588022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:28.588669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:28.598286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:28.598781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:28.599550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:28.602984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:28.804899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:28.812666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9c3754eb-ba72-4668-a67c-45406382f943 req-bed8d24e-23a4-4079-901d-44f8a16a5b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3393e8-259b-450f-960c-571c6b6b2723", "name": "network-vif-deleted", "tag": "ea17c94b-a799-4122-83e6-5fb812307f35"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:28.817251 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a4cb5909-67cc-468f-994b-23ad1fc4566a tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.233141 Jul 30 21:31:28.818228 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2739/5432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:28 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:28.832305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9c3754eb-ba72-4668-a67c-45406382f943 req-bed8d24e-23a4-4079-901d-44f8a16a5b64 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:28.832788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9c3754eb-ba72-4668-a67c-45406382f943 req-bed8d24e-23a4-4079-901d-44f8a16a5b64 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:28.852291 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9c3754eb-ba72-4668-a67c-45406382f943 req-bed8d24e-23a4-4079-901d-44f8a16a5b64 service nova] Creating event network-vif-deleted:ea17c94b-a799-4122-83e6-5fb812307f35 for instance eb3393e8-259b-450f-960c-571c6b6b2723 on nch2-master-1 Jul 30 21:31:28.859899 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9c3754eb-ba72-4668-a67c-45406382f943 req-bed8d24e-23a4-4079-901d-44f8a16a5b64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054584 Jul 30 21:31:28.860539 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2694/5433] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:29.514140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:29.515185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: eb3393e8-259b-450f-960c-571c6b6b2723] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:29.524040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:29.524711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:29.525658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:29.526416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:29.542765 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] HTTP exception thrown: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Request method failure captured: Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 HTTP/1.1 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aKp90dBlJxMh9WaS3Gkq8gfM6d3-8CW3esqUHxEuCANA_gqkiFmN_HnVJHO6yowKHncdygk0zqfSahCnQ0Jc7c0nZC3rQBEysFKa_cSm1_zBYPdjJVetekWVSZ7A9FqS6XppBVFwcCGkdqB6qkkULx-peDevL2cETeLnN9aiv-ImQs Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4a16baf2cd6043c79dbe21fafc13eb28", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9f113fc80feb42148c3dad0c33417dfe Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'eb3393e8-259b-450f-960c-571c6b6b2723'} Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:29.545738 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. Jul 30 21:31:29.550075 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:29.552405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Returning 404 to user: Instance eb3393e8-259b-450f-960c-571c6b6b2723 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:31:29.555223 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6eb75671-92ac-409e-89b4-4749201d766c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723" status: 404 len: 111 microversion: 2.1 time: 0.045376 Jul 30 21:31:29.556997 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2740/5434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:29 2022] GET /compute/v2.1/servers/eb3393e8-259b-450f-960c-571c6b6b2723 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:31:29.841286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:29.842772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:29.850184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:29.850751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:29.851843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:29.852398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:30.642400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:30.652652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26001c3c-9360-406d-b116-65fa90b96d20 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.817932 Jul 30 21:31:30.653251 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2695/5435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:29 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:31.675283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:31.677485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:31.685919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:31.687153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:31.705835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:31.707650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:31.710965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:31.711573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:32.245580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-384db386-1f23-4db7-84e3-4fd7c22b450d req-3f3eb7a1-bba4-4d58-8d62-4214a391d368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b2128f-7455-4215-a480-cc4345a10e17", "name": "network-vif-plugged", "status": "completed", "tag": "cd9fbdbb-e56f-4215-a0e6-c6cdb5612506"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:32.267775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-384db386-1f23-4db7-84e3-4fd7c22b450d req-3f3eb7a1-bba4-4d58-8d62-4214a391d368 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:32.268238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-384db386-1f23-4db7-84e3-4fd7c22b450d req-3f3eb7a1-bba4-4d58-8d62-4214a391d368 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:32.290334 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-384db386-1f23-4db7-84e3-4fd7c22b450d req-3f3eb7a1-bba4-4d58-8d62-4214a391d368 service nova] Creating event network-vif-plugged:cd9fbdbb-e56f-4215-a0e6-c6cdb5612506 for instance 78b2128f-7455-4215-a480-cc4345a10e17 on nch1-master-1 Jul 30 21:31:32.306960 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-384db386-1f23-4db7-84e3-4fd7c22b450d req-3f3eb7a1-bba4-4d58-8d62-4214a391d368 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065828 Jul 30 21:31:32.307964 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2696/5436] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:32.392923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:32.402725 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6ec75a2b-3241-4b9b-bbdc-e4f3ba867d75 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.730911 Jul 30 21:31:32.418618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2741/5437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:31 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:33.426278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:33.430504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:33.443181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:33.446626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:33.450478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:33.452180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:33.882454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:33.893369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b13a233e-28fe-4eba-8bfb-e41613da4ff4 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1313 microversion: 2.1 time: 0.471204 Jul 30 21:31:33.901943 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2697/5438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:33 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:34.933800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:34.935130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:34.944416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:34.945125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:34.946095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:34.946945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:35.150942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:35.165291 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-36004aad-ec63-4fc6-90dc-f7cc7b3973b3 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1497 microversion: 2.1 time: 0.245307 Jul 30 21:31:35.166319 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2742/5439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:34 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:35.995899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:35.997140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:36.016468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:36.017204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:36.020209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:36.020845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:36.102974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:36.120611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:31:36.409810 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d99e747-3e7a-4461-99a6-8ff318e7fa2c tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 204 len: 0 microversion: 2.1 time: 0.419747 Jul 30 21:31:36.414590 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2698/5440] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:31:35 2022] DELETE /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:31:36.434392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:36.436456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:36.451838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:36.453797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:36.456602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:36.457467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:36.927665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:36.944194 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c8cf297-613b-46d0-b332-83202b53dfd1 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1503 microversion: 2.1 time: 0.522655 Jul 30 21:31:36.944943 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2743/5441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:36 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1503 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:37.966864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:37.967661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:37.978105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:37.978921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:37.993200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:38.000488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:38.573715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:38.587843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-286950f0-c196-4c03-aa78-2f77abce7d05 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1503 microversion: 2.1 time: 0.625154 Jul 30 21:31:38.588551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2699/5442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:37 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:38.633309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3ebbdac-9f41-4bff-860f-952bce394858 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '.version_select at 0x7fbb4fbdadc0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:38.681103 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3ebbdac-9f41-4bff-860f-952bce394858 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1122464873" status: 202 len: 0 microversion: 2.1 time: 0.052868 Jul 30 21:31:38.682385 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2744/5443] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 21:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1122464873 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:31:38.725143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7dc3a87-5813-48d9-9830-c2a8a18fd6bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: .version_select at 0x7fbb62896ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-794826589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmwHf+jkPNMjdU4wyHd8J++/kqoZe1jZlGvFoiDUyp74uzFpbfhAWRtI4QZ2hWy+Egy+jz85g/YvNdBtx+W7s/6cOqy9Jkeowo3/tfk8sYul4Ye8QpTLs3cTYlSHu6i7A=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:38.775947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e7dc3a87-5813-48d9-9830-c2a8a18fd6bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:38.783639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e7dc3a87-5813-48d9-9830-c2a8a18fd6bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:38.848030 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7dc3a87-5813-48d9-9830-c2a8a18fd6bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.127264 Jul 30 21:31:38.849921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2700/5444] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:31:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:39.608013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:39.610241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:39.633740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:39.634223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:39.635045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:39.635542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:39.792375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:39.811141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:39.811927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:39.812421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lazy-loading 'fault' on Instance uuid 78b2128f-7455-4215-a480-cc4345a10e17 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:31:39.935888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0114359ded1f4ac588c8b1f0f31737ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d6725c617b4a29a437ea385e84a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:39.961227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-260de5a7-2d5e-43a3-b10a-761065f48e41 req-0dbfef56-e3e0-4c79-b846-d1b2859fcf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b2128f-7455-4215-a480-cc4345a10e17", "name": "network-vif-deleted", "tag": "cd9fbdbb-e56f-4215-a0e6-c6cdb5612506"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:39.967834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-361c3af5-4f76-4eca-83b0-d2fc99f9c5e7 tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 200 len: 1303 microversion: 2.1 time: 0.362495 Jul 30 21:31:39.968559 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2701/5445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:39 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 1303 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:40.007554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-260de5a7-2d5e-43a3-b10a-761065f48e41 req-0dbfef56-e3e0-4c79-b846-d1b2859fcf05 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:40.009774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-260de5a7-2d5e-43a3-b10a-761065f48e41 req-0dbfef56-e3e0-4c79-b846-d1b2859fcf05 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:40.038343 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-260de5a7-2d5e-43a3-b10a-761065f48e41 req-0dbfef56-e3e0-4c79-b846-d1b2859fcf05 service nova] Creating event network-vif-deleted:cd9fbdbb-e56f-4215-a0e6-c6cdb5612506 for instance 78b2128f-7455-4215-a480-cc4345a10e17 on nch1-master-1 Jul 30 21:31:40.049035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-260de5a7-2d5e-43a3-b10a-761065f48e41 req-0dbfef56-e3e0-4c79-b846-d1b2859fcf05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.708906 Jul 30 21:31:40.050145 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2745/5446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:40.142483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:40.143668 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:31:40.143668 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:31:40.145997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:40.147166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:40.148723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:40.150095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:40.187696 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34ab92ed-3fb2-4442-9c43-12d6591e31f8 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.147492 Jul 30 21:31:40.191468 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2702/5447] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Jul 30 21:31:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:40.369371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-566955875", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e3710b20-6e24-42bc-88b4-53efdc1a9b74"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:40.492118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] validate_networks() for [('e3710b20-6e24-42bc-88b4-53efdc1a9b74', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:31:40.545281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1130930905", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "bcf5a444-6465-4b5c-b72a-413dc169d21e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-431975755", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ae8161b8-c374-4519-96fd-1aacab5b7d2c"]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:40.628369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] validate_networks() for [('bcf5a444-6465-4b5c-b72a-413dc169d21e', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:31:41.054563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:31:41.055545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:31:41.056280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:31:41.056881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:31:41.057489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:31:41.082122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.082517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.083432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.083831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.126719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Getting quotas for project ff13fa2ab2ea4813adf39c4c4c3ece12. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:41.133802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Getting quotas for user 9512e7df6b054f1f98e4293ad1247741 and project ff13fa2ab2ea4813adf39c4c4c3ece12. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:41.181780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:31:41.186864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:31:41.253992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5fd6f48-fe3b-49c3-b1b9-9c803de55d8b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889397 Jul 30 21:31:41.261343 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2746/5448] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:31:41.267331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:41.268214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] [instance: 78b2128f-7455-4215-a480-cc4345a10e17] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:41.275059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.275586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.276383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.276841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.325906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] HTTP exception thrown: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Request method failure captured: Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 HTTP/1.1 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aMSSHVomn4o2mq_efNXogMTAaceTv437G856a5i7I-poEtZwYrYRmQ_XatOKtVFv7-EzeET7PDExtxptDPZsLi4n-vG2bhf_YaiatB9sPAoXrR2DNb6CBiR9bwI54s0rb4J4aIZzyViaWDK8E0ZheWxS7wuF3y4_9uH6K7zO_ilmqU Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d3d6725c617b4a29a437ea385e84a684 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3d6725c617b4a29a437ea385e84a684", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3d6725c617b4a29a437ea385e84a684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d3d6725c617b4a29a437ea385e84a684 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesActionsTest-1001371749 Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesActionsTest-1001371749-project Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 0114359ded1f4ac588c8b1f0f31737ff Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesActionsTest-1001371749-project Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '78b2128f-7455-4215-a480-cc4345a10e17'} Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:31:41.327709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. Jul 30 21:31:41.332506 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:31:41.346046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] Returning 404 to user: Instance 78b2128f-7455-4215-a480-cc4345a10e17 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:31:41.346984 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e1b0e49-b533-42cc-812b-305277a297dd tempest-VolumesActionsTest-1001371749 tempest-VolumesActionsTest-1001371749-project] 10.222.0.17 "GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17" status: 404 len: 111 microversion: 2.1 time: 0.083767 Jul 30 21:31:41.347608 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2747/5449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:41 2022] GET /compute/v2.1/servers/78b2128f-7455-4215-a480-cc4345a10e17 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:31:41.359864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1660abcc-1b75-4e81-be86-148aca6b52f0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:41.360498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1660abcc-1b75-4e81-be86-148aca6b52f0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:41.437047 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1660abcc-1b75-4e81-be86-148aca6b52f0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1328 microversion: 2.1 time: 0.088010 Jul 30 21:31:41.441962 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2748/5450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:41 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:41.577000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:31:41.577421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:31:41.577915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:31:41.578336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:31:41.578757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:31:41.616853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.617328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.618163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:41.618615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:41.686400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for project 434fef0893984988a8acc8b251efdddc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:41.702073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Getting quotas for user 67db2c00c71f469f9a7a871ed28e97e4 and project 434fef0893984988a8acc8b251efdddc. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:41.737623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:31:41.741523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:31:41.847587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-98cab0be-e7e7-4cfd-bd1f-f35664bfd12b tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.304678 Jul 30 21:31:41.849284 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2703/5451] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:31:40 2022] POST /compute/v2.1/servers => generated 361 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:31:41.860478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b06340e2-75c8-4ebe-83fb-0adb1d2e2ee5 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:41.861462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b06340e2-75c8-4ebe-83fb-0adb1d2e2ee5 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:42.310318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b06340e2-75c8-4ebe-83fb-0adb1d2e2ee5 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:42.323558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b06340e2-75c8-4ebe-83fb-0adb1d2e2ee5 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1241 microversion: 2.1 time: 0.464632 Jul 30 21:31:42.326501 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2749/5452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:41 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1241 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:42.459967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:42.460613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:42.493400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:42.494027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:42.495186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:42.496143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:42.687113 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e44f0020-cf19-4bea-8884-ca28045cf4b6 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1345 microversion: 2.1 time: 0.232641 Jul 30 21:31:42.690612 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2704/5453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:42 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:43.350444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:43.351446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:43.372550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:43.373147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:43.374086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:43.374642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:43.602622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:43.620755 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-017b6292-243b-4b40-a6dd-ae755af19730 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1293 microversion: 2.1 time: 0.269657 Jul 30 21:31:43.626558 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2750/5454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:43 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1293 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:43.712846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:43.713544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:43.732345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:43.732830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:43.733681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:43.734140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:44.303701 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4a6fd72-8001-4e81-a7e8-6c584c240623 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1433 microversion: 2.1 time: 0.595793 Jul 30 21:31:44.308668 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2705/5455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:43 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1433 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:44.648597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:44.650272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:44.668035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:44.672682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:44.674907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:44.676911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:44.817769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:44.831069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79ae0d70-5fc6-4f96-be71-489cf79d3f26 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.188663 Jul 30 21:31:44.831647 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2751/5456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:44 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:45.330281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:45.331530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:45.377464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:45.377967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:45.391492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:45.392010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:45.854787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:45.855437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:45.884650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:45.885200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:45.889708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:45.890178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:45.996008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:46.005049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:46.011180 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-293a735b-4a0f-49c9-b737-a10c85578fce tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.161178 Jul 30 21:31:46.012365 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2752/5457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:45 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:46.186523 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4d6b8cb9-fa67-46d9-beae-72fa2f013a6f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.859323 Jul 30 21:31:46.191654 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2706/5458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:45 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:47.054155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:47.063606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:47.080735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:47.081492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:47.084115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:47.085675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:47.186879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:47.195240 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a2911ba-de3d-462c-9262-2d394cf47b08 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.165400 Jul 30 21:31:47.197834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2753/5459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:47 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:47.217019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:47.217985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:47.229256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:47.232366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:47.234492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:47.235051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:47.944970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c6bbc1ea-33e7-4336-84e5-3a6dbc34319b tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.731480 Jul 30 21:31:47.959109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2707/5460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:47 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:48.218132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:48.219089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:48.226314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:48.234943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:48.236045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:48.236642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:48.380564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:48.398662 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-576500d6-ad42-463c-8833-c3b4fe4c90f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.184287 Jul 30 21:31:48.402704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2754/5461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:48 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:48.629219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6b09c986-f4c7-489f-8a83-8103a80fe0b4 req-7afa70c5-e622-4257-b9b4-b04ee795f0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0f4749-2cee-4452-950a-1e4b56056f6e", "tag": "39446b33-c2a8-49f7-92f1-41b5c78d474d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:48.651432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6b09c986-f4c7-489f-8a83-8103a80fe0b4 req-7afa70c5-e622-4257-b9b4-b04ee795f0f0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:48.652707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6b09c986-f4c7-489f-8a83-8103a80fe0b4 req-7afa70c5-e622-4257-b9b4-b04ee795f0f0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:48.670621 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6b09c986-f4c7-489f-8a83-8103a80fe0b4 req-7afa70c5-e622-4257-b9b4-b04ee795f0f0 service nova] Creating event network-changed:39446b33-c2a8-49f7-92f1-41b5c78d474d for instance fa0f4749-2cee-4452-950a-1e4b56056f6e on nch1-master-1 Jul 30 21:31:48.680953 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6b09c986-f4c7-489f-8a83-8103a80fe0b4 req-7afa70c5-e622-4257-b9b4-b04ee795f0f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058227 Jul 30 21:31:48.682070 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2708/5462] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:48.966685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:48.967748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:49.012845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:49.014423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:49.015401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:49.016839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:49.235418 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57d0fef9-2114-4a6c-a5b9-f169ece01f23 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.272807 Jul 30 21:31:49.237495 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2755/5463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:48 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:49.424890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:49.425618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:49.448820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:49.449271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:49.450093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:49.450552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:49.691112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:49.708836 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3adcac2b-cbae-40ff-bad1-b1b44f3a58c0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.287942 Jul 30 21:31:49.709450 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2709/5464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:49 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:50.306017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:50.306017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:50.324684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:50.325165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:50.325982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:50.326669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:50.701285 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac665181-75fd-44b4-982a-5b31e7804da5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.430627 Jul 30 21:31:50.701883 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2756/5465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:50 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:50.723935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-62994156-8ad4-4f3c-8b45-a145a5fb9f4b req-36284533-8c78-425b-8b92-8e9a44bfe318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a6c0ab-4ded-456e-93b3-9b0f1ca19af1", "tag": "c2038b30-c6ed-43cc-919c-09b65dc75072"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:50.734644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:50.735328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:50.741873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-62994156-8ad4-4f3c-8b45-a145a5fb9f4b req-36284533-8c78-425b-8b92-8e9a44bfe318 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:50.742740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-62994156-8ad4-4f3c-8b45-a145a5fb9f4b req-36284533-8c78-425b-8b92-8e9a44bfe318 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:50.745851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:50.752934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:50.754202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:50.756380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:50.769760 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-62994156-8ad4-4f3c-8b45-a145a5fb9f4b req-36284533-8c78-425b-8b92-8e9a44bfe318 service nova] Creating event network-changed:c2038b30-c6ed-43cc-919c-09b65dc75072 for instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 on nch2-master-1 Jul 30 21:31:50.777322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-62994156-8ad4-4f3c-8b45-a145a5fb9f4b req-36284533-8c78-425b-8b92-8e9a44bfe318 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057501 Jul 30 21:31:50.778490 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2710/5466] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:50.977738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:50.998635 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03c5a2fd-b98b-4efe-9fe9-af3f6a463a79 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.268762 Jul 30 21:31:51.000356 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2757/5467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:50 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:51.725706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:51.729083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:51.744985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:51.746417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:51.749539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:51.758012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:51.762289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:51.765862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:52.027749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:52.028934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:52.031715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:52.034592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:52.070289 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-36616949-c54d-43f4-a0a2-b509bfefc1d0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.351597 Jul 30 21:31:52.072619 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2711/5468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:51 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:52.074313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:52.075509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:52.077168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:52.078397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:52.220375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:52.249150 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0ef9a42-001c-4ad4-be6d-e1ddbd541f58 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.223908 Jul 30 21:31:52.250486 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2758/5469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:52 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:53.093931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:53.094731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:53.109571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:53.111839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:53.115997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:53.117089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:53.384403 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-24c88ff0-6532-4124-a106-2a98b9a3850f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.293661 Jul 30 21:31:53.385311 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2712/5470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:53 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:53.393420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:53.394063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:53.396587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:53.422345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:53.423103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:53.424248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:53.428509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:53.635617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:53.655108 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9cc12b6c-83f1-4c79-b500-d00c9c82c6ea tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.265169 Jul 30 21:31:53.656086 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2759/5471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:53 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:54.407853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:54.409119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:54.430397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:54.431071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:54.431936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:54.432404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:54.680918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:54.681510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:54.717002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:54.717484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:54.718302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:54.718759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:54.887564 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b34d42e9-8daf-4549-93e2-d99187def2cb tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.484721 Jul 30 21:31:54.904274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2713/5472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:54 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:55.071046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:55.079841 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-979d1c13-1931-40d5-b950-a99a1084939d tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.406373 Jul 30 21:31:55.086037 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2760/5473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:54 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:55.625382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1849896826", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "9b9b50ba-5243-4aa3-a7b9-ea43d90fd25c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-794826589", "security_groups": [{"name": "tempest-secgroup-smoke-60277921"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:55.819987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] validate_networks() for [('9b9b50ba-5243-4aa3-a7b9-ea43d90fd25c', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:31:55.912335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:55.913712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:55.928269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:55.928735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:55.929537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:55.929978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.299244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c89f503a-cab5-4a7b-ac2c-46d09065d377 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.392956 Jul 30 21:31:56.312589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2761/5474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:55 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:56.319675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:56.320571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:56.327744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.328433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.329908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.330543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.569157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:56.580532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d75b802e-7980-4981-a5b0-75cb84bcdf20 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.266262 Jul 30 21:31:56.594137 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2762/5475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:56 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:56.609398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:56.618120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:56.641978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.643897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.646694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.647156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.806062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lazy-loading 'services' on Instance uuid 1c28cc18-83ac-4376-bab3-01c3219dbf21 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:31:56.892586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:31:56.893194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:31:56.893494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:31:56.893918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:31:56.894353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:31:56.913281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.913950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.915002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:56.917930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:56.966565 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a18e1241-f838-4f2d-85da-049273368113 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments/600fb7d5-259f-4c12-a1f9-57e6e59664cd" status: 202 len: 0 microversion: 2.1 time: 0.360896 Jul 30 21:31:56.967742 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2763/5476] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:31:56 2022] DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments/600fb7d5-259f-4c12-a1f9-57e6e59664cd => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:31:56.969266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:31:57.010386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:31:57.061542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:31:57.064370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:31:57.206184 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f30f0cf-0658-4234-9021-1cfa0fc895ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.585814 Jul 30 21:31:57.219390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd58bff7-bc92-48e2-8a04-ebdf7ae64a15 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:57.220111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd58bff7-bc92-48e2-8a04-ebdf7ae64a15 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:57.226485 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2714/5477] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:31:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:31:57.359359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd58bff7-bc92-48e2-8a04-ebdf7ae64a15 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:57.373758 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd58bff7-bc92-48e2-8a04-ebdf7ae64a15 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1266 microversion: 2.1 time: 0.154887 Jul 30 21:31:57.380960 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2764/5478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:57 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:57.392220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:57.394256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:57.417974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:57.418445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:57.419242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:57.419728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:57.449517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a5e50239-690c-4a79-95c8-5394efecd20e req-9042543f-4de7-454d-9281-fb77b650a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0f4749-2cee-4452-950a-1e4b56056f6e", "name": "network-vif-plugged", "status": "completed", "tag": "39446b33-c2a8-49f7-92f1-41b5c78d474d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:57.476353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a5e50239-690c-4a79-95c8-5394efecd20e req-9042543f-4de7-454d-9281-fb77b650a3a9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:57.485020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a5e50239-690c-4a79-95c8-5394efecd20e req-9042543f-4de7-454d-9281-fb77b650a3a9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:57.525383 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a5e50239-690c-4a79-95c8-5394efecd20e req-9042543f-4de7-454d-9281-fb77b650a3a9 service nova] Creating event network-vif-plugged:39446b33-c2a8-49f7-92f1-41b5c78d474d for instance fa0f4749-2cee-4452-950a-1e4b56056f6e on nch1-master-1 Jul 30 21:31:57.547473 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a5e50239-690c-4a79-95c8-5394efecd20e req-9042543f-4de7-454d-9281-fb77b650a3a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313267 Jul 30 21:31:57.575080 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2715/5479] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:31:57.653855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:57.655057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:57.698465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:57.701662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:57.702714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:57.703534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:57.882532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:57.900121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4491fb07-be4a-4ebe-8a88-58a593acb5a4 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.287439 Jul 30 21:31:57.900810 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2716/5480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:57 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:57.909419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3b86e4e1-7c35-45af-b451-3e9c1a8ab8ce tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.525153 Jul 30 21:31:57.910519 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2765/5481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:57 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:58.260883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e5d983c-0d90-45e3-a543-f568007a6901 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:58.275675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e5d983c-0d90-45e3-a543-f568007a6901 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.277401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e5d983c-0d90-45e3-a543-f568007a6901 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.353042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e5d983c-0d90-45e3-a543-f568007a6901 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:31:58.398058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:58.398689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:58.409569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:58.416644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.422886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.424055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.425275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.476417 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e5d983c-0d90-45e3-a543-f568007a6901 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action" status: 202 len: 0 microversion: 2.1 time: 0.219462 Jul 30 21:31:58.477528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2717/5482] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:31:58 2022] POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:31:58.509670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:58.510544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:58.527090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.529478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.530640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.541615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.577283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:58.591246 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7240db7-a915-423c-b7d0-912437a01825 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1270 microversion: 2.1 time: 0.197619 Jul 30 21:31:58.591874 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2766/5483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:58 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:58.834403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:58.846687 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7028a6c-c743-436a-af3a-a81be819b5e7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.353965 Jul 30 21:31:58.859321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2718/5484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:58 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:58.925396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:58.927777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:58.930766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:58.931662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:58.943713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.944146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.948753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.951825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.952420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.952838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:58.953692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:58.955156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:59.188129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b125249b-b447-4b50-acc6-330403c379cc tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1463 microversion: 2.1 time: 0.261884 Jul 30 21:31:59.188959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:59.191144 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2719/5485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:58 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:31:59.203600 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e2b34d8-6536-4919-bd9b-6dfe9640b2d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.281898 Jul 30 21:31:59.204742 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2767/5486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:58 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:59.613693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:59.614334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:59.623435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:59.625574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:59.631940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:59.634792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:59.681560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-962c5841-3722-4372-8379-cfca030b62d6 req-8ee7d6b0-2d40-434a-a065-2cd97a901433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6c0ab-4ded-456e-93b3-9b0f1ca19af1", "name": "network-vif-plugged", "status": "completed", "tag": "c2038b30-c6ed-43cc-919c-09b65dc75072"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:31:59.711844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-962c5841-3722-4372-8379-cfca030b62d6 req-8ee7d6b0-2d40-434a-a065-2cd97a901433 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:59.714719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-962c5841-3722-4372-8379-cfca030b62d6 req-8ee7d6b0-2d40-434a-a065-2cd97a901433 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:59.746936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-962c5841-3722-4372-8379-cfca030b62d6 req-8ee7d6b0-2d40-434a-a065-2cd97a901433 service nova] Creating event network-vif-plugged:c2038b30-c6ed-43cc-919c-09b65dc75072 for instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 on nch2-master-1 Jul 30 21:31:59.762932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-962c5841-3722-4372-8379-cfca030b62d6 req-8ee7d6b0-2d40-434a-a065-2cd97a901433 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086683 Jul 30 21:31:59.773121 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2768/5487] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:31:59.804412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:31:59.825712 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a409a5a6-9f55-4be7-aa27-abaea1d598ce tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1324 microversion: 2.1 time: 0.215343 Jul 30 21:31:59.828324 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2720/5488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:59 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:31:59.869726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:31:59.874106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:31:59.884493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:59.885588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:31:59.886573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:31:59.887190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.189396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:00.206419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8488fed9-fac9-4bfd-92d7-d23310185a95 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.340968 Jul 30 21:32:00.227097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2769/5489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:31:59 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:00.228825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:00.229337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:00.237665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:00.237904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.238185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.239010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.240576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.242531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:00.249973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.251122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.253062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.253822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.292183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:00.425743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:00.437622 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7541bee-7fbf-4bd8-b75b-cca9815d0218 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1299 microversion: 2.1 time: 0.206703 Jul 30 21:32:00.438661 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2770/5490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:00 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:00.536487 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d93d4081-54ba-4751-b44a-761343d1b76f tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1649 microversion: 2.1 time: 0.318865 Jul 30 21:32:00.551610 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2721/5491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:00 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1649 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:00.556997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:00.557750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:00.564987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.565790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.566729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.567187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.741656 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-adc3cebb-a3c6-4780-8bec-d9025b4f5d59 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1649 microversion: 2.1 time: 0.186544 Jul 30 21:32:00.743227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2771/5492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:00 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1649 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:00.767220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:00.767883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:00.778384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.778876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.781641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.782106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.854498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:00.854851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:00.866767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.867171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:00.867988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:00.871850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.102692 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-115a851f-0411-47eb-ad05-77e73666e267 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1649 microversion: 2.1 time: 0.339586 Jul 30 21:32:01.106733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2722/5493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:00 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1649 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:01.150824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:01.168098 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a46754fd-a955-4c72-8dc6-6f308ac8332b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.319528 Jul 30 21:32:01.181729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-97838587", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e3710b20-6e24-42bc-88b4-53efdc1a9b74"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:01.184745 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2772/5494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:00 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:01.237527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:01.238318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:01.252299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.252876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.253782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.256051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.300262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] validate_networks() for [('e3710b20-6e24-42bc-88b4-53efdc1a9b74', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:32:01.444382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:01.453163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0e637ec9-e2d6-4668-bcfa-3317b46bdfb1 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.222435 Jul 30 21:32:01.468208 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2773/5495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:01 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:01.477100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:01.478522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:01.485521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.486093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.487034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.487612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.609314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:01.622265 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-013c9e23-c27a-4bec-a470-d7328e605efb tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1472 microversion: 2.1 time: 0.152430 Jul 30 21:32:01.624339 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2774/5496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:01 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:01.646684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:01.648425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:01.655558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.656343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.658326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.659778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.767976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:01.777910 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4cf98a0d-2e60-42ac-937e-2374816ac5f8 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1472 microversion: 2.1 time: 0.137151 Jul 30 21:32:01.778932 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2775/5497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:01 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1472 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:01.802433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:01.803346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:01.809814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.810302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.811199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.811679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.903543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fcf251ab-bc3d-4eac-9ffc-e69ccba59ac7 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1623 microversion: 2.1 time: 0.105188 Jul 30 21:32:01.904738 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2776/5498] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:01 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1623 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:01.910918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:32:01.911622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:32:01.912265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:32:01.912838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:32:01.913645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:32:01.925119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:01.926489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.927006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.927497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:01.927876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.928329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.946424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.947535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.948680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:01.949336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:01.969403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Getting quotas for project ff13fa2ab2ea4813adf39c4c4c3ece12. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:01.975684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Getting quotas for user 9512e7df6b054f1f98e4293ad1247741 and project ff13fa2ab2ea4813adf39c4c4c3ece12. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:01.996128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:32:01.999157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:32:02.057582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14cbf7f0-1143-4c56-b598-f7b645b39ee7 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880236 Jul 30 21:32:02.059689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2723/5499] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:32:02.076539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-87803ac1-dcd4-4e79-a9e9-0cc53b7fca94 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:02.077491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-87803ac1-dcd4-4e79-a9e9-0cc53b7fca94 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:02.169641 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-87803ac1-dcd4-4e79-a9e9-0cc53b7fca94 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1327 microversion: 2.1 time: 0.099337 Jul 30 21:32:02.171841 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2724/5500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:02 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:02.178604 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44742020-831a-4ad0-9318-12b177e80a22 tempest-TestSecurityGroupsBasicOps-555622836 tempest-TestSecurityGroupsBasicOps-555622836-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1912 microversion: 2.1 time: 0.257090 Jul 30 21:32:02.183329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2777/5501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:01 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1912 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:02.200742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:02.202384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:02.203916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:02.218342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.218916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.219803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.220329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.278855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:02.281391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:02.290216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.290693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.291575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.292028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.321472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:02.486192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:02.497192 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09f45de8-26e6-4a27-9938-6560a1ad1c51 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.304591 Jul 30 21:32:02.523398 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2725/5502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:02 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:02.544349 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33638e3b-e08e-4860-abc2-24321169c8d9 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 204 len: 0 microversion: 2.1 time: 0.272377 Jul 30 21:32:02.545493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2778/5503] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:02 2022] DELETE /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:32:02.546351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:02.547013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:02.555031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:02.556417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:02.562730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.563047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.563881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.564346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.564621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.565144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.566089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.566649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.759856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:02.775407 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-acfb266e-a2ef-43bb-a402-fac9e4238ddd tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1478 microversion: 2.1 time: 0.225178 Jul 30 21:32:02.776119 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2779/5504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:02 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:02.789803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e1565c99-9d5b-46a9-98e6-9c8a8ad484b0 req-3793f657-c412-47ca-b177-be58b3a578ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:02.825474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1565c99-9d5b-46a9-98e6-9c8a8ad484b0 req-3793f657-c412-47ca-b177-be58b3a578ff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:02.827485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e1565c99-9d5b-46a9-98e6-9c8a8ad484b0 req-3793f657-c412-47ca-b177-be58b3a578ff service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:02.848386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e1565c99-9d5b-46a9-98e6-9c8a8ad484b0 req-3793f657-c412-47ca-b177-be58b3a578ff service nova] Creating event network-changed:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:32:02.856245 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e1565c99-9d5b-46a9-98e6-9c8a8ad484b0 req-3793f657-c412-47ca-b177-be58b3a578ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076949 Jul 30 21:32:02.857170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2780/5505] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:02.858915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:02.872665 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9a9d570-6b52-4aa9-a045-22045255dcde tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.348026 Jul 30 21:32:02.874043 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2726/5506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:02 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:03.193653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:03.194304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:03.201645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.202117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.202922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.203519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.282708 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6518f681-3b62-4d19-8288-4fd81846c73c tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1344 microversion: 2.1 time: 0.093718 Jul 30 21:32:03.296956 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2781/5507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:03 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:03.521688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:03.523631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:03.535853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.541337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.543786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.544513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.801376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:03.803373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:03.817544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.819434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.820476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.821098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.921119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:03.931861 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ee3a9ad4-00a6-4b6a-ade1-df3a592377d0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1478 microversion: 2.1 time: 0.134251 Jul 30 21:32:03.933177 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2782/5508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:03 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1478 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:03.938341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:03.938976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:03.953570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.954384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:03.955492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:03.956112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:04.555891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:04.571748 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-361c8709-d076-4aa2-a32c-85f5d7dc8e83 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.635287 Jul 30 21:32:04.588699 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2783/5509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:03 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:04.601621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:04.607218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:04.608510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:04.619721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:04.620188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:04.620987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:04.621568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:04.627542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-08ac65fe-c95b-461a-afe7-bd4da209bc54 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 1.109874 Jul 30 21:32:04.630599 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2727/5510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:03 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:04.775216 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c64751d-a5e8-46b6-b987-00997c2b01e2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1432 microversion: 2.1 time: 0.184692 Jul 30 21:32:04.775984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2784/5511] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:04 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1432 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:04.956490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:04.957493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:04.969994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:04.977059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:04.981259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:04.986144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:05.258819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:05.270099 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6b90fe6a-6550-4bbf-a8a6-9053f2091d52 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1478 microversion: 2.1 time: 0.317984 Jul 30 21:32:05.272055 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2728/5512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:04 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:05.596808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:05.597444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:05.619671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:05.620145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:05.624208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:05.626506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:05.652945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:05.653553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:05.677652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:05.678170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:05.679027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:05.679490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.127639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:06.144122 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b4059a7-c597-4c59-9c89-19f741a70892 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.495262 Jul 30 21:32:06.149302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2729/5513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:05 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:06.158108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:06.164744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:06.182242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.189341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.190278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.190739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.265817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:06.276125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44a11aa3-0303-4916-9178-2a57be887f97 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.684096 Jul 30 21:32:06.276730 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2785/5514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:05 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:06.303718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5b35c430-ecc8-4843-8734-d3281f6efba9 req-289ae4ba-aa62-44d4-b2c1-1bcc24d8718d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6c0ab-4ded-456e-93b3-9b0f1ca19af1", "name": "network-vif-deleted", "tag": "c2038b30-c6ed-43cc-919c-09b65dc75072"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:06.344085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5b35c430-ecc8-4843-8734-d3281f6efba9 req-289ae4ba-aa62-44d4-b2c1-1bcc24d8718d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.344829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5b35c430-ecc8-4843-8734-d3281f6efba9 req-289ae4ba-aa62-44d4-b2c1-1bcc24d8718d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.350749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:06.378413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5b35c430-ecc8-4843-8734-d3281f6efba9 req-289ae4ba-aa62-44d4-b2c1-1bcc24d8718d service nova] Creating event network-vif-deleted:c2038b30-c6ed-43cc-919c-09b65dc75072 for instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 on nch2-master-1 Jul 30 21:32:06.389802 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5b35c430-ecc8-4843-8734-d3281f6efba9 req-289ae4ba-aa62-44d4-b2c1-1bcc24d8718d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097441 Jul 30 21:32:06.393351 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2786/5515] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:06.406145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:06.412927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:06.426679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.429247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.430541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.432434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.550832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:06.551490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:06.552255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lazy-loading 'fault' on Instance uuid 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:32:06.644482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:06.656452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-49b13ebf-eda0-4e11-9adf-4a5ce8d848e0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 200 len: 1331 microversion: 2.1 time: 0.261500 Jul 30 21:32:06.657627 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2787/5516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:06 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 1331 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:06.693897 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-363da7ef-410d-44db-8d93-f984b9460fcd tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.541191 Jul 30 21:32:06.695787 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2730/5517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:06 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:07.087811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-85c00724-9720-4d6b-a65e-9a6d0afecf8a req-40fc858b-c0b8-4abb-abbe-fd7f406b5813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8e388e-0cab-49ca-94e5-b198cfd0a5a4", "tag": "be85033f-bda0-42e1-b157-a0e8d32de0a9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:07.102015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-85c00724-9720-4d6b-a65e-9a6d0afecf8a req-40fc858b-c0b8-4abb-abbe-fd7f406b5813 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.102749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-85c00724-9720-4d6b-a65e-9a6d0afecf8a req-40fc858b-c0b8-4abb-abbe-fd7f406b5813 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.119526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-85c00724-9720-4d6b-a65e-9a6d0afecf8a req-40fc858b-c0b8-4abb-abbe-fd7f406b5813 service nova] Creating event network-changed:be85033f-bda0-42e1-b157-a0e8d32de0a9 for instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 on nch2-master-1 Jul 30 21:32:07.126392 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-85c00724-9720-4d6b-a65e-9a6d0afecf8a req-40fc858b-c0b8-4abb-abbe-fd7f406b5813 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125437 Jul 30 21:32:07.127368 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2788/5518] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:07.172428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:07.173062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:07.182907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.183330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.184630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.185689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.297667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:07.298379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:07.308069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.308538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.309347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.309799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.371511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:07.413649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:07.429462 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1f5890d2-926e-4843-ad23-74789b7aba1e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.260779 Jul 30 21:32:07.430082 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2731/5519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:07 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:07.490293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:07.498662 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8964cbdd-bcaa-4ef9-a08b-19b662cd3e99 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.205096 Jul 30 21:32:07.503340 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2789/5520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:07 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:07.682117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:07.684123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:07.707501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.711176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.712993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.713797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.722385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:07.724612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:07.741775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.744175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.746725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:07.749300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:07.773592 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] HTTP exception thrown: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Request method failure captured: Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 HTTP/1.1 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aLr7mVXGUSLqNVq6Hk-PvHkkYmQaowZ0FmJxcLi994VQj92HHgWldh-1ako3DKx5YMuHMOL-TqxAdD-DJye8uwW_IMUAEmY1AlE28T4RCQnSlHBUsUtTdYIAPkqxXwMAjNgAVfV5tqqOiTcVDTHs6aUxvZSNSRbAKUczjq9UU2SV9s Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 434fef0893984988a8acc8b251efdddc Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/434fef0893984988a8acc8b251efdddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_434fef0893984988a8acc8b251efdddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/434fef0893984988a8acc8b251efdddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/434fef0893984988a8acc8b251efdddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 434fef0893984988a8acc8b251efdddc Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestSecurityGroupsBasicOps-89145644-project Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 67db2c00c71f469f9a7a871ed28e97e4 Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestSecurityGroupsBasicOps-89145644-project Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '45a6c0ab-4ded-456e-93b3-9b0f1ca19af1'} Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:07.782101 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. Jul 30 21:32:07.786507 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:07.789611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Returning 404 to user: Instance 45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:07.791772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-afa7a9e5-c9a6-4189-a6b6-ce63b5679145 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1" status: 404 len: 111 microversion: 2.1 time: 0.117030 Jul 30 21:32:07.793508 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2732/5521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:07 2022] GET /compute/v2.1/servers/45a6c0ab-4ded-456e-93b3-9b0f1ca19af1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:32:08.081082 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-09d7db2a-21d1-4831-b7a9-4388df565f89 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.365279 Jul 30 21:32:08.081668 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2790/5522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:07 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:08.457270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:08.458713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:08.471561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:08.474235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:08.476209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:08.478140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:08.519894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:08.520596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:08.532891 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:08.533511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:08.534968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:08.535618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:08.822946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:08.838046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-69136db4-0dbe-4259-80d8-f3bb523de860 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.383910 Jul 30 21:32:08.838902 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2733/5523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:08 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:08.842938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:08.858491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a50029e-1aad-4818-b001-9910de3e31ff tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1678 microversion: 2.1 time: 0.342781 Jul 30 21:32:08.871838 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2791/5524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:08 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:09.102323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:09.102866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:09.110068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.110540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:09.111345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.112552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:09.585542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-61107427-c773-471d-b46a-fa52431f4403 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.487359 Jul 30 21:32:09.586135 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2734/5525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:09 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:09.861320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:09.861938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:09.876527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.876986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:09.883741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:09.884312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:09.898733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.899635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:09.904791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.905544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:09.908442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:09.909132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.155860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:10.170130 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f69c244-64d8-4619-95be-f0da3787f569 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.312656 Jul 30 21:32:10.170727 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2792/5526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:09 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:10.358849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:10.370676 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-560c3275-b340-445c-9606-725b17406ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1655 microversion: 2.1 time: 0.491436 Jul 30 21:32:10.372288 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2735/5527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:09 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1655 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:10.410945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8890fa9b-42f1-4d6a-b978-d891e0c93411 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:10.421369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8890fa9b-42f1-4d6a-b978-d891e0c93411 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:10.422489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8890fa9b-42f1-4d6a-b978-d891e0c93411 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.464163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8890fa9b-42f1-4d6a-b978-d891e0c93411 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Going to try to start instance {{(pid=130984) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:32:10.546531 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8890fa9b-42f1-4d6a-b978-d891e0c93411 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action" status: 202 len: 0 microversion: 2.1 time: 0.139806 Jul 30 21:32:10.550392 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2793/5528] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:32:10 2022] POST /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:32:10.558166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:10.558842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:10.571215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:10.572141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.572665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:10.580085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.614567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:10.628804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:10.650903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:10.651885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.652986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:10.654024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:10.654157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:10.896760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:10.907819 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f685f98-9c14-4178-8b60-ce0719a60667 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1664 microversion: 2.1 time: 0.355421 Jul 30 21:32:10.908928 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2736/5529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:10 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1664 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:11.191984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:11.193278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:11.202749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:11.216783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:11.220032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:11.220690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:11.334142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e2de8d1-bd1d-48a2-b924-9119aa1c2066 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.730924 Jul 30 21:32:11.335909 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2794/5530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:10 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:11.733693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:11.743467 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4c6fb93c-caa0-47d6-bd21-8b2abbaf59e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.555544 Jul 30 21:32:11.746975 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2737/5531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:11 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:11.930687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:11.931610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:11.942153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:11.943823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:11.946898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:11.950043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:12.264974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:12.278628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e502a49-6bb4-4db1-8009-e8fcc1c3b468 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1664 microversion: 2.1 time: 0.352309 Jul 30 21:32:12.280286 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2795/5532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:11 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1664 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:12.357922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:12.358498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:12.365937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:12.367809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:12.370641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:12.371513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:12.373613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:12.374243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:12.681325 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b4d8f24-0a11-4e8d-96c6-30f7fec76f95 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.327114 Jul 30 21:32:12.685424 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2738/5533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:12 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:12.771316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:12.772708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:12.784614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:12.787280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:12.789122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:12.789759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:13.094671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:13.112489 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ddf55d09-1656-4514-b597-132ad404ef6f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.346138 Jul 30 21:32:13.113946 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2796/5534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:12 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:13.312451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:13.313360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:13.326532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:13.327511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:13.328949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:13.330738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:13.430057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-20cb4a7e-e37f-4f9a-9fb5-f8e5ebe323a9 req-140364e2-6e0e-4c53-8cfc-8d9ddf6d3fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "name": "network-vif-plugged", "status": "completed", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:13.469340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-20cb4a7e-e37f-4f9a-9fb5-f8e5ebe323a9 req-140364e2-6e0e-4c53-8cfc-8d9ddf6d3fe4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:13.471903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-20cb4a7e-e37f-4f9a-9fb5-f8e5ebe323a9 req-140364e2-6e0e-4c53-8cfc-8d9ddf6d3fe4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:13.513226 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-20cb4a7e-e37f-4f9a-9fb5-f8e5ebe323a9 req-140364e2-6e0e-4c53-8cfc-8d9ddf6d3fe4 service nova] Creating event network-vif-plugged:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:32:13.518361 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-20cb4a7e-e37f-4f9a-9fb5-f8e5ebe323a9 req-140364e2-6e0e-4c53-8cfc-8d9ddf6d3fe4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117110 Jul 30 21:32:13.519258 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2797/5535] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:13.535661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:13.564379 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8c522f3d-ec97-4dde-9fe2-3654b86f2b68 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1668 microversion: 2.1 time: 0.265494 Jul 30 21:32:13.565026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2739/5536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:13 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:13.707105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:13.708486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:13.715852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:13.716425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:13.717291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:13.717813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.135073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:14.135823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:14.142021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.142550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.143458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.143895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.205345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f6775e5f-a33e-497a-a4a4-a48e563c0b22 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.502310 Jul 30 21:32:14.219055 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2798/5537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:13 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:14.299691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:14.307950 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c148aa4-9c71-490d-b167-a09d8969a4c0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1390 microversion: 2.1 time: 0.176781 Jul 30 21:32:14.321916 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2740/5538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:14 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:14.687949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f2741bc3-eace-47f0-9f8f-666e715d2487 req-a469cd50-700f-4885-9406-847ddfb9bb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8161b8-c374-4519-96fd-1aacab5b7d2c", "tag": "764f845c-a47d-4735-ad56-6157e1652c88"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:14.692591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:14.696476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:14.718133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f2741bc3-eace-47f0-9f8f-666e715d2487 req-a469cd50-700f-4885-9406-847ddfb9bb9a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.718885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f2741bc3-eace-47f0-9f8f-666e715d2487 req-a469cd50-700f-4885-9406-847ddfb9bb9a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.721125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.722424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.724547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.726583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.738035 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f2741bc3-eace-47f0-9f8f-666e715d2487 req-a469cd50-700f-4885-9406-847ddfb9bb9a service nova] Creating event network-changed:764f845c-a47d-4735-ad56-6157e1652c88 for instance ae8161b8-c374-4519-96fd-1aacab5b7d2c on nch1-master-1 Jul 30 21:32:14.744546 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f2741bc3-eace-47f0-9f8f-666e715d2487 req-a469cd50-700f-4885-9406-847ddfb9bb9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060424 Jul 30 21:32:14.745707 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2741/5539] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:14.768263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:14.901664 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-400934de-fd69-4bba-825c-61f315047966 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 204 len: 0 microversion: 2.1 time: 0.218958 Jul 30 21:32:14.906703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2799/5540] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:14 2022] DELETE /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:32:14.913415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:14.914466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:14.923032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.923934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:14.927093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:14.927763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.152828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:15.162300 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14e4ef69-ce34-4ec6-9a5b-8b0c5ad5abb0 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1767 microversion: 2.1 time: 0.253937 Jul 30 21:32:15.163504 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2742/5541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:14 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1767 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:15.226647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:15.227905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:15.230888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:15.236745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.237319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.238360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.239482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.329832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:15.330740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:15.339534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.340631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.341595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.342265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.424940 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-21e46fb1-987d-4f1a-947b-d1533eaca3af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.202041 Jul 30 21:32:15.427035 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2800/5542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:15 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:15.493264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:15.502893 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b4fb65f0-d824-4986-98c5-0ebddff31d42 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1562 microversion: 2.1 time: 0.177326 Jul 30 21:32:15.516873 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2743/5543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:15 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:15.527050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:15.527050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:15.533261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.533940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.534744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.535193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.549993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1b570aba-c339-42dd-bce1-44583ed58729 req-465ad86a-9f67-440c-b0d2-03dde2abefb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8e388e-0cab-49ca-94e5-b198cfd0a5a4", "name": "network-vif-plugged", "status": "completed", "tag": "be85033f-bda0-42e1-b157-a0e8d32de0a9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:15.560934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1b570aba-c339-42dd-bce1-44583ed58729 req-465ad86a-9f67-440c-b0d2-03dde2abefb4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:15.561404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1b570aba-c339-42dd-bce1-44583ed58729 req-465ad86a-9f67-440c-b0d2-03dde2abefb4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:15.573645 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1b570aba-c339-42dd-bce1-44583ed58729 req-465ad86a-9f67-440c-b0d2-03dde2abefb4 service nova] Creating event network-vif-plugged:be85033f-bda0-42e1-b157-a0e8d32de0a9 for instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 on nch2-master-1 Jul 30 21:32:15.578906 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1b570aba-c339-42dd-bce1-44583ed58729 req-465ad86a-9f67-440c-b0d2-03dde2abefb4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Jul 30 21:32:15.580356 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2744/5544] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:32:15.744824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:15.747104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:15.755706 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3ca7130-d82b-4db5-bf2c-2d40848157a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1562 microversion: 2.1 time: 0.233522 Jul 30 21:32:15.758298 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2801/5545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:15 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:16.187581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:16.188454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:16.200285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:16.200910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:16.201932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:16.202498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:16.446932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:16.448175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:16.461911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:16.462770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:16.464153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:16.465221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:16.572102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:16.580750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a000756-31cc-4c6d-af96-33845b8e6c61 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1767 microversion: 2.1 time: 0.398533 Jul 30 21:32:16.581414 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2745/5546] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:16 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1767 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:16.811204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5b805e3-7d3f-4ded-9b1a-0c9b1e0b600a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1462 microversion: 2.1 time: 0.368894 Jul 30 21:32:16.812935 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2802/5547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:16 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1462 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:17.287230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-86a7217d-6153-4b6b-a274-bf018e486585 req-a33293d3-2084-4f01-8426-668f0ee82879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8161b8-c374-4519-96fd-1aacab5b7d2c", "name": "network-vif-deleted", "tag": "764f845c-a47d-4735-ad56-6157e1652c88"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:17.305101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-86a7217d-6153-4b6b-a274-bf018e486585 req-a33293d3-2084-4f01-8426-668f0ee82879 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.306232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-86a7217d-6153-4b6b-a274-bf018e486585 req-a33293d3-2084-4f01-8426-668f0ee82879 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:17.321034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-86a7217d-6153-4b6b-a274-bf018e486585 req-a33293d3-2084-4f01-8426-668f0ee82879 service nova] Creating event network-vif-deleted:764f845c-a47d-4735-ad56-6157e1652c88 for instance ae8161b8-c374-4519-96fd-1aacab5b7d2c on nch1-master-1 Jul 30 21:32:17.328199 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-86a7217d-6153-4b6b-a274-bf018e486585 req-a33293d3-2084-4f01-8426-668f0ee82879 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045347 Jul 30 21:32:17.329612 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2746/5548] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:17.603412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:17.604308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:17.618624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.619400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:17.620443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.621084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:17.669668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.670242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:17.670953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lazy-loading 'fault' on Instance uuid ae8161b8-c374-4519-96fd-1aacab5b7d2c {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:32:17.734693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67db2c00c71f469f9a7a871ed28e97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434fef0893984988a8acc8b251efdddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:17.745096 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2302d8ed-ebb9-4592-9e27-bff8b46f0626 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 200 len: 1382 microversion: 2.1 time: 0.145088 Jul 30 21:32:17.770199 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2803/5549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:17 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 1382 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:17.842369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:17.844108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:17.858235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.859245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:17.862994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:17.864789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.037733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-647fd2f0-aa53-4700-a18c-d6f989120f99 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1647 microversion: 2.1 time: 0.207158 Jul 30 21:32:18.044284 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2747/5550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:17 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1647 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:18.057823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.058386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.065774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.066430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.067546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.079980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.096892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.097566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.105921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.106752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.107826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.108507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.275480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:18.284087 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eaf99811-3cff-4cc1-adb0-f6905691247e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1562 microversion: 2.1 time: 0.192001 Jul 30 21:32:18.289492 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2748/5551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:18 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1562 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:18.314333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a1ab76f-7f28-41fb-957f-cf0cf9941bd0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1647 microversion: 2.1 time: 0.258343 Jul 30 21:32:18.314977 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2804/5552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:18 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1647 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:18.336825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.337714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.346514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.351503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.352431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.353299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.498099 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a844f46-a08e-47d4-a3bf-bebde75b50af tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1647 microversion: 2.1 time: 0.166941 Jul 30 21:32:18.498759 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2749/5553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:18 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1647 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:18.518810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.519358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.526525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.526999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.527854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.528309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.553721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:18.655861 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b34151fb-b8a3-4dd2-b191-2e27185af8d2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 204 len: 0 microversion: 2.1 time: 0.140331 Jul 30 21:32:18.658794 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2805/5554] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:18 2022] DELETE /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:32:18.667137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.668116 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.674956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.675471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.676800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.677259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.768461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:18.770003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] [instance: ae8161b8-c374-4519-96fd-1aacab5b7d2c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:18.790798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.797707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.798442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:18.798910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:18.828971 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] HTTP exception thrown: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Request method failure captured: Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c HTTP/1.1 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLr7mVXGUSLqNVq6Hk-PvHkkYmQaowZ0FmJxcLi994VQj92HHgWldh-1ako3DKx5YMuHMOL-TqxAdD-DJye8uwW_IMUAEmY1AlE28T4RCQnSlHBUsUtTdYIAPkqxXwMAjNgAVfV5tqqOiTcVDTHs6aUxvZSNSRbAKUczjq9UU2SV9s Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 434fef0893984988a8acc8b251efdddc Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/434fef0893984988a8acc8b251efdddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_434fef0893984988a8acc8b251efdddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/434fef0893984988a8acc8b251efdddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/434fef0893984988a8acc8b251efdddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 434fef0893984988a8acc8b251efdddc Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-89145644 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestSecurityGroupsBasicOps-89145644-project Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 67db2c00c71f469f9a7a871ed28e97e4 Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestSecurityGroupsBasicOps-89145644-project Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'ae8161b8-c374-4519-96fd-1aacab5b7d2c'} Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:18.830703 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. Jul 30 21:32:18.836547 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:18.842202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50c9e296-1c0f-4d28-b4e3-4a2e56b83024 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1653 microversion: 2.1 time: 0.179007 Jul 30 21:32:18.856984 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2750/5555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:18 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1653 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:18.857144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Returning 404 to user: Instance ae8161b8-c374-4519-96fd-1aacab5b7d2c could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:18.857144 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5a02679b-ec0d-41e0-88ef-9dc5b49cfa23 tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c" status: 404 len: 111 microversion: 2.1 time: 0.081537 Jul 30 21:32:18.857144 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2806/5556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:18 2022] GET /compute/v2.1/servers/ae8161b8-c374-4519-96fd-1aacab5b7d2c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:32:19.344621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-78dc926c-64ac-412d-b67a-0acafa6ae4c8 req-3456c9ab-5b4a-4496-ae49-502d68164148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:19.355957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-78dc926c-64ac-412d-b67a-0acafa6ae4c8 req-3456c9ab-5b4a-4496-ae49-502d68164148 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:19.357028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-78dc926c-64ac-412d-b67a-0acafa6ae4c8 req-3456c9ab-5b4a-4496-ae49-502d68164148 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:19.372387 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-78dc926c-64ac-412d-b67a-0acafa6ae4c8 req-3456c9ab-5b4a-4496-ae49-502d68164148 service nova] Creating event network-changed:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:32:19.377767 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-78dc926c-64ac-412d-b67a-0acafa6ae4c8 req-3456c9ab-5b4a-4496-ae49-502d68164148 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036824 Jul 30 21:32:19.378496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2751/5557] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:19.866952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:19.867622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:19.874578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:19.875053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:19.876141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:19.876595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:19.983491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-806854283", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:20.054384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:32:20.113992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-55116ec0-8ca9-4412-b1d4-562365d40821 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1653 microversion: 2.1 time: 0.251595 Jul 30 21:32:20.114590 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2807/5558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:19 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1653 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:20.913002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:32:20.913515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:32:20.914029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:32:20.914454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:32:20.915087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:32:20.924358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:20.924848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:20.925789 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:20.926323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:20.943565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Getting quotas for project d4b1716d1241449ea378b184fcd95729. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:20.948905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Getting quotas for user a2645fa8ca13490bb0c23aad8c73de3f and project d4b1716d1241449ea378b184fcd95729. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:20.961995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:32:20.964427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:32:21.016790 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75e5ab7b-c18f-4856-9938-afa79c190dbd tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037543 Jul 30 21:32:21.017459 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2752/5559] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:32:21.029137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9601c1ad-21f1-4824-8a65-a089704f6a11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:21.029826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9601c1ad-21f1-4824-8a65-a089704f6a11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:21.093864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9601c1ad-21f1-4824-8a65-a089704f6a11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:21.102397 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9601c1ad-21f1-4824-8a65-a089704f6a11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1213 microversion: 2.1 time: 0.077205 Jul 30 21:32:21.102971 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2808/5560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:21 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:21.136138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:21.136779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:21.145662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:21.146371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:21.147389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:21.148151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:21.498020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ac74b113-27ee-4aaf-a837-c03d21b22617 req-a281ed18-2fab-4cce-bc90-08b5aab3fbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8e388e-0cab-49ca-94e5-b198cfd0a5a4", "name": "network-vif-deleted", "tag": "be85033f-bda0-42e1-b157-a0e8d32de0a9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:21.528841 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99a51825-cd52-4413-8151-24c5298b5b51 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 200 len: 1653 microversion: 2.1 time: 0.397148 Jul 30 21:32:21.533567 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2753/5561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:21 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 1653 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:21.551825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ac74b113-27ee-4aaf-a837-c03d21b22617 req-a281ed18-2fab-4cce-bc90-08b5aab3fbee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:21.552713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ac74b113-27ee-4aaf-a837-c03d21b22617 req-a281ed18-2fab-4cce-bc90-08b5aab3fbee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:21.569844 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ac74b113-27ee-4aaf-a837-c03d21b22617 req-a281ed18-2fab-4cce-bc90-08b5aab3fbee service nova] Creating event network-vif-deleted:be85033f-bda0-42e1-b157-a0e8d32de0a9 for instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 on nch2-master-1 Jul 30 21:32:21.576592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ac74b113-27ee-4aaf-a837-c03d21b22617 req-a281ed18-2fab-4cce-bc90-08b5aab3fbee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082580 Jul 30 21:32:21.577731 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2809/5562] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:32:22.123257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:22.123923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:22.132436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.132912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.133899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.134683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.221550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:22.234797 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88eb167b-76d7-47a2-ae12-d3a6f3e7718e tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1265 microversion: 2.1 time: 0.115522 Jul 30 21:32:22.248989 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2754/5563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:22 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:22.559549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:22.560864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:22.567832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.568541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.569496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.570115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.584730 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] HTTP exception thrown: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Request method failure captured: Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 HTTP/1.1 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aM7LqY3yixaB3dJl9-Z6K8nVHGdbQavWxBOUwJSymtSFt4pjYFbKJPLI59eEBkPYZvRyY_EDh6G-oEXdECeX5HhpK5YtdMjkXtkHo6hVFXM92DJvAhgiHY3Ce_vNXXehr5kDtWuMbGh3rlFMlct_kDbytAgoO4RYDH9sHA-i_4OM8o Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: ff13fa2ab2ea4813adf39c4c4c3ece12 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestServerMultinode-885023127 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff13fa2ab2ea4813adf39c4c4c3ece12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestServerMultinode-885023127 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: ff13fa2ab2ea4813adf39c4c4c3ece12 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestServerMultinode-885023127 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestServerMultinode-885023127-project-admin Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9512e7df6b054f1f98e4293ad1247741 Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestServerMultinode-885023127-project-admin Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '0c8e388e-0cab-49ca-94e5-b198cfd0a5a4'} Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:22.586643 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. Jul 30 21:32:22.591118 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:22.592830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Returning 404 to user: Instance 0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:22.593903 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d43513a8-6010-4427-acfb-ecccdc0904e0 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4" status: 404 len: 111 microversion: 2.1 time: 0.039664 Jul 30 21:32:22.595017 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2810/5564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:22 2022] GET /compute/v2.1/servers/0c8e388e-0cab-49ca-94e5-b198cfd0a5a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:32:22.604219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:22.605509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:22.614295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.614930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.615921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.617335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.649308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:22.666239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:22.753871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bec7de0-10ef-4fa1-a34c-0d46284b284a tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 204 len: 0 microversion: 2.1 time: 0.153711 Jul 30 21:32:22.755337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2755/5565] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:22 2022] DELETE /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:32:22.766125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:22.766961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:22.774316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.774860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:22.775697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:22.776153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:23.128425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c1c30ad-0a32-4d6a-bd17-178dae1afb34 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1655 microversion: 2.1 time: 0.367743 Jul 30 21:32:23.130182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2811/5566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:22 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1655 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:23.257817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:23.258543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:23.265257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:23.265957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:23.266923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:23.267659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:23.411377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:23.420173 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e3d04b43-f001-46e4-8b94-d36977687c72 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1271 microversion: 2.1 time: 0.167061 Jul 30 21:32:23.433186 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2756/5567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:23 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:23.867463 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b22207d-99de-4807-a711-09de31586f9c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] Calling method '.version_select at 0x7fbb4fac5430>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:23.896397 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b22207d-99de-4807-a711-09de31586f9c tempest-TestSecurityGroupsBasicOps-89145644 tempest-TestSecurityGroupsBasicOps-89145644-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-431975755" status: 202 len: 0 microversion: 2.1 time: 0.032942 Jul 30 21:32:23.896979 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2812/5568] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-431975755 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:32:24.151329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:24.152169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:24.162718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.163197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.164029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.164483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.409236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d2a8fdca-c20e-4296-9621-aecdafd1ecb5 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1655 microversion: 2.1 time: 0.262372 Jul 30 21:32:24.412961 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2757/5569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:24 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1655 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:24.431519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a8601760-e685-4ca6-ba09-bb0da2520540 req-38d53a98-abe2-41ff-b9de-b68d0875bffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3edfe2f-dff0-4424-aca7-57a13b654a2e", "tag": "efa9fc4f-9852-461a-b057-1d6c54b8a477"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:24.442098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:24.442912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:24.453932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.454396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.455062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a8601760-e685-4ca6-ba09-bb0da2520540 req-38d53a98-abe2-41ff-b9de-b68d0875bffd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.455372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.456140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.457050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a8601760-e685-4ca6-ba09-bb0da2520540 req-38d53a98-abe2-41ff-b9de-b68d0875bffd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.472700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a8601760-e685-4ca6-ba09-bb0da2520540 req-38d53a98-abe2-41ff-b9de-b68d0875bffd service nova] Creating event network-changed:efa9fc4f-9852-461a-b057-1d6c54b8a477 for instance a3edfe2f-dff0-4424-aca7-57a13b654a2e on nch1-master-1 Jul 30 21:32:24.478854 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a8601760-e685-4ca6-ba09-bb0da2520540 req-38d53a98-abe2-41ff-b9de-b68d0875bffd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051036 Jul 30 21:32:24.480238 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2813/5570] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:24.772223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c52d919b-6cea-4453-bec7-95ad370b3861 req-02412132-47f5-48ac-8272-71d913b404dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0f4749-2cee-4452-950a-1e4b56056f6e", "name": "network-vif-deleted", "tag": "39446b33-c2a8-49f7-92f1-41b5c78d474d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:24.778246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:24.790422 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-deec7030-29d6-4189-8597-46857e483d2c tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.352729 Jul 30 21:32:24.793152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c52d919b-6cea-4453-bec7-95ad370b3861 req-02412132-47f5-48ac-8272-71d913b404dc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:24.793804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c52d919b-6cea-4453-bec7-95ad370b3861 req-02412132-47f5-48ac-8272-71d913b404dc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:24.794081 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2758/5571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:24 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:24.810745 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c52d919b-6cea-4453-bec7-95ad370b3861 req-02412132-47f5-48ac-8272-71d913b404dc service nova] Creating event network-vif-deleted:39446b33-c2a8-49f7-92f1-41b5c78d474d for instance fa0f4749-2cee-4452-950a-1e4b56056f6e on nch1-master-1 Jul 30 21:32:24.816125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c52d919b-6cea-4453-bec7-95ad370b3861 req-02412132-47f5-48ac-8272-71d913b404dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052877 Jul 30 21:32:24.817140 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2814/5572] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:32:25.433360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:25.434173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:25.441269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:25.442360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:25.443144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:25.443631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:25.476669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:25.477146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:25.477646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lazy-loading 'fault' on Instance uuid fa0f4749-2cee-4452-950a-1e4b56056f6e {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:32:25.531517 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d90bfbd-56a3-47e5-8021-c21e4857c9c2 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 200 len: 1453 microversion: 2.1 time: 0.101693 Jul 30 21:32:25.532119 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2759/5573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:25 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:25.815531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:25.816518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:25.823326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:25.823829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:25.824621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:25.825245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:26.135012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:26.143684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-82cad1c9-a5dc-4e53-8fba-46d23fd0cbbc tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.333009 Jul 30 21:32:26.144388 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2815/5574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:25 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:26.555631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:26.556342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] [instance: fa0f4749-2cee-4452-950a-1e4b56056f6e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:26.568130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:26.569017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:26.571229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:26.571791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:26.596258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] HTTP exception thrown: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Request method failure captured: Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e HTTP/1.1 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aM7LqY3yixaB3dJl9-Z6K8nVHGdbQavWxBOUwJSymtSFt4pjYFbKJPLI59eEBkPYZvRyY_EDh6G-oEXdECeX5HhpK5YtdMjkXtkHo6hVFXM92DJvAhgiHY3Ce_vNXXehr5kDtWuMbGh3rlFMlct_kDbytAgoO4RYDH9sHA-i_4OM8o Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: ff13fa2ab2ea4813adf39c4c4c3ece12 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestServerMultinode-885023127 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff13fa2ab2ea4813adf39c4c4c3ece12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff13fa2ab2ea4813adf39c4c4c3ece12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestServerMultinode-885023127 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: ff13fa2ab2ea4813adf39c4c4c3ece12 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestServerMultinode-885023127 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestServerMultinode-885023127-project-admin Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 9512e7df6b054f1f98e4293ad1247741 Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestServerMultinode-885023127-project-admin Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'fa0f4749-2cee-4452-950a-1e4b56056f6e'} Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:26.598578 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] Returning 404 to user: Instance fa0f4749-2cee-4452-950a-1e4b56056f6e could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c0d87ce-34d0-4c05-bc12-338487567852 tempest-TestServerMultinode-885023127 tempest-TestServerMultinode-885023127-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e" status: 404 len: 111 microversion: 2.1 time: 0.050641 Jul 30 21:32:26.606820 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2760/5575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:26 2022] GET /compute/v2.1/servers/fa0f4749-2cee-4452-950a-1e4b56056f6e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:32:27.165641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:27.166910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:27.175348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:27.176574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:27.177598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:27.178185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:27.349924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:27.358654 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec053828-f6d0-4895-b9c9-1a8d3f141d32 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.197315 Jul 30 21:32:27.359893 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2816/5576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:27 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:28.385364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:28.386154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:28.400244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:28.400795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:28.402671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:28.403710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:28.624700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:28.638172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-338b2384-eec1-497c-bed5-93353f957fc9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.259992 Jul 30 21:32:28.638837 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2761/5577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:28 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:29.660854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:29.662238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:29.677665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:29.678452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:29.679490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:29.680143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:30.444679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:30.454742 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-97310af0-74c7-42d5-8397-33c315730230 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.797835 Jul 30 21:32:30.455850 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2817/5578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:29 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:30.635317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-15c97636-879f-40fe-abd0-ae6936cc5152 req-76ec2602-12ef-4bb8-876c-cb41043f5b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3edfe2f-dff0-4424-aca7-57a13b654a2e", "name": "network-vif-plugged", "status": "completed", "tag": "efa9fc4f-9852-461a-b057-1d6c54b8a477"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:30.657417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-15c97636-879f-40fe-abd0-ae6936cc5152 req-76ec2602-12ef-4bb8-876c-cb41043f5b45 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:30.658032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-15c97636-879f-40fe-abd0-ae6936cc5152 req-76ec2602-12ef-4bb8-876c-cb41043f5b45 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:30.671546 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-15c97636-879f-40fe-abd0-ae6936cc5152 req-76ec2602-12ef-4bb8-876c-cb41043f5b45 service nova] Creating event network-vif-plugged:efa9fc4f-9852-461a-b057-1d6c54b8a477 for instance a3edfe2f-dff0-4424-aca7-57a13b654a2e on nch1-master-1 Jul 30 21:32:30.679259 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-15c97636-879f-40fe-abd0-ae6936cc5152 req-76ec2602-12ef-4bb8-876c-cb41043f5b45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047703 Jul 30 21:32:30.682584 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2762/5579] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:31.484573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:31.485379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:31.488547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:31.497353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:31.501912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:31.507232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:31.507921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:31.841922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:31.857983 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-296e2605-c8bf-41a0-8e26-e8e71060c1b9 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1313 microversion: 2.1 time: 0.376049 Jul 30 21:32:31.858632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2818/5580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:31 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:32.885115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:32.886418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:32.890379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:32.891475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:32.893251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:32.898459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:32.898929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:32.899807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:32.900265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:33.108881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:33.120810 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53298759-7ef0-4826-8510-f3e94fe973a5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1463 microversion: 2.1 time: 0.239763 Jul 30 21:32:33.122411 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2763/5581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:32 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:33.149681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d83d9a53-4523-48b8-96ac-369aca869db0", "device": "/dev/sdb"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:33.152870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:33.163381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:33.164139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:33.165166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:33.166000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:33.564109 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3245a101-9867-43b9-a8be-bec28fa0fb9a tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "POST /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425413 Jul 30 21:32:33.580873 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2819/5582] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:32:33 2022] POST /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:40.803466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77848ffd-771c-4a16-a2d2-db117602b099 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Action: 'create', calling method: .version_select at 0x7fbb5c040670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-270708493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+Ts6Yv1JqI7leCDd0uFH3SaOhGYT5mjbf1uk6QBs6V2ZvvlmlWu/s1h5igycTw2kvufBMp2iYlAogOGd0gDTLsqseyjjXBErSwxz7SUNWmiw12OrQBdYb9vGICRu2c+A=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:40.820398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-77848ffd-771c-4a16-a2d2-db117602b099 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for project 5105e54fdfa345c4891676afaf2dcd5e. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:40.827424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-77848ffd-771c-4a16-a2d2-db117602b099 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for user 8b1ec28438dc45a48433b159e5f04d6b and project 5105e54fdfa345c4891676afaf2dcd5e. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:40.854672 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77848ffd-771c-4a16-a2d2-db117602b099 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.231892 Jul 30 21:32:40.855314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2764/5583] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:32:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:42.019409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1420422859", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-270708493", "security_groups": [{"name": "tempest-secgroup-smoke-1786677092"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b0de35e5-eb7a-459a-a64e-4e54177e38a7"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:42.145604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] validate_networks() for [('b0de35e5-eb7a-459a-a64e-4e54177e38a7', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:32:42.643330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:42.646501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:42.653779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:42.654178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:42.655010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:42.655760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:42.724542 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc7089c8-e88c-4017-ad96-cd64d654ee27 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action" status: 200 len: 24550 microversion: 2.1 time: 0.085809 Jul 30 21:32:42.726482 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2765/5584] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:32:42 2022] POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action => generated 24550 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:32:42.897682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for project 5105e54fdfa345c4891676afaf2dcd5e. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:42.902971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for user 8b1ec28438dc45a48433b159e5f04d6b and project 5105e54fdfa345c4891676afaf2dcd5e. Resources: dict_keys(['metadata_items']) {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:42.917474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:32:42.917973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:32:42.918473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:32:42.918929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:32:42.919486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:32:42.929045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:42.929526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:42.930535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:42.931064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:42.950630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for project 5105e54fdfa345c4891676afaf2dcd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:42.957217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Getting quotas for user 8b1ec28438dc45a48433b159e5f04d6b and project 5105e54fdfa345c4891676afaf2dcd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:42.971906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:32:42.975198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:32:43.030292 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6cf818a3-fa46-4584-8cc4-43caeaabfd89 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.016313 Jul 30 21:32:43.031306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2820/5585] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:32:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:32:43.042691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2d29284-dfa4-48a8-bdbb-7e03ebc52012 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:43.043450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2d29284-dfa4-48a8-bdbb-7e03ebc52012 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:43.103608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2d29284-dfa4-48a8-bdbb-7e03ebc52012 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:43.110739 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2d29284-dfa4-48a8-bdbb-7e03ebc52012 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1302 microversion: 2.1 time: 0.072377 Jul 30 21:32:43.111410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2766/5586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:43 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1302 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:43.855334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:43.855857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:43.863941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:43.864409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:43.865199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:43.865657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:43.869983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:43.956207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lazy-loading 'services' on Instance uuid a3edfe2f-dff0-4424-aca7-57a13b654a2e {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:32:44.036165 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fca581b9-9e2e-472e-96f2-ed7238527dec tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e/os-volume_attachments/d83d9a53-4523-48b8-96ac-369aca869db0" status: 202 len: 0 microversion: 2.1 time: 0.185156 Jul 30 21:32:44.036858 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2821/5587] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:32:43 2022] DELETE /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e/os-volume_attachments/d83d9a53-4523-48b8-96ac-369aca869db0 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:32:44.134295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:44.134931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:44.142945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:44.143453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:44.144984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:44.145450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:44.237120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:44.246057 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f434e624-dfe6-40f8-8c43-806a1fc47ba8 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1362 microversion: 2.1 time: 0.115703 Jul 30 21:32:44.246646 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2767/5588] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:44 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1362 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:45.206185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:45.207925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:45.223879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.224626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.225716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.226392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.262284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:45.268792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:45.269456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:45.279706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.280527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.283962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.285350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.358917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:45.388310 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-662666e3-75f8-4dfc-8b66-dd32a7fdd151 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 204 len: 0 microversion: 2.1 time: 0.187130 Jul 30 21:32:45.388936 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2822/5589] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:45 2022] DELETE /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:32:45.397852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:45.398814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:45.412432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.413027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.414286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:45.414970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:45.507545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:45.530484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-68877084-3333-4657-9079-1eb71dc93e24 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.265565 Jul 30 21:32:45.531865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2768/5590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:45 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:45.649975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:45.660677 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-de4e6eeb-dda6-42ab-b91f-ade99388ad11 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1469 microversion: 2.1 time: 0.265757 Jul 30 21:32:45.663308 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2823/5591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:45 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:46.065186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-28d7eb55-cbff-411b-842b-32be31f646e2 req-beab08bf-0c0c-4a9a-8011-eb6bfdd2ce94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88175784-be66-4f78-ade7-1d4b95fa50f5", "tag": "43e10e99-a93c-409d-9147-2a0032513557"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:46.095018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-28d7eb55-cbff-411b-842b-32be31f646e2 req-beab08bf-0c0c-4a9a-8011-eb6bfdd2ce94 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:46.096406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-28d7eb55-cbff-411b-842b-32be31f646e2 req-beab08bf-0c0c-4a9a-8011-eb6bfdd2ce94 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:46.120425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-28d7eb55-cbff-411b-842b-32be31f646e2 req-beab08bf-0c0c-4a9a-8011-eb6bfdd2ce94 service nova] Creating event network-changed:43e10e99-a93c-409d-9147-2a0032513557 for instance 88175784-be66-4f78-ade7-1d4b95fa50f5 on nch2-master-1 Jul 30 21:32:46.130068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-28d7eb55-cbff-411b-842b-32be31f646e2 req-beab08bf-0c0c-4a9a-8011-eb6bfdd2ce94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068476 Jul 30 21:32:46.131506 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2769/5592] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:46.553601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:46.554235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:46.561621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:46.562350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:46.563427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:46.563893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:46.684491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:46.685900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:46.696004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:46.696474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:46.697676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:46.698142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:46.720873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:46.729186 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3b6e74d-2132-49ac-84ef-51e81b78871f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.179958 Jul 30 21:32:46.729778 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2824/5593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:46 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:46.841140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2645fa8ca13490bb0c23aad8c73de3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b1716d1241449ea378b184fcd95729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:46.849472 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f6567ed-d550-4b28-9373-f22d437bed4d tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 200 len: 1469 microversion: 2.1 time: 0.169544 Jul 30 21:32:46.850059 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2770/5594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:46 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:47.307790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-030333d2-d8da-480e-ac7e-e5d727a6cb80 req-16c6f87c-19b8-4416-b5b7-964e8dffa763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3edfe2f-dff0-4424-aca7-57a13b654a2e", "name": "network-vif-deleted", "tag": "efa9fc4f-9852-461a-b057-1d6c54b8a477"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:47.319859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-030333d2-d8da-480e-ac7e-e5d727a6cb80 req-16c6f87c-19b8-4416-b5b7-964e8dffa763 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:47.320441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-030333d2-d8da-480e-ac7e-e5d727a6cb80 req-16c6f87c-19b8-4416-b5b7-964e8dffa763 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:47.335650 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-030333d2-d8da-480e-ac7e-e5d727a6cb80 req-16c6f87c-19b8-4416-b5b7-964e8dffa763 service nova] Creating event network-vif-deleted:efa9fc4f-9852-461a-b057-1d6c54b8a477 for instance a3edfe2f-dff0-4424-aca7-57a13b654a2e on nch1-master-1 Jul 30 21:32:47.341935 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-030333d2-d8da-480e-ac7e-e5d727a6cb80 req-16c6f87c-19b8-4416-b5b7-964e8dffa763 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038406 Jul 30 21:32:47.342765 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2825/5595] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:47.750994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:47.752863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:47.761767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:47.762241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:47.763280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:47.763809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:47.870824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:47.872136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] [instance: a3edfe2f-dff0-4424-aca7-57a13b654a2e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:47.881452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:47.881934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:47.882727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:47.883179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:47.901608 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] HTTP exception thrown: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Request method failure captured: Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e HTTP/1.1 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aNiQOQRQBd51SWxgL_KlUmEHJKSBdGo26oSrEOSM0JZPie6RhlY6SORCGQ9Y793CcZQwLFKoZCoVHYrXxoBFU9T0P2L3tzjCHf0sl4wMUIBFChW-64x15moKUaFI-n_ethV9ESBW5k8KjXRlvxYmHNjeLRQweF5ySZUIuYww99K63o Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d4b1716d1241449ea378b184fcd95729 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-VolumesBackupsTest-2039384880 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4b1716d1241449ea378b184fcd95729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4b1716d1241449ea378b184fcd95729", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4b1716d1241449ea378b184fcd95729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4b1716d1241449ea378b184fcd95729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-VolumesBackupsTest-2039384880 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d4b1716d1241449ea378b184fcd95729 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-VolumesBackupsTest-2039384880 Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-VolumesBackupsTest-2039384880-project Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: a2645fa8ca13490bb0c23aad8c73de3f Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-VolumesBackupsTest-2039384880-project Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'a3edfe2f-dff0-4424-aca7-57a13b654a2e'} Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:47.903431 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] Returning 404 to user: Instance a3edfe2f-dff0-4424-aca7-57a13b654a2e could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4249985-4273-4189-b34d-d2f19ff846e5 tempest-VolumesBackupsTest-2039384880 tempest-VolumesBackupsTest-2039384880-project] 10.222.0.17 "GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e" status: 404 len: 111 microversion: 2.1 time: 0.038462 Jul 30 21:32:47.909154 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2826/5596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:47 2022] GET /compute/v2.1/servers/a3edfe2f-dff0-4424-aca7-57a13b654a2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:32:47.979694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:47.999054 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7468c0df-baa7-4b3d-adb8-bdb98ebdf238 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.251227 Jul 30 21:32:47.999468 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2771/5597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:47 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:48.979505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:48.982264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:48.989959 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:48.990535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:48.991440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:48.991983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.026474 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e945f19-9736-4d31-8e1b-e1f15d76e246 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051163 Jul 30 21:32:49.027065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:49.028329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:49.032608 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2827/5598] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:32:48 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 21:32:49.037834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.038312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.039143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.039626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.109224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:49.111823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:49.121537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.122147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.123051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.130066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.170229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:49.201557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:49.221370 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9264cb93-cc03-4e55-8d80-8e54b4d3cd80 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.198888 Jul 30 21:32:49.239457 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2772/5599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:49 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:49.259785 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a62a2d28-9c76-42d4-b115-0262d196f0b9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 204 len: 0 microversion: 2.1 time: 0.154323 Jul 30 21:32:49.260707 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2828/5600] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:49 2022] DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:32:49.268988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:49.269829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:49.276454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.276935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.277729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:49.278189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:49.422080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:49.432845 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-16bd5f20-b72b-4777-9b89-9248282c6ebc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1674 microversion: 2.1 time: 0.167737 Jul 30 21:32:49.433444 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2773/5601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:49 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:50.247174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:50.247932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:50.255910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:50.256315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:50.257090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:50.257527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:50.392036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:50.400242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bbc4cfa2-4985-4750-889e-c2dcafe5467e tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.157277 Jul 30 21:32:50.400894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2829/5602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:50 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:50.453914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:50.454580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:50.461734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:50.462318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:50.463158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:50.463650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:50.598844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:50.610799 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-85b90f95-f8f2-4273-9988-efc57cb5bd72 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1674 microversion: 2.1 time: 0.160702 Jul 30 21:32:50.611857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2774/5603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:50 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:51.421393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:51.422485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:51.436118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:51.436590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:51.437418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:51.438133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:51.586431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:51.594959 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d71e4874-2f1b-4ac9-9fef-15b8b1c465d7 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.177433 Jul 30 21:32:51.595602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2830/5604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:51 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:51.635208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:51.637485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:51.647441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:51.647927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:51.648742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:51.650522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:51.690167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:51.889554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:51.898138 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce8b78d8-a626-4a35-81c1-1f5bee635fab tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 200 len: 1674 microversion: 2.1 time: 0.267311 Jul 30 21:32:51.899510 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2775/5605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:51 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:52.262337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bc529010-790b-4478-9bdf-50bfe1413b9d req-d0eb7ff1-efe8-47a4-ad64-8ad9782aba0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c28cc18-83ac-4376-bab3-01c3219dbf21", "name": "network-vif-deleted", "tag": "42f107b4-42d7-4512-b542-7ee43883ca3a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:52.274566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc529010-790b-4478-9bdf-50bfe1413b9d req-d0eb7ff1-efe8-47a4-ad64-8ad9782aba0d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:52.275202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc529010-790b-4478-9bdf-50bfe1413b9d req-d0eb7ff1-efe8-47a4-ad64-8ad9782aba0d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:52.293172 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bc529010-790b-4478-9bdf-50bfe1413b9d req-d0eb7ff1-efe8-47a4-ad64-8ad9782aba0d service nova] Creating event network-vif-deleted:42f107b4-42d7-4512-b542-7ee43883ca3a for instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 on nch2-master-1 Jul 30 21:32:52.304126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bc529010-790b-4478-9bdf-50bfe1413b9d req-d0eb7ff1-efe8-47a4-ad64-8ad9782aba0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045352 Jul 30 21:32:52.305183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2831/5606] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:52.617151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:52.618050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:52.624615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:52.625086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:52.626125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:52.626775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:52.787457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:52.798397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fc5c5f3-2031-441e-a96d-bfe26d80481b tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.184011 Jul 30 21:32:52.804132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2776/5607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:52 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:52.930547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:52.931821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:52.950167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:52.953079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:52.953886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:52.954873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:52.955363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:52.971266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:52.974354 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 HTTP/1.1 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1c28cc18-83ac-4376-bab3-01c3219dbf21'} Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:32:52.977320 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d322ee83-561b-4ec4-8f89-12b1c626bff2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 404 len: 111 microversion: 2.1 time: 0.059844 Jul 30 21:32:52.986493 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2832/5608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:52 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:32:52.990746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8f396c39-9203-46da-90de-b575930a2817 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '.version_select at 0x7fbb5c022790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:53.018301 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8f396c39-9203-46da-90de-b575930a2817 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302981942" status: 202 len: 0 microversion: 2.1 time: 0.033284 Jul 30 21:32:53.023097 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2777/5609] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:32:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302981942 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:32:53.296449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d6e29686-94f8-40eb-8b4e-2bfb3b848925 req-086901c2-78f5-406f-bc3b-e766abc138eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88175784-be66-4f78-ade7-1d4b95fa50f5", "name": "network-vif-plugged", "status": "completed", "tag": "43e10e99-a93c-409d-9147-2a0032513557"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:53.310160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6e29686-94f8-40eb-8b4e-2bfb3b848925 req-086901c2-78f5-406f-bc3b-e766abc138eb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.312739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6e29686-94f8-40eb-8b4e-2bfb3b848925 req-086901c2-78f5-406f-bc3b-e766abc138eb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.325093 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d6e29686-94f8-40eb-8b4e-2bfb3b848925 req-086901c2-78f5-406f-bc3b-e766abc138eb service nova] Creating event network-vif-plugged:43e10e99-a93c-409d-9147-2a0032513557 for instance 88175784-be66-4f78-ade7-1d4b95fa50f5 on nch2-master-1 Jul 30 21:32:53.330305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d6e29686-94f8-40eb-8b4e-2bfb3b848925 req-086901c2-78f5-406f-bc3b-e766abc138eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038290 Jul 30 21:32:53.331530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2833/5610] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:53.705926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:53.706821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:53.709041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:53.715202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87a7a95d-3cec-4494-8f1b-a928c21be43c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: .version_select at 0x7fbb4fb3e3a0>, body: {"keypair": {"name": "tempest-keypair-1351700173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdixkLAthuLxp8JwBFOkK31rkjkmHnBpyaTdYaLujwuViQ3dDWBRW/bJb5RE51xFrBfvh9XwpT8JPp600pS3GXnNe55QIBN8HPor7x3N1vNu7mLWTTUg60RutjXzV3R9A=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:53.716070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.716606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.717409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.717867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.732016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-87a7a95d-3cec-4494-8f1b-a928c21be43c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:53.737931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-87a7a95d-3cec-4494-8f1b-a928c21be43c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for user 5a6da0171fac41fb934ed2b294081531 and project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:53.763350 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87a7a95d-3cec-4494-8f1b-a928c21be43c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052513 Jul 30 21:32:53.764279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2834/5611] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:32:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:32:53.820887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:53.821628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:53.828668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.829174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.830139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.830607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.875730 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be211c53-5814-418b-abaf-4c01aa3865a4 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1831 microversion: 2.1 time: 0.172805 Jul 30 21:32:53.878894 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2778/5612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:53 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1831 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:53.900403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:53.903752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:53.911597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.912288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:53.913267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:53.913724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.098828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:54.107867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5795d4c8-14e5-472e-9ef7-b0d0a25bc630 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1428 microversion: 2.1 time: 0.290810 Jul 30 21:32:54.108755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2835/5613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:53 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1428 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:54.126222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:54.135759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebe94875-b2f0-4a0b-9d69-0c46a1011362 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1680 microversion: 2.1 time: 0.240624 Jul 30 21:32:54.137023 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2779/5614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:53 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:54.241624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:54.244867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:54.252213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.253307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.254122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.254581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.313392 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a92004c7-efcd-49b0-969e-a803be3e17ef tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action" status: 200 len: 32618 microversion: 2.1 time: 0.078402 Jul 30 21:32:54.314057 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2836/5615] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:32:54 2022] POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action => generated 32618 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:32:54.486276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:54.487328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:54.496264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.497173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.499526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.500059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.549333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fa0bf58ed064372805f230f0b35e42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152c660df7e349ad86665647d6b3bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:54.550043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] flavor_id is None. Assuming migration. {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 30 21:32:54.550482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:32:54.916283 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-158404d6-61c2-4c70-9e98-d17f6a935665 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.434556 Jul 30 21:32:54.917613 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2780/5616] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:32:54 2022] POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:32:54.927534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:54.929776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:54.948034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.948791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:54.949827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:54.950787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.137743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:55.138610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:55.149012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.149633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.157251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.158671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.243171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:55.254108 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b673dd6-3c4d-4506-b9b3-aa1ca89cea0b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1689 microversion: 2.1 time: 0.331578 Jul 30 21:32:55.254701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2837/5617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:54 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1689 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:55.456629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:55.467795 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f8ad321-6bc1-40e9-b3b7-0c48ff7ae527 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1608 microversion: 2.1 time: 0.342165 Jul 30 21:32:55.468978 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2781/5618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:55 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1608 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:55.489269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:55.489898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:55.502020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.502492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.503911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.504500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.533063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:55.718441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:55.730937 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7193922b-792a-48a4-9bff-ce11cc5ee9c3 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1608 microversion: 2.1 time: 0.246168 Jul 30 21:32:55.732131 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2838/5619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:55 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1608 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:55.761158 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:55.761990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:55.781476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.782686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.785619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:55.786446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:55.891909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-240391869", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f372ffef-6c6a-4f4d-bcab-1b2fc3684d65"}], "security_groups": [{"name": "tempest-securitygroup--2144245503"}], "key_name": "tempest-keypair-1351700173", "user_data": "}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:32:56.015910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:56.025858 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-83094c74-3f5f-43bb-9fc7-c14820a53dfd tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1608 microversion: 2.1 time: 0.275497 Jul 30 21:32:56.026467 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2782/5620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:55 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1608 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:56.038976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] validate_networks() for [('f372ffef-6c6a-4f4d-bcab-1b2fc3684d65', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:32:56.282219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:56.284694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:56.295492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.296506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.297565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.298229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.534253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:56.543614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58b36d3e-bc9d-4b8a-af5c-25bbe0931078 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1689 microversion: 2.1 time: 0.270755 Jul 30 21:32:56.544715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2783/5621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:56 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:56.549902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:56.551003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:56.562247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.567274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.568118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.568575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.703961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lazy-loading 'services' on Instance uuid 8876225f-c2f8-4ea2-a781-5af8be7552f7 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:32:56.830217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-350693a5-3a4e-4827-a5ec-b0c2757efe91 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7/os-volume_attachments/3a0555a8-f248-41c2-b23f-fd458dbd282b" status: 202 len: 0 microversion: 2.1 time: 0.283806 Jul 30 21:32:56.831726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2784/5622] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:32:56 2022] DELETE /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7/os-volume_attachments/3a0555a8-f248-41c2-b23f-fd458dbd282b => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:32:56.919640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:32:56.921367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:32:56.921941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:32:56.922559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:32:56.923315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:32:56.946514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.948099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.949774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:56.950240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:56.982142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:32:56.993565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Getting quotas for user 5a6da0171fac41fb934ed2b294081531 and project 1c7b4209e06447d5abdff867f9a7adce. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:32:57.021685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:32:57.024190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:32:57.082822 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b35a6f5d-90be-42fb-aa13-876940e19313 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.195930 Jul 30 21:32:57.083761 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2839/5623] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:32:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:32:57.096311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-955054f5-1492-4422-bb67-c6afaac41fe8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:57.103591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-955054f5-1492-4422-bb67-c6afaac41fe8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:57.216729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-955054f5-1492-4422-bb67-c6afaac41fe8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:57.224484 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-955054f5-1492-4422-bb67-c6afaac41fe8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1237 microversion: 2.1 time: 0.132816 Jul 30 21:32:57.225252 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2785/5624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:57 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1237 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:57.576478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:57.583021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:57.594976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:57.596913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:57.598353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:57.599886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:57.804953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:57.817962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf6eaff7-e245-4c64-a8d9-7b75a03ea877 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1689 microversion: 2.1 time: 0.250978 Jul 30 21:32:57.819329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2840/5625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:57 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:58.033667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:58.034829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:58.044804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.045807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.046795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.047440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.086276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:32:58.224060 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e6bc96c-5a2e-4f93-9d5f-80d121fa4c37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 204 len: 0 microversion: 2.1 time: 0.203416 Jul 30 21:32:58.227753 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2786/5626] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:32:58 2022] DELETE /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:32:58.234662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:58.236183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:58.244864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.245628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.246764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.247434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.253757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:58.255007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:58.263912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.264852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.265795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.266362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.437827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:58.449227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:58.459217 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-505eca0e-042d-42ea-a963-61d6aaaf0a00 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1513 microversion: 2.1 time: 0.228373 Jul 30 21:32:58.460182 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2841/5627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:58 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:58.462763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8a60c3b4-6fd6-45c1-a25e-75b98cad3988 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1289 microversion: 2.1 time: 0.218696 Jul 30 21:32:58.477755 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2787/5628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:58 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1289 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:32:58.840677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:58.841450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:58.849644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.851077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:58.851961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:58.852423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:59.061329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:59.073835 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-248be01c-1b62-4f1d-b74c-0bda6e9266dd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1689 microversion: 2.1 time: 0.237612 Jul 30 21:32:59.074613 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2842/5629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:58 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:32:59.486319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:59.487868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:59.499256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:59.499543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:32:59.500631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:32:59.500940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:59.501919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:59.503095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:59.542386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:59.543155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:59.547055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:32:59.548286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:32:59.639030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:32:59.654880 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1d734e1-1506-4a71-9c3c-a08a7fa0921e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1297 microversion: 2.1 time: 0.172747 Jul 30 21:32:59.657593 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2843/5630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:59 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1297 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:00.097910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:00.098898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:00.105030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:00.110802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:00.113873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:00.117372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:00.118015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:00.132922 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fdd0f312-ba4f-4758-ac43-180c62756db3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1513 microversion: 2.1 time: 0.652119 Jul 30 21:33:00.134298 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2788/5631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:32:59 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1513 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:00.195664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-56e688ad-c854-4083-9a22-920263f1f7b9 req-4f4c29c0-7dc5-4f9c-a897-b492346e7700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88175784-be66-4f78-ade7-1d4b95fa50f5", "tag": "43e10e99-a93c-409d-9147-2a0032513557"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:00.207940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-56e688ad-c854-4083-9a22-920263f1f7b9 req-4f4c29c0-7dc5-4f9c-a897-b492346e7700 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:00.208883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-56e688ad-c854-4083-9a22-920263f1f7b9 req-4f4c29c0-7dc5-4f9c-a897-b492346e7700 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:00.223187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-56e688ad-c854-4083-9a22-920263f1f7b9 req-4f4c29c0-7dc5-4f9c-a897-b492346e7700 service nova] Creating event network-changed:43e10e99-a93c-409d-9147-2a0032513557 for instance 88175784-be66-4f78-ade7-1d4b95fa50f5 on nch2-master-1 Jul 30 21:33:00.233850 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-56e688ad-c854-4083-9a22-920263f1f7b9 req-4f4c29c0-7dc5-4f9c-a897-b492346e7700 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055714 Jul 30 21:33:00.234571 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2789/5632] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:00.455719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:00.463700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-273ebec1-7a31-4367-b92b-79704aac1472 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.370543 Jul 30 21:33:00.465183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2844/5633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:00 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:00.694338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:00.695121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:00.709879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:00.711432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:00.712262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:00.712729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:00.779464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:01.079309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:01.091444 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-357002b8-d70a-4b53-90cf-bb77b925794c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.402135 Jul 30 21:33:01.092672 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2790/5634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:00 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:01.162391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:01.163140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:01.175146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.177477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.178704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.180371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.242784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.243462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.244037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lazy-loading 'fault' on Instance uuid 8876225f-c2f8-4ea2-a781-5af8be7552f7 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:33:01.330408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:01.344283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77a0f21e-98d1-484d-a91f-f28fc96629e7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 200 len: 1308 microversion: 2.1 time: 0.187879 Jul 30 21:33:01.345491 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2845/5635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:01 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:01.488881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:01.489510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:01.498047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.498780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.500154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.501028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.661488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:01.669387 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8213cde-ccf5-447c-b4e3-c08653fa495e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.184964 Jul 30 21:33:01.670558 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2791/5636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:01 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:01.710840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2f324029-7fe0-4b67-84e4-ba4229fbec9c req-95721497-5b64-42ca-bb9b-9f29f26d4e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe3476f-8428-4676-9cc4-9881ce1a7750", "tag": "02601998-e43f-465b-8fa9-9cdb528d55ba"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:01.722728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f324029-7fe0-4b67-84e4-ba4229fbec9c req-95721497-5b64-42ca-bb9b-9f29f26d4e79 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:01.723192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2f324029-7fe0-4b67-84e4-ba4229fbec9c req-95721497-5b64-42ca-bb9b-9f29f26d4e79 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:01.734783 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2f324029-7fe0-4b67-84e4-ba4229fbec9c req-95721497-5b64-42ca-bb9b-9f29f26d4e79 service nova] Creating event network-changed:02601998-e43f-465b-8fa9-9cdb528d55ba for instance abe3476f-8428-4676-9cc4-9881ce1a7750 on nch1-master-1 Jul 30 21:33:01.740891 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2f324029-7fe0-4b67-84e4-ba4229fbec9c req-95721497-5b64-42ca-bb9b-9f29f26d4e79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039466 Jul 30 21:33:01.741846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2846/5637] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:02.113622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:02.114328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:02.121695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.122170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.122976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.123517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.256030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:02.264049 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb6e56a3-ddee-45da-b7f5-a1b3c2920d5c tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.155129 Jul 30 21:33:02.264627 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2792/5638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:02 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:02.264792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9bf7d335-7e47-4d06-aac6-436d31e4f74c req-9b8f8472-72c1-4c3e-a9ad-02094b520766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8876225f-c2f8-4ea2-a781-5af8be7552f7", "name": "network-vif-deleted", "tag": "78eb11de-c7d6-4613-b17a-944348c6e06e"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:02.275533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9bf7d335-7e47-4d06-aac6-436d31e4f74c req-9b8f8472-72c1-4c3e-a9ad-02094b520766 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.276000 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9bf7d335-7e47-4d06-aac6-436d31e4f74c req-9b8f8472-72c1-4c3e-a9ad-02094b520766 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.287418 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9bf7d335-7e47-4d06-aac6-436d31e4f74c req-9b8f8472-72c1-4c3e-a9ad-02094b520766 service nova] Creating event network-vif-deleted:78eb11de-c7d6-4613-b17a-944348c6e06e for instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 on nch1-master-1 Jul 30 21:33:02.292450 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9bf7d335-7e47-4d06-aac6-436d31e4f74c req-9b8f8472-72c1-4c3e-a9ad-02094b520766 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Jul 30 21:33:02.293064 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2847/5639] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:33:02.365021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:02.365768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 8876225f-c2f8-4ea2-a781-5af8be7552f7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:02.371927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.372398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.373198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.373667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.387411 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] HTTP exception thrown: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Request method failure captured: Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 HTTP/1.1 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aL-OThEpElvAAlXvxRFiNHmkktY5PIDqACSo-XzXurzw9dH-o6jsmnjLMpxjIy2NQynzABAgK3DjKlRu4Tvo9Jea2olz2n4aqRrRpmm90teePu3_YsBh6L3BSQLVrtH8N6ABG8t4Y-536mK3Kk45dK83GXOR1V4yswQ64oa7xqvrZE Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 86550d66e9144788967e5b514cda82d7 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86550d66e9144788967e5b514cda82d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86550d66e9144788967e5b514cda82d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86550d66e9144788967e5b514cda82d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86550d66e9144788967e5b514cda82d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 86550d66e9144788967e5b514cda82d7 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesSnapshotTestJSON-1137680000-project Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 937935818cda4a6e8b9104d38aa3a8b1 Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesSnapshotTestJSON-1137680000-project Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '8876225f-c2f8-4ea2-a781-5af8be7552f7'} Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:33:02.389079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Returning 404 to user: Instance 8876225f-c2f8-4ea2-a781-5af8be7552f7 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78616863-1621-4d49-98ae-817b32a9bc37 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7" status: 404 len: 111 microversion: 2.1 time: 0.029471 Jul 30 21:33:02.394869 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2793/5640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:02 2022] GET /compute/v2.1/servers/8876225f-c2f8-4ea2-a781-5af8be7552f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:33:02.692827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:02.693645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:02.700026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.700504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.701357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:02.701753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:02.840444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:02.848340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f12c06d5-eaac-4a39-ab87-ca06b845e50c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.160365 Jul 30 21:33:02.848922 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2848/5641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:02 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:03.286655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:03.287278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:03.290085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:03.295603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:03.296074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:03.296864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:03.297333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:03.434630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:03.443010 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f63ca494-db45-48ea-84e3-9ec24922b35d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.160732 Jul 30 21:33:03.443630 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2794/5642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:03 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:03.869513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:03.870172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:03.877728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:03.878202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:03.879013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:03.879491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:04.047125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:04.055898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50f80401-1e48-46ed-9ec9-6efcea021d69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.190136 Jul 30 21:33:04.057122 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2849/5643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:03 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:04.463930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:04.464559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:04.471687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:04.472149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:04.472922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:04.473391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:04.605362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:04.613676 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f5bded82-cab8-4c49-8255-0233ec09796e tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.153630 Jul 30 21:33:04.614276 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2795/5644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:04 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:05.083409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:05.085197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:05.108893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:05.109494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:05.110952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:05.112791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:05.328279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:05.340624 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-227e1113-e566-42a3-986e-2ca41fe977e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.263039 Jul 30 21:33:05.345492 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2850/5645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:05 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:05.635960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:05.635960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:05.647148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:05.647785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:05.648645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:05.649104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:05.908869 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:05.924105 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c5b89b7c-23ac-47e9-88d1-78eb9c5b6c7b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.292720 Jul 30 21:33:05.925235 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2796/5646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:05 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:06.331479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-925706270", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "87506bc5-4984-4aaa-a9f0-dcc00644b77f"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:06.373896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:06.374937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:06.384809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:06.385711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:06.387045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:06.387669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:06.426757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] validate_networks() for [('87506bc5-4984-4aaa-a9f0-dcc00644b77f', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:33:06.632401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:06.642414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe645547-2c19-4345-9eb8-da0760e6d771 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.281446 Jul 30 21:33:06.645147 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2797/5647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:06 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:06.950114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:06.950675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:06.961773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:06.962950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:06.964086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:06.965517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:06.965921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:06.997510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:33:06.998041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:33:06.998546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:33:06.999377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:33:06.999990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:33:07.014777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:07.025097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:07.025825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:07.026844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:07.027585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:07.049901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:07.056160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Getting quotas for project 86550d66e9144788967e5b514cda82d7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:33:07.067029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Getting quotas for user 937935818cda4a6e8b9104d38aa3a8b1 and project 86550d66e9144788967e5b514cda82d7. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:33:07.089118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:33:07.091438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:33:07.159965 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71e9ee21-9798-4153-b7c9-323d693e298a tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835978 Jul 30 21:33:07.166705 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2851/5648] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:33:07.176250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:07.182710 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fed66980-a6f0-40c8-9e17-7479a837e751 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.237538 Jul 30 21:33:07.184029 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2798/5649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:06 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:07.191327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8211f9c7-e3da-4f64-84f8-ec9d53190f30 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:07.191327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8211f9c7-e3da-4f64-84f8-ec9d53190f30 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:07.294048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8211f9c7-e3da-4f64-84f8-ec9d53190f30 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:07.316452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8211f9c7-e3da-4f64-84f8-ec9d53190f30 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1218 microversion: 2.1 time: 0.147657 Jul 30 21:33:07.317552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2852/5650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:07 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:07.678922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:07.680980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:07.694390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:07.701924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:07.702426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:07.703274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:07.703942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:07.902823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:07.925775 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fad0a30e-8aac-41ea-a2b1-3d3ac23d7e44 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.257540 Jul 30 21:33:07.926318 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2799/5651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:07 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:08.208840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:08.210138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:08.218679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.219499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.220761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.221314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.341033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:08.342389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:08.349728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.350346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.351266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.351756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.360655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:08.370367 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-37ff72f2-5ed2-46ea-962e-c5f01044f722 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.165516 Jul 30 21:33:08.371219 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2853/5652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:08 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:08.436353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:08.445051 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0c0c9a5-644b-4c58-a0a8-40458a5465e2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1270 microversion: 2.1 time: 0.108255 Jul 30 21:33:08.445640 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2800/5653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:08 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:08.814365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-078cbd22-6bd3-46a3-a62e-0b893f5995d8 req-d438d339-1362-4f31-b382-d2f572a84c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe3476f-8428-4676-9cc4-9881ce1a7750", "name": "network-vif-plugged", "status": "completed", "tag": "02601998-e43f-465b-8fa9-9cdb528d55ba"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:08.827954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-078cbd22-6bd3-46a3-a62e-0b893f5995d8 req-d438d339-1362-4f31-b382-d2f572a84c30 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.828425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-078cbd22-6bd3-46a3-a62e-0b893f5995d8 req-d438d339-1362-4f31-b382-d2f572a84c30 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.842672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-078cbd22-6bd3-46a3-a62e-0b893f5995d8 req-d438d339-1362-4f31-b382-d2f572a84c30 service nova] Creating event network-vif-plugged:02601998-e43f-465b-8fa9-9cdb528d55ba for instance abe3476f-8428-4676-9cc4-9881ce1a7750 on nch1-master-1 Jul 30 21:33:08.849069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-078cbd22-6bd3-46a3-a62e-0b893f5995d8 req-d438d339-1362-4f31-b382-d2f572a84c30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Jul 30 21:33:08.849699 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2854/5654] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:08.950666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:08.951395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:08.960373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.960901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:08.961780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:08.962294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:09.152014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:09.168684 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79cf8b0b-1013-4405-84e1-a1135754b014 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.223130 Jul 30 21:33:09.185428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2801/5655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:08 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:09.392630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:09.393961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:09.401358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:09.401821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:09.402599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:09.403045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:09.466187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:09.466820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:09.475529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:09.476253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:09.477053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:09.477508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:09.720621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:09.729185 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e5d1a65-bb97-4ac7-951e-5197d11df255 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.266841 Jul 30 21:33:09.739440 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2802/5656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:09 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:09.887823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:09.895980 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2bc24932-679b-403a-ba16-989d6a6c5486 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1363 microversion: 2.1 time: 0.507548 Jul 30 21:33:09.896571 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2855/5657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:09 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1363 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:10.193681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:10.194456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:10.201953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.202429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.203263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.203924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.436292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8f70a44f-c8a4-4108-afab-59c043248fce req-97c51f67-9aab-46dd-9b33-adbdd2f7edb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb28c4e-4df4-4880-ba3f-dacb40590476", "tag": "590a91d9-f553-4e79-b756-03d29a8f902a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:10.449297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f70a44f-c8a4-4108-afab-59c043248fce req-97c51f67-9aab-46dd-9b33-adbdd2f7edb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.449781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f70a44f-c8a4-4108-afab-59c043248fce req-97c51f67-9aab-46dd-9b33-adbdd2f7edb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.454622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:10.467660 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8f70a44f-c8a4-4108-afab-59c043248fce req-97c51f67-9aab-46dd-9b33-adbdd2f7edb8 service nova] Creating event network-changed:590a91d9-f553-4e79-b756-03d29a8f902a for instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 on nch2-master-1 Jul 30 21:33:10.474029 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8f70a44f-c8a4-4108-afab-59c043248fce req-97c51f67-9aab-46dd-9b33-adbdd2f7edb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041469 Jul 30 21:33:10.474211 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-046998b7-8ced-4ba8-a141-521cb6467939 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.283696 Jul 30 21:33:10.475176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2856/5658] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:33:10.475943 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2803/5659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:10 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:10.771258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:10.772191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:10.787905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.788830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.789821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.790287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.916815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:10.917477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:10.924322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.924865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.925742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:10.926269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:10.926496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:10.934141 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2a931584-955e-427d-bc41-c27d32bb3ef2 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.169203 Jul 30 21:33:10.934723 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2857/5660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:10 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:11.064107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:11.072476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-99de7324-c652-4e80-9616-5e43e9e4d084 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1548 microversion: 2.1 time: 0.159707 Jul 30 21:33:11.073050 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2804/5661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:10 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:11.092894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:11.093400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:11.099508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.099972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:11.100742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.101189 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:11.178720 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-34bead74-f133-44ac-9737-01f3861ced7d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089602 Jul 30 21:33:11.179355 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2858/5662] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:33:11 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:11.497668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:11.498318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:11.506349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.506817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:11.507629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.508083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:11.758977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:11.768092 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fca0ab4c-ea9c-4095-8bae-597e9e44888b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.274310 Jul 30 21:33:11.782440 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2805/5663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:11 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:11.957290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:11.958036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:11.964373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.964833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:11.965605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:11.966054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:12.102671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:12.111959 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5d2f38c-6a01-4032-88eb-0f86be5229a6 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.159853 Jul 30 21:33:12.112549 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2859/5664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:11 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:12.586881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0d14e9a1-0cea-4fc9-9902-8cc99130105e req-650d5d40-0465-472b-bceb-409c1096b570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe3476f-8428-4676-9cc4-9881ce1a7750", "tag": "02601998-e43f-465b-8fa9-9cdb528d55ba"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:12.598834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0d14e9a1-0cea-4fc9-9902-8cc99130105e req-650d5d40-0465-472b-bceb-409c1096b570 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:12.599321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0d14e9a1-0cea-4fc9-9902-8cc99130105e req-650d5d40-0465-472b-bceb-409c1096b570 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:12.614291 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0d14e9a1-0cea-4fc9-9902-8cc99130105e req-650d5d40-0465-472b-bceb-409c1096b570 service nova] Creating event network-changed:02601998-e43f-465b-8fa9-9cdb528d55ba for instance abe3476f-8428-4676-9cc4-9881ce1a7750 on nch1-master-1 Jul 30 21:33:12.619817 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0d14e9a1-0cea-4fc9-9902-8cc99130105e req-650d5d40-0465-472b-bceb-409c1096b570 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037476 Jul 30 21:33:12.620808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2806/5665] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:33:12.789901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:12.790838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:12.797607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:12.798082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:12.799461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:12.800131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:12.804468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:13.034999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:13.042859 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e23b426c-b7af-4255-a354-63a794a23ae1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.256979 Jul 30 21:33:13.047339 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2860/5666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:12 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:13.133314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:13.134084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:13.140793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:13.141274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:13.142074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:13.142713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:13.292383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:13.301140 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d72bd696-232c-4c94-9d09-c4800945c5a8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.172043 Jul 30 21:33:13.301731 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2807/5667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:13 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:14.065732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:14.066353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:14.073423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:14.073888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:14.074669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:14.075123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:14.213702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:14.221383 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a79c5533-2743-47f6-a9f5-6bd015a4f25f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.160214 Jul 30 21:33:14.221994 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2861/5668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:14 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:14.325252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:14.326298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:14.335451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:14.335927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:14.336730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:14.337193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:14.358511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:14.485090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:14.493357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0213438a-bb90-4472-b60b-566ea3bcf68f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.173979 Jul 30 21:33:14.493938 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2808/5669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:14 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:15.242571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:15.243208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:15.250632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:15.251108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:15.252428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:15.252886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:15.409739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:15.419192 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4bc4d5b1-a60c-44bf-8ebc-fa101de26cff tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1694 microversion: 2.1 time: 0.180394 Jul 30 21:33:15.420408 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2862/5670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:15 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:15.515126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:15.515691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:15.523361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:15.523828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:15.524612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:15.525061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:15.659616 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:15.671013 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-37448e85-a04f-465c-9595-8850b19eb2cb tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.158914 Jul 30 21:33:15.671569 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2809/5671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:15 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:16.442017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:16.442780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:16.451047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:16.451505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:16.452295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:16.452751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:16.680020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:16.691627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79ac4f5c-a4b8-4e40-a1ce-a52d98948c89 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1693 microversion: 2.1 time: 0.253353 Jul 30 21:33:16.693668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:16.695640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:16.705399 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2863/5672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:16 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:16.706814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:16.707548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:16.708527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:16.709052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:16.740706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:16.752665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:16.753131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:16.765833 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] Creating event network-vif-unplugged:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch1-master-1 Jul 30 21:33:16.772441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:33:16.784532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-58934def-28e8-4693-9376-e337ec5f186e req-97122ccb-5b14-47bc-a4ea-2678d6677caf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047484 Jul 30 21:33:16.785409 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2864/5673] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:33:16.856445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:16.865024 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-57778ed9-2a97-44f6-a682-2112cafc29c7 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.176466 Jul 30 21:33:16.865516 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2810/5674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:16 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:17.334653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:17.335623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:17.341224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f96e94f2-f24e-4acd-803c-cb6bd9e0b625 req-bb1ae760-0363-40ec-b675-7de18b671859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb28c4e-4df4-4880-ba3f-dacb40590476", "name": "network-vif-plugged", "status": "completed", "tag": "590a91d9-f553-4e79-b756-03d29a8f902a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:17.357105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f96e94f2-f24e-4acd-803c-cb6bd9e0b625 req-bb1ae760-0363-40ec-b675-7de18b671859 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:17.358260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f96e94f2-f24e-4acd-803c-cb6bd9e0b625 req-bb1ae760-0363-40ec-b675-7de18b671859 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:17.377539 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f96e94f2-f24e-4acd-803c-cb6bd9e0b625 req-bb1ae760-0363-40ec-b675-7de18b671859 service nova] Creating event network-vif-plugged:590a91d9-f553-4e79-b756-03d29a8f902a for instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 on nch2-master-1 Jul 30 21:33:17.382877 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f96e94f2-f24e-4acd-803c-cb6bd9e0b625 req-bb1ae760-0363-40ec-b675-7de18b671859 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049132 Jul 30 21:33:17.384211 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2865/5675] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:17.719540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:17.720304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:17.729612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:17.730153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:17.731539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:17.732075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:17.890703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:17.891626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:17.900431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:17.901055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:17.902211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:17.902924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:17.934186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:17.943018 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-25099f8b-dad8-4afb-898e-155a7b635c69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1693 microversion: 2.1 time: 0.227675 Jul 30 21:33:17.944042 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2811/5676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:17 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:18.060970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:18.075602 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d6525fa-46e1-4730-8f75-68c2c240ed17 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1318 microversion: 2.1 time: 0.190902 Jul 30 21:33:18.089633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2866/5677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:17 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:18.817885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:18.828178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:18.828646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:18.841094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] Creating event network-changed:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch1-master-1 Jul 30 21:33:18.847395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:33:18.859541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8393f673-54a3-423f-a7ab-aec84ea9ed96 req-b76daeff-9de7-4eb3-8c86-b304343b615c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045179 Jul 30 21:33:18.860148 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2812/5678] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:18.965869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:18.966634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:18.974567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:18.975256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:18.976222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:18.976870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:19.100502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:19.101362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:19.113692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:19.114180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:19.114990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:19.115663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:19.173349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:19.182604 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b21f28db-f370-43f8-bbb2-87d89145da87 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1691 microversion: 2.1 time: 0.221538 Jul 30 21:33:19.183601 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2867/5679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:18 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:19.680401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:19.688131 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01691eeb-163a-42df-a161-da149865c91f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1507 microversion: 2.1 time: 0.595061 Jul 30 21:33:19.688717 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2813/5680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:19 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:19.709942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "629d4006-7b40-4644-8678-fd6e4b6063f7", "device": "/dev/sdb"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:19.712425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:19.719010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:19.719757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:19.720652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:19.721120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.024721 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7bd99fed-d520-4b9d-894c-96266d27a19b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "POST /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318856 Jul 30 21:33:20.027485 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2868/5681] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:33:19 2022] POST /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:20.206342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:20.207067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:20.214343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.214818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.215651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.216105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.360412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:20.368457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0e4283d6-6597-46fd-a27d-1c8611c25abe tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1688 microversion: 2.1 time: 0.166871 Jul 30 21:33:20.369041 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2814/5682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:20 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:20.390392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:20.390955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:20.398327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.398855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.399746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.400237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.536743 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ec557977-95b6-4e04-9f50-6e49a58dff93 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.151053 Jul 30 21:33:20.537911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2869/5683] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:20 2022] POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:20.546125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:20.546909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:20.554942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.564988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.566029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:20.566532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:20.760219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:20.768752 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1e938a10-552d-443b-90c2-dac3b945fcbb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.226958 Jul 30 21:33:20.769342 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2815/5684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:20 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:21.791935 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:21.792805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:21.800634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:21.801164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:21.802021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:21.802504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:21.945160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:21.952840 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-31661a9a-d91d-4d89-b310-708e2834a58f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.166413 Jul 30 21:33:21.953412 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2870/5685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:21 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:22.974686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:22.975336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:22.983754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:22.984231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:22.985027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:22.985485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:23.127051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:23.134847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39493a65-5532-4eef-a99f-8b6de93a38bc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.164594 Jul 30 21:33:23.135466 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2816/5686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:22 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:24.157077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:24.157792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:24.164619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:24.165089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:24.165884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:24.166344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:24.307266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:24.315369 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c8ddbe0c-ba88-4e61-aa86-4cae8aed0249 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.162535 Jul 30 21:33:24.316058 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2871/5687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:24 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:24.497313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:24.513992 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:24.514465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:24.527720 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] Creating event network-changed:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:33:24.535953 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:33:24.547058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f41ca61a-75e0-4c2e-8aa9-a80702c644b4 req-63c05cbc-d022-4b94-8c46-bc0894a70080 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053584 Jul 30 21:33:24.547981 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2817/5688] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:25.337532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:25.338222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:25.345541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:25.346013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:25.346897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:25.347376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:25.746495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:25.759579 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-704bce3e-9666-4915-a18e-b7c4838c3b0a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.425883 Jul 30 21:33:25.760159 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2872/5689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:25 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:33:26.792408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:26.794603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:26.804658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:26.805126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:26.806369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:26.806773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:27.023163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:27.030831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f1a78543-efc1-4c31-9367-dcc31a51ba94 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1687 microversion: 2.1 time: 0.248740 Jul 30 21:33:27.031438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2818/5690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:26 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1687 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:28.054645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:28.055327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:28.061532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:28.062001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:28.062787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:28.063280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:28.195121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:28.202769 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e13c954e-153b-415e-ba11-007f5d244c31 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1680 microversion: 2.1 time: 0.154126 Jul 30 21:33:28.203347 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2873/5691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:28 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:31.402175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f35bec9c-074e-4be5-9f4b-fc04be910ee5 req-3bbd3cde-b95c-4e86-b8cd-6b9526417ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "name": "network-vif-plugged", "status": "completed", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:31.415634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f35bec9c-074e-4be5-9f4b-fc04be910ee5 req-3bbd3cde-b95c-4e86-b8cd-6b9526417ccc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:31.416418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f35bec9c-074e-4be5-9f4b-fc04be910ee5 req-3bbd3cde-b95c-4e86-b8cd-6b9526417ccc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:31.434056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f35bec9c-074e-4be5-9f4b-fc04be910ee5 req-3bbd3cde-b95c-4e86-b8cd-6b9526417ccc service nova] Creating event network-vif-plugged:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:33:31.440096 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f35bec9c-074e-4be5-9f4b-fc04be910ee5 req-3bbd3cde-b95c-4e86-b8cd-6b9526417ccc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041557 Jul 30 21:33:31.441015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2819/5692] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:32.409895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-828230048", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "1f1b76ae-2e52-4582-a3e4-7ef4ebf4a248"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:32.462136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] validate_networks() for [('1f1b76ae-2e52-4582-a3e4-7ef4ebf4a248', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:33:32.815826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:33:32.816263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:33:32.816754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:33:32.817178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:33:32.817605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:33:32.826588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:32.827056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:32.828030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:32.828439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:32.845530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Getting quotas for project 31cd519c52624cafbad2cdfebe8d03c4. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:33:32.851250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Getting quotas for user 929a74be31674ae2a22c47709cfa6955 and project 31cd519c52624cafbad2cdfebe8d03c4. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:33:32.864090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:33:32.866357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:33:32.914368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e11e452c-4d3b-45f9-8343-19cb4d112029 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619716 Jul 30 21:33:32.915025 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2874/5693] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:33:32.927405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51cfd772-3e8e-438f-bdd9-f69273064b58 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:32.929719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51cfd772-3e8e-438f-bdd9-f69273064b58 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:32.990468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51cfd772-3e8e-438f-bdd9-f69273064b58 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:32.997430 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51cfd772-3e8e-438f-bdd9-f69273064b58 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1214 microversion: 2.1 time: 0.075158 Jul 30 21:33:32.998023 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2820/5694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:32 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:34.019350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:34.019996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:34.026830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:34.027321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:34.028124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:34.028587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:34.032722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:34.102630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:34.110201 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3e5aa3e-102c-4e42-9c80-4b91cee2f069 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1272 microversion: 2.1 time: 0.096123 Jul 30 21:33:34.110770 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2875/5695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:34 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:35.135690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:35.136332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:35.138944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=56 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:35.145758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:35.146645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:35.147520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:35.147982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:35.246093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-bc5e46cc-9ea9-49b6-a8c2-679d6cff06f0 req-6bbfea52-b034-4388-9894-38b1017e3a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43692cc-30cb-4346-a985-8c4d99b6b7d8", "tag": "2769a1b8-82bb-40e9-a7e4-7697827e3168"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:35.260273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc5e46cc-9ea9-49b6-a8c2-679d6cff06f0 req-6bbfea52-b034-4388-9894-38b1017e3a6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:35.261010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-bc5e46cc-9ea9-49b6-a8c2-679d6cff06f0 req-6bbfea52-b034-4388-9894-38b1017e3a6e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:35.273759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-bc5e46cc-9ea9-49b6-a8c2-679d6cff06f0 req-6bbfea52-b034-4388-9894-38b1017e3a6e service nova] Creating event network-changed:2769a1b8-82bb-40e9-a7e4-7697827e3168 for instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 on nch1-master-1 Jul 30 21:33:35.281468 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-bc5e46cc-9ea9-49b6-a8c2-679d6cff06f0 req-6bbfea52-b034-4388-9894-38b1017e3a6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041059 Jul 30 21:33:35.282698 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2876/5696] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:35.339925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:35.352120 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5bc0161-a87f-4309-a4c9-55a9524275a2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.222367 Jul 30 21:33:35.352803 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2821/5697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:35 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:36.013244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:36.013838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:36.020745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:36.021244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:36.022001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:36.022449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:36.046446 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2497c735-e252-4555-842f-0c4bb73af601 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.037606 Jul 30 21:33:36.047003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2877/5698] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Jul 30 21:33:36 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5/os-server-password => generated 116 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:36.373354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:36.373988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:36.381838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:36.382312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:36.383101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:36.383591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:36.514121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:36.524903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cdce3ae6-ad2a-4ec4-bd3c-8f096733fa7e tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.155172 Jul 30 21:33:36.525585 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2822/5699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:36 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:37.546803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:37.547466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:37.550371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:37.555980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:37.556452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:37.557248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:37.557700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:37.702159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:37.711771 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2d596e2a-117d-4b71-b8e6-09b91b1113bd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.168993 Jul 30 21:33:37.712360 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2878/5700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:37 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:38.733810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:38.734545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:38.742277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:38.742748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:38.743558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:38.744019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:38.877647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:38.885315 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-eedaae60-33e6-4be3-8928-62add03dfdeb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.155499 Jul 30 21:33:38.885889 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2823/5701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:38 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:39.906835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:39.907533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:39.914577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:39.915055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:39.915878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:39.916337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:40.050556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:40.058221 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7930bb1-ddcd-48a7-abb1-3878b00c0be2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.155328 Jul 30 21:33:40.058796 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2879/5702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:39 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:40.817477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-956661fa-506f-4017-9f6b-a963c55b6a0f req-2be21289-07c0-42de-817a-b1f62eaf5c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43692cc-30cb-4346-a985-8c4d99b6b7d8", "name": "network-vif-plugged", "status": "completed", "tag": "2769a1b8-82bb-40e9-a7e4-7697827e3168"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:40.828570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-956661fa-506f-4017-9f6b-a963c55b6a0f req-2be21289-07c0-42de-817a-b1f62eaf5c24 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:40.829246 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-956661fa-506f-4017-9f6b-a963c55b6a0f req-2be21289-07c0-42de-817a-b1f62eaf5c24 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:40.845084 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-956661fa-506f-4017-9f6b-a963c55b6a0f req-2be21289-07c0-42de-817a-b1f62eaf5c24 service nova] Creating event network-vif-plugged:2769a1b8-82bb-40e9-a7e4-7697827e3168 for instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 on nch1-master-1 Jul 30 21:33:40.850043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-956661fa-506f-4017-9f6b-a963c55b6a0f req-2be21289-07c0-42de-817a-b1f62eaf5c24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036803 Jul 30 21:33:40.850697 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2824/5703] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:41.078940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:41.079630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:41.087276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:41.087775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:41.088557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:41.089013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:41.218475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:41.226301 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b136289a-bb83-498a-a01a-caa7d709edcb tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1314 microversion: 2.1 time: 0.151290 Jul 30 21:33:41.226893 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2880/5704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:41 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:42.249331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:42.249959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:42.257108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.257572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.258380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.258822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.393747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:42.401418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bd74e088-d95f-467b-af8e-7e9db8f09046 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1501 microversion: 2.1 time: 0.157195 Jul 30 21:33:42.402040 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2825/5705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:42 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:42.421591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:42.422230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:42.429394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.429865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.430648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.431107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.565504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:42.573028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4c0cb72-428a-4122-b95f-66d1d43457e1 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1501 microversion: 2.1 time: 0.155325 Jul 30 21:33:42.573589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2881/5706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:42 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:42.594464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:42.595024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:42.601199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.601671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.602463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.602922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.626320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lazy-loading 'flavor' on Instance uuid c43692cc-30cb-4346-a985-8c4d99b6b7d8 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:33:42.672648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:42.693876 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51aa8df7-8e86-4820-815a-6b135f833098 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.103265 Jul 30 21:33:42.694526 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2826/5707] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:42 2022] POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:33:42.702571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:42.703205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:42.709498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.709967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.710866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:42.711399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:42.836364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:42.842085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:42.849886 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1f1817c7-ef2e-4415-93a8-d92ab2c61431 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1509 microversion: 2.1 time: 0.151200 Jul 30 21:33:42.850456 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2882/5708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:42 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:43.868770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:43.873950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:43.874657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:43.882277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:43.882773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:43.883587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:43.884033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:44.020639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:44.028286 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8df6279e-1df9-4d1d-9835-6c3bce74e6c6 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1492 microversion: 2.1 time: 0.160455 Jul 30 21:33:44.028850 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2827/5709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:43 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1492 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:44.048248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:44.048855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:44.050629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:44.057175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:44.057634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:44.058408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:44.058858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:44.126125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-77563223-a1cc-484a-a9cc-67a6feefbce0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.081252 Jul 30 21:33:44.127241 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2883/5710] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:44 2022] POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:44.135641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:44.136283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:44.142712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:44.143334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:44.144579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:44.145097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:44.284395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:44.292302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05f0f6e3-21f2-4a84-a012-a2d1203dcc8d tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1498 microversion: 2.1 time: 0.160682 Jul 30 21:33:44.292892 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2828/5711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:44 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:45.315609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:45.316837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:45.325511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.326073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.326949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.327453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.468405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:45.476140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1951550d-1a80-4a27-a25f-4b777f06afa0 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1501 microversion: 2.1 time: 0.166973 Jul 30 21:33:45.476701 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2884/5712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:45 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:45.496219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:45.496783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:45.505242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.505709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.506501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.506959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.530426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lazy-loading 'flavor' on Instance uuid c43692cc-30cb-4346-a985-8c4d99b6b7d8 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:33:45.596482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9177dca-b14d-4e0c-af1d-bb1997470e96 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.104019 Jul 30 21:33:45.599901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2829/5713] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:45 2022] POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:45.605380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:45.606012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:45.613176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.613790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.614570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:45.615026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:45.744284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:45.752912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-73cb662b-564a-4df9-8486-82d172470ae2 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1509 microversion: 2.1 time: 0.151410 Jul 30 21:33:45.753625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2885/5714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:45 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:46.431577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:46.432188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:46.438610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.439103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:46.439919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.440380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:46.463625 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6fc4e046-5ace-446f-af62-544cbeb3a274 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/ips" status: 200 len: 145 microversion: 2.1 time: 0.036453 Jul 30 21:33:46.464232 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2830/5715] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Jul 30 21:33:46 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:46.774660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:46.775312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:46.782358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.782925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:46.783885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.784346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:46.929200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:46.936910 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f31739c0-46cf-428d-ab0f-809de3a5f084 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1492 microversion: 2.1 time: 0.166495 Jul 30 21:33:46.937481 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2886/5716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:46 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1492 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:46.958642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:46.959199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:46.966695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.967171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:46.968072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:46.968497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:47.036272 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4967cf48-3cb7-40f7-a0eb-69a39d83494f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.082061 Jul 30 21:33:47.036924 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2831/5717] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:46 2022] POST /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:47.046164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:47.046825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:47.053245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:47.053932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:47.054730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:47.055236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:47.275623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:47.283113 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1576ff0e-eb95-48c2-948c-4d361788a3df tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1498 microversion: 2.1 time: 0.240878 Jul 30 21:33:47.283742 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2887/5718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:47 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:47.799126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44d7e113-0b68-4b4b-bd08-160ac4fe0c50"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:47.801597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:47.807887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:47.808347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:47.809117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:47.809565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.055425 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-802d9658-caa2-4573-9e38-4605ba26ac94 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261080 Jul 30 21:33:48.056270 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2832/5719] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:33:47 2022] POST /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:48.304848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:48.305474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:48.313566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.314487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.315282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.315824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.459886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:48.467679 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80be68b4-2f69-43b0-8db2-b9d93548409b tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1501 microversion: 2.1 time: 0.167254 Jul 30 21:33:48.468252 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2888/5720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:48 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:48.489753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:48.490355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:48.496893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.497365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.498154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.498606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.524535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:33:48.607155 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58355a23-8684-45ab-a829-61b275a1e3dd tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 204 len: 0 microversion: 2.1 time: 0.122303 Jul 30 21:33:48.607740 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2833/5721] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:33:48 2022] DELETE /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:33:48.617670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:48.618562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:48.625634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.626317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.627145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:48.627629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:48.768886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:48.777393 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4cbf0ca5-b5dd-4b5f-93dd-f05a6ed39797 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1507 microversion: 2.1 time: 0.164252 Jul 30 21:33:48.777973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2889/5722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:48 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:49.800017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:49.800820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:49.807911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:49.808383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:49.809184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:49.809645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:49.941145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:49.948832 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ba077bb3-d2a1-450d-a927-77605f4a1d44 tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1507 microversion: 2.1 time: 0.153450 Jul 30 21:33:49.949410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2834/5723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:49 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:50.802640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d58cf0d6-0f63-4d2f-9b2c-a11277cd7757 req-c5fb99b0-f2d0-461e-9381-d71d4cb37481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43692cc-30cb-4346-a985-8c4d99b6b7d8", "name": "network-vif-deleted", "tag": "2769a1b8-82bb-40e9-a7e4-7697827e3168"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:50.813433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d58cf0d6-0f63-4d2f-9b2c-a11277cd7757 req-c5fb99b0-f2d0-461e-9381-d71d4cb37481 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:50.814483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d58cf0d6-0f63-4d2f-9b2c-a11277cd7757 req-c5fb99b0-f2d0-461e-9381-d71d4cb37481 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:50.826722 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d58cf0d6-0f63-4d2f-9b2c-a11277cd7757 req-c5fb99b0-f2d0-461e-9381-d71d4cb37481 service nova] Creating event network-vif-deleted:2769a1b8-82bb-40e9-a7e4-7697827e3168 for instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 on nch1-master-1 Jul 30 21:33:50.831946 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d58cf0d6-0f63-4d2f-9b2c-a11277cd7757 req-c5fb99b0-f2d0-461e-9381-d71d4cb37481 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Jul 30 21:33:50.832656 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2890/5724] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:50.970731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:50.971535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:50.978961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:50.979576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:50.980501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:50.981056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:51.046278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929a74be31674ae2a22c47709cfa6955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cd519c52624cafbad2cdfebe8d03c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:51.054156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aaff56fe-aab3-4f73-a700-20f1c6524aac tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 200 len: 1465 microversion: 2.1 time: 0.087936 Jul 30 21:33:51.067999 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2835/5725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:50 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 1465 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:33:51.561215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:51.563538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:51.570416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:51.570888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:51.571709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:51.572169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:51.602060 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d1498014-94cb-43c5-8dfb-89b0ca437802 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jul 30 21:33:51.602621 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2891/5726] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:33:51 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:51.613723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:51.614244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:51.621050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:51.621796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:51.622245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:51.622708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:51.652614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2331ea4b-d341-4b59-bce1-5527c4b4cab9 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50" status: 200 len: 194 microversion: 2.1 time: 0.043424 Jul 30 21:33:51.653207 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2836/5727] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Jul 30 21:33:51 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:52.075023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:52.076302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] [instance: c43692cc-30cb-4346-a985-8c4d99b6b7d8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:52.083627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:52.084091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:52.084954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:52.085321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:52.101344 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] HTTP exception thrown: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Request method failure captured: Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 HTTP/1.1 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aOqeft5X9_MnNbg6yz3AWiEqMjxUWBmXHFBJYxmXZbvwBUvLodPRqC5vKuMV3P7y6-HJAGCjN97Lqm0ceoTCSCtAXJ6UzsPeX1bC6MpmAVxzNP-2M3KBRTq_MGHNwCxKBvmryrmINW3r3hnA32cIQpc8bNCHjcQmSLzIeyWSNfr6no Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 31cd519c52624cafbad2cdfebe8d03c4 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestServerAdvancedOps-1099740264 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/31cd519c52624cafbad2cdfebe8d03c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_31cd519c52624cafbad2cdfebe8d03c4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/31cd519c52624cafbad2cdfebe8d03c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/31cd519c52624cafbad2cdfebe8d03c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestServerAdvancedOps-1099740264 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 31cd519c52624cafbad2cdfebe8d03c4 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestServerAdvancedOps-1099740264 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestServerAdvancedOps-1099740264-project Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 929a74be31674ae2a22c47709cfa6955 Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestServerAdvancedOps-1099740264-project Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'c43692cc-30cb-4346-a985-8c4d99b6b7d8'} Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:33:52.103559 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] Returning 404 to user: Instance c43692cc-30cb-4346-a985-8c4d99b6b7d8 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-29d0af9e-20e3-4b17-a938-6cf1c11e334f tempest-TestServerAdvancedOps-1099740264 tempest-TestServerAdvancedOps-1099740264-project] 10.222.0.17 "GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8" status: 404 len: 111 microversion: 2.1 time: 0.034229 Jul 30 21:33:52.109019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2892/5728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:52 2022] GET /compute/v2.1/servers/c43692cc-30cb-4346-a985-8c4d99b6b7d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:33:52.989775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efda9a59-83d1-427b-8df8-e3439f11f71f"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:52.992476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:52.999693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:53.000434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:53.002529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:53.002999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:53.074928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:53.283951 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8b167c08-e661-49cc-a7bc-6e075aea2301 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "POST /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298090 Jul 30 21:33:53.284575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2837/5729] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:33:52 2022] POST /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:54.408533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:33:54.411077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:54.419726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:54.420210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:54.421027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:54.421489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:54.426964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:54.489781 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac6551d9-b8cc-4abf-b4bf-9764a51c4376 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action" status: 200 len: 63155 microversion: 2.1 time: 0.085175 Jul 30 21:33:54.490401 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2893/5730] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:33:54 2022] POST /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2/action => generated 63155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:33:55.550368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:55.552888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:55.559282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.559775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.560557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.561015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.591278 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5ca3be0-3be9-4c6d-b536-db5973532d65 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046511 Jul 30 21:33:55.591865 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2838/5731] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:33:55 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:33:55.740374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:55.740892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:55.748733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.749174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.749960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.750672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.782271 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-32af99f8-4d81-43b5-9ef1-90234d9dba46 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50" status: 200 len: 194 microversion: 2.1 time: 0.046259 Jul 30 21:33:55.782868 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2894/5732] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Jul 30 21:33:55 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:55.793217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:55.793729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:55.800357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.800827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.801646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:55.802241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:55.886889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lazy-loading 'services' on Instance uuid abe3476f-8428-4676-9cc4-9881ce1a7750 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:33:55.959951 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d960867-9814-4bb0-b503-fa4071f9c018 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50" status: 202 len: 0 microversion: 2.1 time: 0.170504 Jul 30 21:33:55.960724 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2839/5733] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:33:55 2022] DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/44d7e113-0b68-4b4b-bd08-160ac4fe0c50 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:57.085991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:57.086511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:57.093908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:57.094410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:57.096126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:57.096365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:57.125027 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-50c15123-0b65-41eb-be8a-37d410c579bc tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/efda9a59-83d1-427b-8df8-e3439f11f71f" status: 200 len: 194 microversion: 2.1 time: 0.043083 Jul 30 21:33:57.125875 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2895/5734] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Jul 30 21:33:57 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/efda9a59-83d1-427b-8df8-e3439f11f71f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:33:57.137986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:57.138580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:57.145424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:57.145882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:57.146658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:57.147108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:57.226342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lazy-loading 'services' on Instance uuid abe3476f-8428-4676-9cc4-9881ce1a7750 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:33:57.296968 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11ade789-06a4-466b-91fd-b768f08f06e0 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/efda9a59-83d1-427b-8df8-e3439f11f71f" status: 202 len: 0 microversion: 2.1 time: 0.164065 Jul 30 21:33:57.297525 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2840/5735] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:33:57 2022] DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments/efda9a59-83d1-427b-8df8-e3439f11f71f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:33:58.465727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:58.467995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:58.475247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.475754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.476548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.477011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.506988 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2e0da38-0de3-4e8b-baf2-6fb0963b19e8 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045269 Jul 30 21:33:58.507569 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2896/5736] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:33:58 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:33:58.640369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:58.642774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:58.649113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.649582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.650369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.650826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.679302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0fa2f7c3-1478-41c5-96da-3978feb418d7 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044305 Jul 30 21:33:58.679874 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2841/5737] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:33:58 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 21:33:58.741860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:58.742375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:58.748885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.749352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.750378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.750831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.775958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:33:58.850045 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-344b697e-451c-4e73-92d3-e73bb0e45924 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 204 len: 0 microversion: 2.1 time: 0.112009 Jul 30 21:33:58.850637 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2897/5738] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:33:58 2022] DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:33:58.858904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:33:58.859558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:33:58.866360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.866829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:58.867642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:33:58.868100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:33:59.008347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:33:59.016172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ccec693-617a-4f02-8591-69a28d09b477 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1673 microversion: 2.1 time: 0.161133 Jul 30 21:33:59.016782 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2842/5739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:33:58 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:00.037683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:00.038405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:00.045383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:00.045892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:00.046679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:00.047139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:00.181212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:00.189619 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6b9791da-6ea5-4770-84db-63cea73c125d tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1673 microversion: 2.1 time: 0.156269 Jul 30 21:34:00.190127 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2898/5740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:00 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:00.783991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:00.784627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:00.793056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:00.793624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:00.794494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:00.795029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:00.948799 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6454f300-0b80-4cda-a01f-d6c9b27db52d tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1831 microversion: 2.1 time: 0.169342 Jul 30 21:34:00.949415 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2843/5741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:00 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1831 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:01.210924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:01.212506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:01.220270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.220803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.221871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.222625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.451910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6da0171fac41fb934ed2b294081531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b4209e06447d5abdff867f9a7adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:01.460518 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a313279f-5fff-42f6-892d-4fb28ab2730b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 200 len: 1673 microversion: 2.1 time: 0.253594 Jul 30 21:34:01.461588 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2899/5742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:01 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:01.776233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d3877998-d7f4-4b01-ba53-d04f22bc2a4c req-9a464124-7696-483f-9684-2592398a4e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe3476f-8428-4676-9cc4-9881ce1a7750", "name": "network-vif-deleted", "tag": "02601998-e43f-465b-8fa9-9cdb528d55ba"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:01.810856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d3877998-d7f4-4b01-ba53-d04f22bc2a4c req-9a464124-7696-483f-9684-2592398a4e42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.811607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d3877998-d7f4-4b01-ba53-d04f22bc2a4c req-9a464124-7696-483f-9684-2592398a4e42 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.832849 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d3877998-d7f4-4b01-ba53-d04f22bc2a4c req-9a464124-7696-483f-9684-2592398a4e42 service nova] Creating event network-vif-deleted:02601998-e43f-465b-8fa9-9cdb528d55ba for instance abe3476f-8428-4676-9cc4-9881ce1a7750 on nch1-master-1 Jul 30 21:34:01.841018 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d3877998-d7f4-4b01-ba53-d04f22bc2a4c req-9a464124-7696-483f-9684-2592398a4e42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074968 Jul 30 21:34:01.846302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2844/5743] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:34:01.932406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:01.933125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:01.939833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-92f0ad55-51d6-4d64-9054-5cbdec5f1732 req-bd25ed02-0520-4f42-a00c-b0dc862d8e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:01.948505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.949270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.950248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.951357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-92f0ad55-51d6-4d64-9054-5cbdec5f1732 req-bd25ed02-0520-4f42-a00c-b0dc862d8e12 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:01.951704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.952054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-92f0ad55-51d6-4d64-9054-5cbdec5f1732 req-bd25ed02-0520-4f42-a00c-b0dc862d8e12 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:01.973414 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-92f0ad55-51d6-4d64-9054-5cbdec5f1732 req-bd25ed02-0520-4f42-a00c-b0dc862d8e12 service nova] Creating event network-changed:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:34:01.980948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-92f0ad55-51d6-4d64-9054-5cbdec5f1732 req-bd25ed02-0520-4f42-a00c-b0dc862d8e12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044726 Jul 30 21:34:01.985302 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2845/5744] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:34:02.000415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:34:02.128996 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e5b9074-7f89-4438-9147-1b45521549a7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 204 len: 0 microversion: 2.1 time: 0.201158 Jul 30 21:34:02.130007 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2900/5745] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:34:01 2022] DELETE /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:34:02.139838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:02.141110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:02.180115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:02.183189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:02.184411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:02.185026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:02.380970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:02.390637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7472e3e8-6e59-408f-b017-a6110ea42aee tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1686 microversion: 2.1 time: 0.255961 Jul 30 21:34:02.391319 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2846/5746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:02 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1686 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:02.482696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:02.483543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:02.490606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:02.491064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:02.492074 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:02.492716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:02.507907 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 HTTP/1.1 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'abe3476f-8428-4676-9cc4-9881ce1a7750'} Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:02.509838 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:02.514754 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:02.515947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:02.517515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16e3bcc5-d40c-4137-9aeb-460702ab2cb2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 404 len: 111 microversion: 2.1 time: 0.039312 Jul 30 21:34:02.518087 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2901/5747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:02 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:02.528591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5a714fdb-6ce2-41ba-b6c6-c1ee2df8b6e2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '.version_select at 0x7fbb62a91310>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:02.554415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5a714fdb-6ce2-41ba-b6c6-c1ee2df8b6e2 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351700173" status: 202 len: 0 microversion: 2.1 time: 0.031105 Jul 30 21:34:02.555360 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2847/5748] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351700173 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:34:03.412972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:03.413529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:03.420106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:03.420577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:03.421368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:03.421819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:03.677271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:03.690729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d4a2190a-e1ba-4f17-964b-c0a6c0a11bbc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 200 len: 1686 microversion: 2.1 time: 0.281676 Jul 30 21:34:03.693981 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2902/5749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:03 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 1686 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:04.117453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-99aed01d-dc33-4b4a-ac17-8ba19f7abb6e req-1678486e-46e5-4181-b501-2381f3ce289a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2", "name": "network-vif-deleted", "tag": "7adbb2cb-1170-48b2-a485-9219b6f8e648"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:04.136282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-99aed01d-dc33-4b4a-ac17-8ba19f7abb6e req-1678486e-46e5-4181-b501-2381f3ce289a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:04.137119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-99aed01d-dc33-4b4a-ac17-8ba19f7abb6e req-1678486e-46e5-4181-b501-2381f3ce289a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:04.150117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-99aed01d-dc33-4b4a-ac17-8ba19f7abb6e req-1678486e-46e5-4181-b501-2381f3ce289a service nova] Creating event network-vif-deleted:7adbb2cb-1170-48b2-a485-9219b6f8e648 for instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 on nch2-master-1 Jul 30 21:34:04.155618 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-99aed01d-dc33-4b4a-ac17-8ba19f7abb6e req-1678486e-46e5-4181-b501-2381f3ce289a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043029 Jul 30 21:34:04.156638 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2848/5750] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:34:04.717008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:04.717559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:04.724700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:04.725162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:04.726755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:04.727225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:04.741683 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] HTTP exception thrown: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Request method failure captured: Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 HTTP/1.1 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aKp90dBlJxMh9WaS3Gkq8gfM6d3-8CW3esqUHxEuCANA_gqkiFmN_HnVJHO6yowKHncdygk0zqfSahCnQ0Jc7c0nZC3rQBEysFKa_cSm1_zBYPdjJVetekWVSZ7A9FqS6XppBVFwcCGkdqB6qkkULx-peDevL2cETeLnN9aiv-ImQs Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4a16baf2cd6043c79dbe21fafc13eb28", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9f113fc80feb42148c3dad0c33417dfe Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2'} Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:04.743254 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Returning 404 to user: Instance e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-889fba72-0666-4f32-ad64-f6f512fd6037 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2" status: 404 len: 111 microversion: 2.1 time: 0.031760 Jul 30 21:34:04.752676 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2903/5751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:04 2022] GET /compute/v2.1/servers/e7d68bdf-ffbb-42fb-a9b9-998e13c66fe2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:06.008569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:06.010197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:06.012410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:06.020852 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:06.021331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:06.022135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:06.022590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:06.037895 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 HTTP/1.1 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'abe3476f-8428-4676-9cc4-9881ce1a7750'} Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:06.039553 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9f3943a1-d6ac-4157-a0cd-42154b3e91df tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 404 len: 111 microversion: 2.1 time: 0.038274 Jul 30 21:34:06.045247 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2849/5752] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:34:06 2022] DELETE /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:06.052038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:06.052692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: abe3476f-8428-4676-9cc4-9881ce1a7750] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:06.059675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:06.060152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:06.060958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:06.061573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:06.075906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 HTTP/1.1 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'abe3476f-8428-4676-9cc4-9881ce1a7750'} Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:06.077480 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance abe3476f-8428-4676-9cc4-9881ce1a7750 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3330927a-61ba-432d-bbdc-931802acbe0b tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750" status: 404 len: 111 microversion: 2.1 time: 0.031404 Jul 30 21:34:06.085286 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2904/5753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:06 2022] GET /compute/v2.1/servers/abe3476f-8428-4676-9cc4-9881ce1a7750 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:07.240452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:07.241618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:07.251650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:07.253245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:07.254309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:07.254849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:07.270286 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 HTTP/1.1 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1c28cc18-83ac-4376-bab3-01c3219dbf21'} Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:07.271929 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b569b96-5c51-4049-aa9e-275092cfec43 tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 404 len: 111 microversion: 2.1 time: 0.036734 Jul 30 21:34:07.276563 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2850/5754] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:34:07 2022] DELETE /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:07.282768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:07.283449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] [instance: 1c28cc18-83ac-4376-bab3-01c3219dbf21] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:07.290498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:07.290984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:07.291874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:07.292340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:07.308516 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] HTTP exception thrown: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Request method failure captured: Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 HTTP/1.1 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aLfwLtiZyhRmbAuxiv7uFX5YOd0DHX-41VqnYYKQw1GyykzH_IggiUpoA9mOlAlohH9g1KZRc4EPuz1bC91N0xMpjukU9j-UhtSuA-mifV903sytnZ9gGFU3J9iBQM_Og9X7QJoFX1pB6dZ7mq13nrd6fk6SpwuvTCo_FhOJxdq0O8 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c7b4209e06447d5abdff867f9a7adce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c7b4209e06447d5abdff867f9a7adce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 1c7b4209e06447d5abdff867f9a7adce Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1877777549 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 5a6da0171fac41fb934ed2b294081531 Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-AttachVolumeTestJSON-1877777549-project Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1c28cc18-83ac-4376-bab3-01c3219dbf21'} Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:34:07.311019 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. Jul 30 21:34:07.315662 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:34:07.324052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] Returning 404 to user: Instance 1c28cc18-83ac-4376-bab3-01c3219dbf21 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:34:07.324586 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c9fb9b2e-db5f-4a00-8b6f-40eb6886756f tempest-AttachVolumeTestJSON-1877777549 tempest-AttachVolumeTestJSON-1877777549-project] 10.222.0.17 "GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21" status: 404 len: 111 microversion: 2.1 time: 0.046381 Jul 30 21:34:07.326740 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2905/5755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:07 2022] GET /compute/v2.1/servers/1c28cc18-83ac-4376-bab3-01c3219dbf21 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:34:08.028408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5431b2dc-626b-4750-8752-74ee0a987805 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '.version_select at 0x7fbb4fd3cf70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:08.052296 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5431b2dc-626b-4750-8752-74ee0a987805 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794826589" status: 202 len: 0 microversion: 2.1 time: 0.029130 Jul 30 21:34:08.053190 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2851/5756] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Jul 30 21:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794826589 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:34:08.096374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cada73a3-1d99-433b-837a-f6482a209c02 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: .version_select at 0x7fbb4fb3ed30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-983072193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKto3mRidFARfs22DzCz947RHlTamekL6de3xDzlKhf8L3qzyZrKcOKy/bCtZR4LvyfvQGSU6MyQ85hlv3GFoyJPpbyCm3HmQFaVYl9JSJDiH2kVXmYERGMB7NsExJVT2Q=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:08.103132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:08.119171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cada73a3-1d99-433b-837a-f6482a209c02 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:34:08.126186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cada73a3-1d99-433b-837a-f6482a209c02 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:34:08.151118 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cada73a3-1d99-433b-837a-f6482a209c02 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060819 Jul 30 21:34:08.151719 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2906/5757] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:34:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:34:15.212912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-732160132", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b8f3cab1-8b1c-4e6a-89f5-ba35e54c939e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-983072193", "security_groups": [{"name": "tempest-secgroup-smoke-2032638952"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:15.708689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] validate_networks() for [('b8f3cab1-8b1c-4e6a-89f5-ba35e54c939e', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:34:16.380059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:34:16.380645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:34:16.380933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:34:16.381361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:34:16.381913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:34:16.395557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:16.396343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:16.397363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:16.398010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:16.420494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:34:16.427749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:34:16.442749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:34:16.445645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:34:16.518536 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02ce1d80-b72d-401a-b073-b1f57159e87c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.310875 Jul 30 21:34:16.519418 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2852/5758] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:34:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:34:16.541596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6090df2a-58f3-4be0-bf0d-a5e647d3d5f7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:16.542403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6090df2a-58f3-4be0-bf0d-a5e647d3d5f7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:16.615706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6090df2a-58f3-4be0-bf0d-a5e647d3d5f7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:16.624993 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6090df2a-58f3-4be0-bf0d-a5e647d3d5f7 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1265 microversion: 2.1 time: 0.096712 Jul 30 21:34:16.626306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2907/5759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:16 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:17.653110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:17.654466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:17.678363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:17.681554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:17.682370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:17.684435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:17.854317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:17.868054 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21536c2e-b0ee-4d17-9da0-70fc5574b8d3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1325 microversion: 2.1 time: 0.222080 Jul 30 21:34:17.871949 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2853/5760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:17 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:18.895786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:18.896836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:18.899267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:18.908055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:18.908812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:18.909945 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:18.910575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:19.202514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:19.213404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7d530cc2-7c87-472b-baec-72b76c6a86bf tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.322964 Jul 30 21:34:19.218708 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2908/5761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:18 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:19.673143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bf92746e-3e0c-42ba-b232-e7f6fca9e838 req-9b0874c1-5dd0-4c78-84fe-32231fbe00fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:19.688362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bf92746e-3e0c-42ba-b232-e7f6fca9e838 req-9b0874c1-5dd0-4c78-84fe-32231fbe00fa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:19.689231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bf92746e-3e0c-42ba-b232-e7f6fca9e838 req-9b0874c1-5dd0-4c78-84fe-32231fbe00fa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:19.718118 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bf92746e-3e0c-42ba-b232-e7f6fca9e838 req-9b0874c1-5dd0-4c78-84fe-32231fbe00fa service nova] Creating event network-changed:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch1-master-1 Jul 30 21:34:19.735896 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bf92746e-3e0c-42ba-b232-e7f6fca9e838 req-9b0874c1-5dd0-4c78-84fe-32231fbe00fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065445 Jul 30 21:34:19.737106 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2854/5762] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:34:20.235609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:20.236503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:20.247838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:20.248420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:20.249242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:20.249761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:20.394638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:20.405279 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bfa5d25-39be-48fc-a80e-f7d5af8260ec tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.173823 Jul 30 21:34:20.405861 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2909/5763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:20 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:21.428545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:21.429225 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:21.436156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:21.436756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:21.438388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:21.438774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:21.592977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:21.602483 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82e81180-197d-405c-937b-28980ea9fe11 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.179390 Jul 30 21:34:21.603198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2855/5764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:21 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:22.624512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:22.626016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:22.633159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:22.633630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:22.634415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:22.634866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:22.839432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:22.851221 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-524aaa22-1778-4fea-b677-472d33c8624a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.230476 Jul 30 21:34:22.851851 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2910/5765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:22 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:23.878801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:23.879491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:23.891187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:23.893317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:23.894180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:23.894637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:23.899089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:24.063371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:24.072045 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-86c326f2-d664-4049-938b-84ea1a79c3db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.203310 Jul 30 21:34:24.072706 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2856/5766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:23 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:25.010424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a41b6afe-f7cc-40ae-b0c0-b7d695dbe2a0 req-16f83cb4-0e7a-49ea-96ba-2840015cd413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "name": "network-vif-plugged", "status": "completed", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:25.025431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a41b6afe-f7cc-40ae-b0c0-b7d695dbe2a0 req-16f83cb4-0e7a-49ea-96ba-2840015cd413 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:25.026094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a41b6afe-f7cc-40ae-b0c0-b7d695dbe2a0 req-16f83cb4-0e7a-49ea-96ba-2840015cd413 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:25.040895 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a41b6afe-f7cc-40ae-b0c0-b7d695dbe2a0 req-16f83cb4-0e7a-49ea-96ba-2840015cd413 service nova] Creating event network-vif-plugged:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch1-master-1 Jul 30 21:34:25.046680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a41b6afe-f7cc-40ae-b0c0-b7d695dbe2a0 req-16f83cb4-0e7a-49ea-96ba-2840015cd413 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039923 Jul 30 21:34:25.047366 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2911/5767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:34:25.093480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:25.094323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:25.107122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:25.107902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:25.108948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:25.109677 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:25.272451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:25.282169 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a9dc8d55-bcce-4b71-8456-256468b9ee50 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.192956 Jul 30 21:34:25.282773 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2857/5768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:25 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:26.304689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:26.305431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:26.312004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:26.312477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:26.313263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:26.313738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:26.471113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:26.479096 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-65548a96-4a67-4285-9493-13e50398390f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1391 microversion: 2.1 time: 0.179525 Jul 30 21:34:26.479710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2912/5769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:26 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:27.500785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:27.501410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:27.504195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.504862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.511022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:27.511527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:27.512320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:27.512811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:27.658209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:27.666309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-41513fda-326b-4cb7-8765-20c1f89888e9 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1563 microversion: 2.1 time: 0.169682 Jul 30 21:34:27.666887 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2858/5770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:27 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:27.686465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:27.687094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:27.689187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.697176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:27.697642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:27.698640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:27.699124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:27.839260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:27.848557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f6814bb-d360-4e81-8f36-64fa78eca429 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1563 microversion: 2.1 time: 0.165844 Jul 30 21:34:27.849129 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2913/5771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:27 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:30.140102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d068162e-8c6f-4a81-8bd1-a4bd09faff13 req-1499baf6-acec-42cf-b7f2-97e988683359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:30.142636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:34:30.142636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:30.152946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:30.153530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:30.154448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:30.155002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:30.167655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d068162e-8c6f-4a81-8bd1-a4bd09faff13 req-1499baf6-acec-42cf-b7f2-97e988683359 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:30.168575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d068162e-8c6f-4a81-8bd1-a4bd09faff13 req-1499baf6-acec-42cf-b7f2-97e988683359 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:30.194411 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d068162e-8c6f-4a81-8bd1-a4bd09faff13 req-1499baf6-acec-42cf-b7f2-97e988683359 service nova] Creating event network-changed:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch1-master-1 Jul 30 21:34:30.206511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d068162e-8c6f-4a81-8bd1-a4bd09faff13 req-1499baf6-acec-42cf-b7f2-97e988683359 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069952 Jul 30 21:34:30.208881 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2914/5772] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:34:30.380182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:34:30.389672 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e8cab92-00ad-41fa-aaef-be07031fa94b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1563 microversion: 2.1 time: 0.254435 Jul 30 21:34:30.398360 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2859/5773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:34:30 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:34:49.705801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:34:49.708132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:34:49.710528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:49.711205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=34 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:49.717376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:49.717866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:49.718666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:34:49.719125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:34:49.774154 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ae8d1b0-9ffa-4386-bfb4-882fd929fb9c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action" status: 200 len: 24566 microversion: 2.1 time: 0.072729 Jul 30 21:34:49.775010 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2915/5774] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:34:49 2022] POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:35:00.085134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:00.085646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:00.088181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:00.088993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=23 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:00.095692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:00.096347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:00.097208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:00.097731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:00.181957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lazy-loading 'services' on Instance uuid 2eb28c4e-4df4-4880-ba3f-dacb40590476 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:35:00.255863 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476/os-volume_attachments/629d4006-7b40-4644-8678-fd6e4b6063f7" status: 202 len: 0 microversion: 2.1 time: 0.174908 Jul 30 21:35:00.256479 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2860/5775] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 21:35:00 2022] DELETE /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476/os-volume_attachments/629d4006-7b40-4644-8678-fd6e4b6063f7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:35:00.846682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:00.847433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:00.850560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:00.851250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:00.865542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:00.866022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:00.866885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:00.867359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.372622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:01.382237 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d08a5ec-a6c9-44da-965e-20b04b6ac152 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1682 microversion: 2.1 time: 0.540386 Jul 30 21:35:01.388892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:01.389530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:01.392751 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2916/5776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:00 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1682 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:01.398218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.398701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.399533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.400259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.429086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:35:01.481293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:01.485644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:01.497792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.499467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.501029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.501855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.525585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ca425c8-4eb8-45f6-be36-b0e8592a4a51 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 204 len: 0 microversion: 2.1 time: 0.140242 Jul 30 21:35:01.526316 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2861/5777] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:35:01 2022] DELETE /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:35:01.536341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:01.537443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:01.543931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.544599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.546150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.546694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.559862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c2a6bfff-5cbc-4753-aeee-e272ee7ab09e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action" status: 200 len: 32644 microversion: 2.1 time: 0.083076 Jul 30 21:35:01.560906 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2917/5778] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:35:01 2022] POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action => generated 32644 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:35:01.746854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:01.747677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:01.756052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.756527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.757315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.757769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.789384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:01.797834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27e60617-c2e4-42f3-9f89-222cf000735f tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1513 microversion: 2.1 time: 0.266891 Jul 30 21:35:01.798425 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2862/5779] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:01 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:01.898109 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-710fcd88-07f0-43fa-ae69-d18b3d9c83e5 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1833 microversion: 2.1 time: 0.155644 Jul 30 21:35:01.898999 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2918/5780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:01 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1833 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:01.926336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:01.928978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:01.935146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.935753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.936619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:01.937136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:01.964807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lazy-loading 'flavor' on Instance uuid b8b16962-1b87-40aa-abd1-e1d6af6d0a71 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:35:01.980886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Going to try to live migrate instance to another host {{(pid=130983) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 30 21:35:02.818479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:02.819127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:02.825698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:02.826167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:02.827627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:02.828089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:02.984658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:02.995499 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7fa4ef8-4058-4b1f-8963-2f01d653cc2b tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1513 microversion: 2.1 time: 0.181309 Jul 30 21:35:02.996458 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2919/5781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:02 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:35:03.602352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-40dab2ea-101a-4214-9fa8-c34de31c3acb req-c2377d9a-9e19-4d36-964f-40fb6cf7e373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb28c4e-4df4-4880-ba3f-dacb40590476", "name": "network-vif-deleted", "tag": "590a91d9-f553-4e79-b756-03d29a8f902a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:03.620936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-40dab2ea-101a-4214-9fa8-c34de31c3acb req-c2377d9a-9e19-4d36-964f-40fb6cf7e373 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:03.622513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-40dab2ea-101a-4214-9fa8-c34de31c3acb req-c2377d9a-9e19-4d36-964f-40fb6cf7e373 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:03.643035 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-40dab2ea-101a-4214-9fa8-c34de31c3acb req-c2377d9a-9e19-4d36-964f-40fb6cf7e373 service nova] Creating event network-vif-deleted:590a91d9-f553-4e79-b756-03d29a8f902a for instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 on nch2-master-1 Jul 30 21:35:03.651217 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-40dab2ea-101a-4214-9fa8-c34de31c3acb req-c2377d9a-9e19-4d36-964f-40fb6cf7e373 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061555 Jul 30 21:35:03.667860 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2920/5782] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:03.809584 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ade1d09-a368-4685-a418-1843d20fad26 tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action" status: 202 len: 0 microversion: 2.1 time: 1.886473 Jul 30 21:35:03.810684 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2863/5783] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:35:01 2022] POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action => generated 0 bytes in 1889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:35:03.828390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:03.829648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:03.837272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:03.838213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:03.839136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:03.839857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:04.029480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:04.030645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:04.036688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:04.046718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:04.048345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2d5c415-ec71-4dae-a830-cd154e5aadb2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.231704 Jul 30 21:35:04.048914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:04.049774 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2921/5784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:03 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:04.052002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:04.053615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:04.104730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:04.105217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:04.105687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lazy-loading 'fault' on Instance uuid 2eb28c4e-4df4-4880-ba3f-dacb40590476 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:35:04.183231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937935818cda4a6e8b9104d38aa3a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86550d66e9144788967e5b514cda82d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:04.196882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c580970-06ef-43c0-a4ec-54ed19f49ea3 tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 200 len: 1308 microversion: 2.1 time: 0.177786 Jul 30 21:35:04.207899 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2864/5785] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:04 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:05.074702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:05.076008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:05.086159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:05.086905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:05.088053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:05.088532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:05.225219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:05.226023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] [instance: 2eb28c4e-4df4-4880-ba3f-dacb40590476] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:05.233326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:05.234055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:05.235021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:05.235855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:05.252890 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] HTTP exception thrown: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Request method failure captured: Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 HTTP/1.1 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aL-OThEpElvAAlXvxRFiNHmkktY5PIDqACSo-XzXurzw9dH-o6jsmnjLMpxjIy2NQynzABAgK3DjKlRu4Tvo9Jea2olz2n4aqRrRpmm90teePu3_YsBh6L3BSQLVrtH8N6ABG8t4Y-536mK3Kk45dK83GXOR1V4yswQ64oa7xqvrZE Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 86550d66e9144788967e5b514cda82d7 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86550d66e9144788967e5b514cda82d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86550d66e9144788967e5b514cda82d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86550d66e9144788967e5b514cda82d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86550d66e9144788967e5b514cda82d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 86550d66e9144788967e5b514cda82d7 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1137680000 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-VolumesSnapshotTestJSON-1137680000-project Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 937935818cda4a6e8b9104d38aa3a8b1 Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-VolumesSnapshotTestJSON-1137680000-project Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '2eb28c4e-4df4-4880-ba3f-dacb40590476'} Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:35:05.254591 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] Returning 404 to user: Instance 2eb28c4e-4df4-4880-ba3f-dacb40590476 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0468ece-9cbd-4884-8dc0-73747abe38ce tempest-VolumesSnapshotTestJSON-1137680000 tempest-VolumesSnapshotTestJSON-1137680000-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476" status: 404 len: 111 microversion: 2.1 time: 0.034970 Jul 30 21:35:05.259480 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2865/5786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:05 2022] GET /compute/v2.1/servers/2eb28c4e-4df4-4880-ba3f-dacb40590476 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:35:05.335549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:05.352239 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8409c5fe-de2f-425d-8df2-5aba9783ebf3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.281841 Jul 30 21:35:05.354714 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2922/5787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:05 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:05.684855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "name": "network-vif-unplugged", "status": "completed", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}, {"name": "network-changed", "server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:05.696022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:05.696854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:05.710357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] Creating event network-vif-unplugged:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch1-master-1 Jul 30 21:35:05.711222 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] Creating event network-changed:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch1-master-1 Jul 30 21:35:05.717941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c6e3c5ee-b618-484c-b6b2-2604cb364b6d req-0ac4d6fd-78dc-4ce3-9a7e-1298e3c913ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036775 Jul 30 21:35:05.718901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2866/5788] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:06.374582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:06.375641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:06.383309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:06.384071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:06.385096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:06.385787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:06.657117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:06.666836 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-181b32dd-6c82-475a-a886-0c04ca69e6cb tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.296428 Jul 30 21:35:06.668152 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2923/5789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:06 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:07.691557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:07.692362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:07.700384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:07.701708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:07.702582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:07.703039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:08.046342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:08.054721 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e2653235-a89c-4723-b6cc-deefee32236e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.369191 Jul 30 21:35:08.055338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2867/5790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:07 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:09.077768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:09.078521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:09.085655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:09.086128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:09.086963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:09.087455 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:09.227796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:09.237936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-583d8615-2d37-47b5-84a1-f8d171bccd9d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.164597 Jul 30 21:35:09.240682 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2924/5791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:09 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:10.275217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:10.276041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:10.284125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:10.284725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:10.285702 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:10.286260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:10.470357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:10.482476 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77eb2a45-faa5-4ef3-bc6f-3e5a4551f82e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.211228 Jul 30 21:35:10.483059 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2868/5792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:10 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:11.507837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:11.509291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:11.517499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:11.518292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:11.519279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:11.519950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:11.910280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:11.925103 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4cdb910c-e064-417b-a628-ce847b87bdcd tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.422440 Jul 30 21:35:11.927399 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2925/5793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:11 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:12.952168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:12.952980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:12.962177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:12.963072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:12.964002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:12.964580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:13.511038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:13.521155 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5648c0ae-8756-4247-a69d-cc9e466bfe28 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1692 microversion: 2.1 time: 0.574595 Jul 30 21:35:13.522238 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2869/5794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:12 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1692 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:14.543996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:14.545318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:14.552683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.553094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:14.553899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.554398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:14.688471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:14.696324 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f01197ee-40ce-46cf-a650-3dda86c73441 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1682 microversion: 2.1 time: 0.156254 Jul 30 21:35:14.696988 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2926/5795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:14 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:14.719390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:14.719933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:14.727877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.728351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:14.729171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.729630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:14.946250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2ec3cfd8-4854-4eb3-b45b-03ea1458322f tempest-TestNetworkAdvancedServerOps-2128872099 tempest-TestNetworkAdvancedServerOps-2128872099-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1833 microversion: 2.1 time: 0.232505 Jul 30 21:35:14.951576 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2870/5796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:14 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1833 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:14.985836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:14.986491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:14.993663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.994140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:14.995735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:14.996438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:15.145821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:15.154933 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1e409fb-cc8b-433f-aca7-1aefad58a31f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1682 microversion: 2.1 time: 0.172702 Jul 30 21:35:15.156262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2927/5797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:14 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:17.293390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:17.296959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:17.304812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:17.305313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:17.306106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:17.306553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:17.363664 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6510de1d-ec3b-4979-9b36-305e08acd7a3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action" status: 200 len: 38619 microversion: 2.1 time: 0.074893 Jul 30 21:35:17.364729 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2871/5798] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:35:17 2022] POST /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71/action => generated 38619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:35:18.936547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:18.937285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:18.941805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e21bb9fd-73df-4d24-b4a2-2186b16eea91 req-3c250f06-ae90-4801-8b13-226c4b49765e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:18.945197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:18.945682 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:18.946807 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:18.947537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:18.953910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e21bb9fd-73df-4d24-b4a2-2186b16eea91 req-3c250f06-ae90-4801-8b13-226c4b49765e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:18.954606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e21bb9fd-73df-4d24-b4a2-2186b16eea91 req-3c250f06-ae90-4801-8b13-226c4b49765e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:18.967703 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e21bb9fd-73df-4d24-b4a2-2186b16eea91 req-3c250f06-ae90-4801-8b13-226c4b49765e service nova] Creating event network-changed:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch2-master-1 Jul 30 21:35:18.974360 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e21bb9fd-73df-4d24-b4a2-2186b16eea91 req-3c250f06-ae90-4801-8b13-226c4b49765e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036174 Jul 30 21:35:18.975630 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2872/5799] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:35:18.987862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:35:19.114982 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87871e34-affa-4ac5-b3c3-67a87f6545e0 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 204 len: 0 microversion: 2.1 time: 0.180288 Jul 30 21:35:19.119656 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2928/5800] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:35:18 2022] DELETE /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:35:19.131913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:19.132694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:19.144556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:19.145144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:19.146207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:19.146773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:19.326949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:19.335117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7a8aa3b5-59e1-4709-9e60-9588cb29743b tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1688 microversion: 2.1 time: 0.210268 Jul 30 21:35:19.335813 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2873/5801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:19 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:20.379148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:20.379941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:20.397840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:20.398319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:20.399130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:20.399649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:20.488020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:20.496241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-42db7c11-d929-4456-af0e-6a4c67bf2ad1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 200 len: 1501 microversion: 2.1 time: 0.140615 Jul 30 21:35:20.505581 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2929/5802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:20 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:20.991241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-438f1e62-07e6-4827-b13c-3b70a413ae93 req-2992d8ea-d59b-4c96-87c1-8c44331237ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b16962-1b87-40aa-abd1-e1d6af6d0a71", "name": "network-vif-deleted", "tag": "23b16db5-66bb-43f8-be78-d843ba1fd9c9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:21.005496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-438f1e62-07e6-4827-b13c-3b70a413ae93 req-2992d8ea-d59b-4c96-87c1-8c44331237ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:21.006208 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-438f1e62-07e6-4827-b13c-3b70a413ae93 req-2992d8ea-d59b-4c96-87c1-8c44331237ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:21.046623 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-438f1e62-07e6-4827-b13c-3b70a413ae93 req-2992d8ea-d59b-4c96-87c1-8c44331237ee service nova] Creating event network-vif-deleted:23b16db5-66bb-43f8-be78-d843ba1fd9c9 for instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 on nch2-master-1 Jul 30 21:35:21.053208 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-438f1e62-07e6-4827-b13c-3b70a413ae93 req-2992d8ea-d59b-4c96-87c1-8c44331237ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065701 Jul 30 21:35:21.054045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2874/5803] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:21.519762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:21.520404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: b8b16962-1b87-40aa-abd1-e1d6af6d0a71] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:21.527567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:21.528039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:21.528831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:21.529283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:21.543522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] HTTP exception thrown: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Request method failure captured: Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 HTTP/1.1 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aKp90dBlJxMh9WaS3Gkq8gfM6d3-8CW3esqUHxEuCANA_gqkiFmN_HnVJHO6yowKHncdygk0zqfSahCnQ0Jc7c0nZC3rQBEysFKa_cSm1_zBYPdjJVetekWVSZ7A9FqS6XppBVFwcCGkdqB6qkkULx-peDevL2cETeLnN9aiv-ImQs Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4a16baf2cd6043c79dbe21fafc13eb28", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 9f113fc80feb42148c3dad0c33417dfe Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b8b16962-1b87-40aa-abd1-e1d6af6d0a71'} Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:35:21.545459 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Returning 404 to user: Instance b8b16962-1b87-40aa-abd1-e1d6af6d0a71 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bf62843c-ef3e-492e-8e3e-4a55ddea9e9a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71" status: 404 len: 111 microversion: 2.1 time: 0.031083 Jul 30 21:35:21.555589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2930/5804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:21 2022] GET /compute/v2.1/servers/b8b16962-1b87-40aa-abd1-e1d6af6d0a71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:35:25.270689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-88e5102f-3f6e-452b-b929-2d303e376584 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '.version_select at 0x7fbb4fce7f70>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:25.299314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-88e5102f-3f6e-452b-b929-2d303e376584 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983072193" status: 202 len: 0 microversion: 2.1 time: 0.032419 Jul 30 21:35:25.300132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2875/5805] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Jul 30 21:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983072193 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:35:25.333155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-edbf82b7-bf78-4d92-a9a3-80d6952ea8cc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: .version_select at 0x7fbb5c655430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1706468018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO2NZ1tTEg5JEOyG9HgDdAc5Yqp1JL5uUNqHwrlIugGHEshee7re+rTLo1b/G7CFJqhMLuJX4tXSd85ZTxZEGnIIIgBav4P7cuppHk3S7oNoPnyxvIA0dz13WUjRobZhA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:25.354414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-edbf82b7-bf78-4d92-a9a3-80d6952ea8cc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:35:25.365383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-edbf82b7-bf78-4d92-a9a3-80d6952ea8cc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:35:25.394624 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-edbf82b7-bf78-4d92-a9a3-80d6952ea8cc tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066153 Jul 30 21:35:25.401455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2931/5806] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:35:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:34.466963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-304365440", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "56a071d5-76db-490a-b9dd-98584efb6c3b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1706468018", "security_groups": [{"name": "tempest-secgroup-smoke-1585214146"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:34.484598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:34.485569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:34.628710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] validate_networks() for [('56a071d5-76db-490a-b9dd-98584efb6c3b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:35:36.236062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:35:36.244865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:35:36.245584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:35:36.246124 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:35:36.246673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:35:36.268748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:36.269323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:36.271635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:36.276263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:36.318957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:35:36.328569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Getting quotas for user 9f113fc80feb42148c3dad0c33417dfe and project 4a16baf2cd6043c79dbe21fafc13eb28. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:35:36.343474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:35:36.346210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:35:36.419541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1db40efc-c185-4a98-ab7d-523f3015282d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.962053 Jul 30 21:35:36.426106 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2876/5807] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:35:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:35:36.433684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a31f8119-49bb-4ee6-8141-d00113d0ad77 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:36.435002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a31f8119-49bb-4ee6-8141-d00113d0ad77 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:36.438476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:36.439610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:36.441876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:36.530278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a31f8119-49bb-4ee6-8141-d00113d0ad77 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:36.541484 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a31f8119-49bb-4ee6-8141-d00113d0ad77 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1266 microversion: 2.1 time: 0.112830 Jul 30 21:35:36.542546 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2932/5808] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:36 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:35:37.562908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:37.563843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:37.572754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:37.574179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:37.576175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:37.576925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:37.725894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:37.742650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebe51850-b1e1-4cd2-a9c6-b116b6785366 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1318 microversion: 2.1 time: 0.182298 Jul 30 21:35:37.752275 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2877/5809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:37 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:38.780729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:38.781365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:38.791150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:38.791909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:38.793158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:38.793918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:39.102553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:39.114850 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-099db880-1f86-4adb-af2c-3fbc18f389a5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1324 microversion: 2.1 time: 0.336946 Jul 30 21:35:39.116716 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2933/5810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:38 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:40.139583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:40.140811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:40.148984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:40.149777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:40.154696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:40.155769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:41.136001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:41.146562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d64047f3-c542-44f4-8b2b-948bfe8eb4db tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 1.012364 Jul 30 21:35:41.148199 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2878/5811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:40 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:41.228303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2b510a5b-5ccf-492a-a813-4d475c97a0e5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: .version_select at 0x7fbb4fe2da60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-155214344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECx6q/CmZ5ykqKR5trH9wJULqiQZZ3x2IM9pLbm/T+2MpCNUuEQxt+xHVtuvBsxIA4BG8RJgu/lIlJPzJlPkOyvRDRe8da5mwOUmOBNCCp7KHd3CljrxZChdyVU8etPLg=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:41.249982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2b510a5b-5ccf-492a-a813-4d475c97a0e5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:35:41.259323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-2b510a5b-5ccf-492a-a813-4d475c97a0e5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:35:41.278572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1b12dbd3-811c-4973-b9ea-265803a7a68c req-169572cb-6d51-4d39-b514-5fa86d5b5fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:41.310603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1b12dbd3-811c-4973-b9ea-265803a7a68c req-169572cb-6d51-4d39-b514-5fa86d5b5fad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:41.311069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1b12dbd3-811c-4973-b9ea-265803a7a68c req-169572cb-6d51-4d39-b514-5fa86d5b5fad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:41.330528 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2b510a5b-5ccf-492a-a813-4d475c97a0e5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.106240 Jul 30 21:35:41.337115 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2934/5812] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:35:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:41.347255 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1b12dbd3-811c-4973-b9ea-265803a7a68c req-169572cb-6d51-4d39-b514-5fa86d5b5fad service nova] Creating event network-changed:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:35:41.367018 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1b12dbd3-811c-4973-b9ea-265803a7a68c req-169572cb-6d51-4d39-b514-5fa86d5b5fad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093066 Jul 30 21:35:41.368237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2879/5813] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:42.175806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:42.176607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:42.191509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:42.192452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:42.196041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:42.196537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:42.410657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:42.433013 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc1f9b73-3a73-4787-bcf7-61d9421a9175 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.266004 Jul 30 21:35:42.433785 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2935/5814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:42 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:43.064878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-698102891", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "81cf7f7b-ec12-471f-871d-a0c183c5c3a7"}], "key_name": "tempest-TestNetworkBasicOps-155214344", "security_groups": [{"name": "tempest-secgroup-smoke-1886974558"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:43.206545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] validate_networks() for [('81cf7f7b-ec12-471f-871d-a0c183c5c3a7', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:35:43.457982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:43.458811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:43.467037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:43.467830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:43.469610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:43.470362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:43.699403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:43.708938 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f50480e2-18db-4dea-aff3-1f3992858a53 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.257995 Jul 30 21:35:43.713078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:35:43.713519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:35:43.714011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:35:43.714438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:35:43.714866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:35:43.726539 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2936/5815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:43 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:43.730106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:43.730640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:43.732278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:43.732806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:43.754531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:35:43.760408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:35:43.774383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:35:43.777109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:35:43.830016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6495e2f4-3926-415e-9671-4f32ff8a2cd5 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771557 Jul 30 21:35:43.830920 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2880/5816] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:35:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:35:43.845135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e569db03-01e0-45a6-9c0b-c3274ef32010 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:43.845838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e569db03-01e0-45a6-9c0b-c3274ef32010 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:43.954385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e569db03-01e0-45a6-9c0b-c3274ef32010 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:43.961709 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e569db03-01e0-45a6-9c0b-c3274ef32010 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1247 microversion: 2.1 time: 0.121321 Jul 30 21:35:43.962839 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2937/5817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:43 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1247 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:44.730721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:44.731444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:44.738971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:44.739547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:44.740414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:44.740942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:44.906109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:44.913915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f0e7998c-15d6-4511-9516-4ce9697c4d7a tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.188067 Jul 30 21:35:44.914510 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2881/5818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:44 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:44.986267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:44.986911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:44.995191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:44.995698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:44.996566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:44.997534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:45.074522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:45.083002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ea4f018-4875-4ac6-95ae-7c31b3660a1c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1307 microversion: 2.1 time: 0.101750 Jul 30 21:35:45.083889 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2938/5819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:44 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:45.936252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:45.937046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:45.945777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:45.946250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:45.947049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:45.947537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:46.106670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:46.115194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:46.124953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:46.125719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:46.126870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:46.128039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:46.212918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:46.226954 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31f788d4-8787-45b3-a65b-52531f7b2cf5 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.293038 Jul 30 21:35:46.244620 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2882/5820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:45 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:46.322799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:46.331518 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00ce4034-24e7-4b95-abcd-4069d0a0b73c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.230180 Jul 30 21:35:46.332449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2939/5821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:46 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:35:47.032952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2b0aab4b-6480-4342-bc5c-da27f3a118b6 req-897480c5-ce76-4934-bcaf-16eae57675ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9f957b-fcb3-4e45-bcc6-194e79e31f34", "tag": "b8849011-2341-430b-b0f5-2bc3ee44e72b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:47.044381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2b0aab4b-6480-4342-bc5c-da27f3a118b6 req-897480c5-ce76-4934-bcaf-16eae57675ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.044836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2b0aab4b-6480-4342-bc5c-da27f3a118b6 req-897480c5-ce76-4934-bcaf-16eae57675ad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.060573 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2b0aab4b-6480-4342-bc5c-da27f3a118b6 req-897480c5-ce76-4934-bcaf-16eae57675ad service nova] Creating event network-changed:b8849011-2341-430b-b0f5-2bc3ee44e72b for instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 on nch2-master-1 Jul 30 21:35:47.067121 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2b0aab4b-6480-4342-bc5c-da27f3a118b6 req-897480c5-ce76-4934-bcaf-16eae57675ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037951 Jul 30 21:35:47.067772 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2883/5822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:47.253391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:47.254642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:47.262705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.263523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.265518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.266177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.357736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:47.358881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:47.375517 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.378298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.380654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.381204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.455743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:47.464234 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26c02ad6-ed6b-45ba-839a-8271d8b32176 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.214885 Jul 30 21:35:47.466018 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2940/5823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:47 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:47.495113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fc021423-6e88-4329-9ba5-292dbd59ebe7 req-ab600f10-74a8-4ee5-967f-4a9808630d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "name": "network-vif-plugged", "status": "completed", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:47.512833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fc021423-6e88-4329-9ba5-292dbd59ebe7 req-ab600f10-74a8-4ee5-967f-4a9808630d85 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:47.513915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fc021423-6e88-4329-9ba5-292dbd59ebe7 req-ab600f10-74a8-4ee5-967f-4a9808630d85 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:47.543962 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fc021423-6e88-4329-9ba5-292dbd59ebe7 req-ab600f10-74a8-4ee5-967f-4a9808630d85 service nova] Creating event network-vif-plugged:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:35:47.551564 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fc021423-6e88-4329-9ba5-292dbd59ebe7 req-ab600f10-74a8-4ee5-967f-4a9808630d85 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059806 Jul 30 21:35:47.552487 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2941/5824] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:35:47.653054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:47.666613 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b12c2f9-19a0-45cb-a2cd-a5773da07cf9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.315943 Jul 30 21:35:47.667273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2884/5825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:47 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:48.487213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:48.488694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:48.496148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:48.496657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:48.497441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:48.497890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:48.658530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:48.668698 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3da9bba-e436-4b62-9c9a-4907394ae1e8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1392 microversion: 2.1 time: 0.186824 Jul 30 21:35:48.669380 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2942/5826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:48 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:48.687913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:48.688811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:48.696013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:48.696484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:48.697510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:48.698108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:48.948018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:48.956904 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b3e5ac41-0e7a-43f6-b01c-42541992491c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.272909 Jul 30 21:35:48.957491 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2885/5827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:48 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:49.690671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:49.691611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:49.698598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.699081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:49.700087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.700549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:49.849729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:49.858105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b5ea3c42-73ab-4b46-ae0c-85e3969c0ae3 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1564 microversion: 2.1 time: 0.171297 Jul 30 21:35:49.859339 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2943/5828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:49 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:49.881173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:49.881809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:49.888978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.889444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:49.890445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.891080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:49.978292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:49.979079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:49.986110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.986780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:49.987734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:49.988326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:50.044265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:50.052781 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ec8bf78-c0ed-4d8e-bcdb-4e750923819d tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1564 microversion: 2.1 time: 0.175734 Jul 30 21:35:50.053671 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2886/5829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:49 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:35:50.144762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:50.153340 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cae7310-ae42-4359-9c78-01d19bc406e4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.178622 Jul 30 21:35:50.154197 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2944/5830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:49 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:51.176085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:51.176845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:51.185442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:51.186064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:51.186884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:51.187370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:51.424382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:51.444906 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0a284e1-db47-4df8-b658-e7f7db1e36a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.264688 Jul 30 21:35:51.452508 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2887/5831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:51 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:52.003232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:52.005958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0a7b6236-406b-4f88-ba48-b60b059be846 req-ac907987-07d1-41c6-bf72-aa7292427339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:52.007079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:52.022453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:52.023254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:52.026085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:52.026627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:52.033561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0a7b6236-406b-4f88-ba48-b60b059be846 req-ac907987-07d1-41c6-bf72-aa7292427339 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:52.034232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0a7b6236-406b-4f88-ba48-b60b059be846 req-ac907987-07d1-41c6-bf72-aa7292427339 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:52.048674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0a7b6236-406b-4f88-ba48-b60b059be846 req-ac907987-07d1-41c6-bf72-aa7292427339 service nova] Creating event network-changed:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:35:52.054822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0a7b6236-406b-4f88-ba48-b60b059be846 req-ac907987-07d1-41c6-bf72-aa7292427339 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058016 Jul 30 21:35:52.055881 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2888/5832] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:35:52.299325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:52.307584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb3fd12f-0e47-4245-853f-9224908a4378 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1564 microversion: 2.1 time: 0.316857 Jul 30 21:35:52.308541 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2945/5833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:51 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1564 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:52.467685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:52.469069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:52.475726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:52.476523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:52.477483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:52.478096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:52.623728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:52.633505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1a663af-cec9-4ed4-8efe-16a89b48454f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.171088 Jul 30 21:35:52.644069 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2889/5834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:52 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:53.654977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:53.655713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:53.663472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:53.663949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:53.664744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:53.665198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:53.804775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:53.814621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2399993c-2c8a-42e0-9f2c-cc1e48e580b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.163548 Jul 30 21:35:53.815436 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2946/5835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:53 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:53.953053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-94098fbc-99a4-4f44-9fce-93098e6968ff req-802afd2a-ae3e-41ee-be85-e62797836fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f957b-fcb3-4e45-bcc6-194e79e31f34", "name": "network-vif-plugged", "status": "completed", "tag": "b8849011-2341-430b-b0f5-2bc3ee44e72b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:53.959929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:53.960609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:53.965146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-94098fbc-99a4-4f44-9fce-93098e6968ff req-802afd2a-ae3e-41ee-be85-e62797836fa1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:53.965606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-94098fbc-99a4-4f44-9fce-93098e6968ff req-802afd2a-ae3e-41ee-be85-e62797836fa1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:53.977438 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-94098fbc-99a4-4f44-9fce-93098e6968ff req-802afd2a-ae3e-41ee-be85-e62797836fa1 service nova] Creating event network-vif-plugged:b8849011-2341-430b-b0f5-2bc3ee44e72b for instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 on nch2-master-1 Jul 30 21:35:53.984287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-94098fbc-99a4-4f44-9fce-93098e6968ff req-802afd2a-ae3e-41ee-be85-e62797836fa1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Jul 30 21:35:53.985706 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2890/5836] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:35:54.836575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:54.837159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:54.839184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:54.846319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:54.846791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:54.847618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:54.848095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:54.992871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:55.002249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e8562058-9064-4a93-8cb7-12affc860773 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1373 microversion: 2.1 time: 0.169785 Jul 30 21:35:55.002843 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2947/5837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:54 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:56.024960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:56.025675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:56.032917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:56.033495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:56.034398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:56.034928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:56.181465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:56.189329 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2e2b0b26-bbd3-493b-95c1-2e6f3e70cfd3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1545 microversion: 2.1 time: 0.169613 Jul 30 21:35:56.189922 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2891/5838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:56 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1545 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:56.210233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:35:56.210908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:35:56.218698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:56.219172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:56.220100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:56.220595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:56.354821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:35:56.364228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-43274317-d6f3-48ba-9b95-035726b73530 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1545 microversion: 2.1 time: 0.158077 Jul 30 21:35:56.364752 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2948/5839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:35:56 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:35:58.363589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6276a3a4-4c74-47b5-b64e-2edc89aaf8bd req-58ee0819-f6a5-4e77-aca0-509006ec9fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9f957b-fcb3-4e45-bcc6-194e79e31f34", "tag": "b8849011-2341-430b-b0f5-2bc3ee44e72b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:35:58.385824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6276a3a4-4c74-47b5-b64e-2edc89aaf8bd req-58ee0819-f6a5-4e77-aca0-509006ec9fc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:35:58.386477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6276a3a4-4c74-47b5-b64e-2edc89aaf8bd req-58ee0819-f6a5-4e77-aca0-509006ec9fc3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:35:58.399705 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6276a3a4-4c74-47b5-b64e-2edc89aaf8bd req-58ee0819-f6a5-4e77-aca0-509006ec9fc3 service nova] Creating event network-changed:b8849011-2341-430b-b0f5-2bc3ee44e72b for instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 on nch2-master-1 Jul 30 21:35:58.415322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6276a3a4-4c74-47b5-b64e-2edc89aaf8bd req-58ee0819-f6a5-4e77-aca0-509006ec9fc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055238 Jul 30 21:35:58.415887 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2892/5840] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:36:13.561569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:13.563882 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:13.566930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:13.567635 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=80 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:13.574283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:13.574779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:13.575649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:13.576124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:13.626482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7eaa5ae-909a-46af-a003-da70b86da903 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action" status: 200 len: 24569 microversion: 2.1 time: 0.069483 Jul 30 21:36:13.627471 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2949/5841] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:36:13 2022] POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action => generated 24569 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:36:19.986282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:19.987047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=74 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:19.991363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:19.994184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:20.001915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.002387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.003192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.003687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.080781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:36:20.081859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:36:20.081986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:36:20.082804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:36:20.082804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:36:20.148433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:20.155865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.157770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.157770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.157770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.184402 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29d8f1e9-2c75-412c-9d71-45cfb6d13223 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action" status: 202 len: 1136 microversion: 2.1 time: 0.200270 Jul 30 21:36:20.197122 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2893/5842] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:36:19 2022] POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action => generated 1136 bytes in 203 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 30 21:36:20.204404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:20.206249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:20.214557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.215420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.217331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.217928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.359664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:20.367635 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e956ace1-a75b-48fb-948f-9630a153deb8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.168718 Jul 30 21:36:20.368211 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2950/5843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:20 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:20.671472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:20.673971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:20.680407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.680880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.681863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:20.682325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:20.739461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-06130194-a944-4bc3-96fa-c5fcfd525753 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34/action" status: 200 len: 24570 microversion: 2.1 time: 0.072551 Jul 30 21:36:20.740124 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2894/5844] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:36:20 2022] POST /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:36:21.389789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:21.390430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:21.398259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:21.398732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:21.399539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:21.399998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:21.537054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:21.545345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd724b12-2446-48a1-9bcc-9ce8457ce284 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.158871 Jul 30 21:36:21.545910 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2951/5845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:21 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:22.567769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:22.568493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:22.576154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:22.576628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:22.577419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:22.577877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:22.709349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:22.718102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72f40abb-4775-4da8-a790-42055b51139c tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.154643 Jul 30 21:36:22.718677 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2895/5846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:22 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:23.739479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:23.740106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:23.747170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:23.748155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:23.748933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:23.749645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:23.930517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:23.939069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f499561c-ccdb-41d1-a853-487ef7eb0b98 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.203779 Jul 30 21:36:23.939894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2952/5847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:23 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:36:24.963624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:24.964278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:24.972169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:24.972642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:24.973482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:24.973946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:25.115391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:25.123989 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5288cd7c-e2d6-41f4-90c3-ade35667b794 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.167387 Jul 30 21:36:25.124834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2896/5848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:24 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:26.150214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:26.151718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:26.165105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:26.165793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:26.166760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:26.167620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:26.330572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:26.338140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d639d4dd-4db3-43ed-86b7-b617d49e2404 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.196326 Jul 30 21:36:26.338713 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2953/5849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:26 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:27.367217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:27.367873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:27.376164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:27.376993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:27.378142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:27.378689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:27.801453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:27.810455 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-823c584f-b68c-4c8c-a797-43d191decc69 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.451442 Jul 30 21:36:27.811036 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2897/5850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:27 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:36:28.832133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:28.832783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:28.840461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:28.840942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:28.842249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:28.842814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:29.255094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:29.262884 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-956fa24c-173b-42fc-bd46-e05ce5c92f90 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.434896 Jul 30 21:36:29.263996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2954/5851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:28 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:30.285334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:30.285980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:30.293084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:30.293549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:30.294954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:30.295443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:30.426305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:30.433926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6986a1bf-b6c2-4063-8e65-891b0f8f18e2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.152477 Jul 30 21:36:30.434485 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2898/5852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:30 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:31.455598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:31.456256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:31.463462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:31.463933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:31.464722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:31.465177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:31.597294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:31.605021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5bd816b8-8274-4c99-ba71-1d12e4bc6d07 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1691 microversion: 2.1 time: 0.153495 Jul 30 21:36:31.605604 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2955/5853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:31 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:32.627523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:32.628149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:32.635283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:32.635853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:32.636636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:32.637086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:32.775198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:32.785582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e192eded-a00b-4e64-955e-50950e23a5d1 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1697 microversion: 2.1 time: 0.162164 Jul 30 21:36:32.786330 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2899/5854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:32 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:33.808511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:33.809151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:33.816738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:33.817114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:33.817919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:33.818374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:33.957751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:33.966495 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-417c78cc-74b2-44fe-927d-813521172fe8 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1697 microversion: 2.1 time: 0.161866 Jul 30 21:36:33.967199 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2956/5855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:33 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:34.989091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:34.989728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:34.997011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:34.997777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:34.998797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:34.999865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:35.134126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:35.142499 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7cb3b9dc-be03-4966-b160-c7e4a2928520 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1682 microversion: 2.1 time: 0.157398 Jul 30 21:36:35.143074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2900/5856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:34 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:35.730295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8afe7b07-4036-48fa-a55e-14dd096c540e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: .version_select at 0x7fbb4fe74430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1732114993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNiRyEUVOwksNRWyTchpTBX+0YgtYY4FYLl8MeQNxrNR3uc/h7MBIcNJWyJV5AZ4hnxwnUU/rb1wP9yviwO+asgl3KuvZGqFrCEecV4sKBGxR5S54F2D1yo+JjfOH1kBA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:35.747613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8afe7b07-4036-48fa-a55e-14dd096c540e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:36:35.754768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8afe7b07-4036-48fa-a55e-14dd096c540e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:36:35.787571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-295e1d61-b5b8-43b4-a6aa-b42bc998052e req-dfc93d6c-fe49-4e60-b165-fd516ebdbcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "name": "network-vif-unplugged", "status": "completed", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:35.788057 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8afe7b07-4036-48fa-a55e-14dd096c540e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.061912 Jul 30 21:36:35.790142 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2957/5857] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:36:35 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:36:35.812394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-295e1d61-b5b8-43b4-a6aa-b42bc998052e req-dfc93d6c-fe49-4e60-b165-fd516ebdbcc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:35.816249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-295e1d61-b5b8-43b4-a6aa-b42bc998052e req-dfc93d6c-fe49-4e60-b165-fd516ebdbcc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:35.851674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-295e1d61-b5b8-43b4-a6aa-b42bc998052e req-dfc93d6c-fe49-4e60-b165-fd516ebdbcc9 service nova] Creating event network-vif-unplugged:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:36:35.860800 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-295e1d61-b5b8-43b4-a6aa-b42bc998052e req-dfc93d6c-fe49-4e60-b165-fd516ebdbcc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079404 Jul 30 21:36:35.862659 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2901/5858] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:36:36.996032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-428830986", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "d346edb0-2add-4795-a59b-1d80e6e51ca3"}], "key_name": "tempest-TestNetworkBasicOps-1732114993", "security_groups": [{"name": "tempest-secgroup-smoke-457113500"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:37.136430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] validate_networks() for [('d346edb0-2add-4795-a59b-1d80e6e51ca3', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:36:37.604048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:36:37.604048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:36:37.604048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:36:37.604048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:36:37.604048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:36:37.613419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:37.613885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:37.614805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:37.615261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:37.633973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:36:37.639492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:36:37.651997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:36:37.654826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:36:37.705326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba8150c9-8bd9-4184-a2b1-9376179c027c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714098 Jul 30 21:36:37.712377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2958/5859] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:36:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:36:37.730651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f409fd2c-3f83-4052-8d2c-3b82539413c3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:37.731476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f409fd2c-3f83-4052-8d2c-3b82539413c3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:37.798451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f409fd2c-3f83-4052-8d2c-3b82539413c3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:37.806525 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f409fd2c-3f83-4052-8d2c-3b82539413c3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1248 microversion: 2.1 time: 0.091200 Jul 30 21:36:37.807109 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2902/5860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:37 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:37.973608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d29a44b3-1354-4e3d-bebf-f53ad7699eaa req-19c02f75-0229-4b19-817f-4ff4db49e33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "name": "network-vif-plugged", "status": "completed", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:37.989283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d29a44b3-1354-4e3d-bebf-f53ad7699eaa req-19c02f75-0229-4b19-817f-4ff4db49e33d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:37.989894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d29a44b3-1354-4e3d-bebf-f53ad7699eaa req-19c02f75-0229-4b19-817f-4ff4db49e33d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:38.006207 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d29a44b3-1354-4e3d-bebf-f53ad7699eaa req-19c02f75-0229-4b19-817f-4ff4db49e33d service nova] Creating event network-vif-plugged:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:36:38.025051 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d29a44b3-1354-4e3d-bebf-f53ad7699eaa req-19c02f75-0229-4b19-817f-4ff4db49e33d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055462 Jul 30 21:36:38.025791 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2959/5861] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:36:38.829736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:38.831104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:38.838646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:38.839802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:38.840755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:38.841566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:38.914735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:38.924747 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09782d0b-50e3-48f7-a45c-1b00ecc91c77 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1318 microversion: 2.1 time: 0.100840 Jul 30 21:36:38.925341 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2903/5862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:38 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:39.950827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:39.952190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:39.961593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:39.962072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:39.962879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:39.963450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:40.114876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:40.123454 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-856f53f4-8044-4db5-8af7-c1908f6c3920 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.180481 Jul 30 21:36:40.124041 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2960/5863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:39 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:40.316064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bc221353-16bc-4c98-9022-f3419361d2d1 req-1ddd610a-4976-409a-93d4-a6fac732b1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4954e9a3-7b91-442f-a685-26ae5e61fd4c", "tag": "fa41aac6-c6e7-4d10-8c26-7ea3a8829205"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:40.332939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bc221353-16bc-4c98-9022-f3419361d2d1 req-1ddd610a-4976-409a-93d4-a6fac732b1ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:40.333503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bc221353-16bc-4c98-9022-f3419361d2d1 req-1ddd610a-4976-409a-93d4-a6fac732b1ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:40.348285 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bc221353-16bc-4c98-9022-f3419361d2d1 req-1ddd610a-4976-409a-93d4-a6fac732b1ef service nova] Creating event network-changed:fa41aac6-c6e7-4d10-8c26-7ea3a8829205 for instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c on nch2-master-1 Jul 30 21:36:40.353918 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bc221353-16bc-4c98-9022-f3419361d2d1 req-1ddd610a-4976-409a-93d4-a6fac732b1ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175215 Jul 30 21:36:40.354528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2904/5864] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:36:41.145429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:41.146103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:41.153203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:41.153675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:41.155096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:41.155582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:41.287949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:41.295597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1eead355-4a17-4f5b-9408-550e8b7c3140 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.154130 Jul 30 21:36:41.296177 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2961/5865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:41 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:36:42.318022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:42.318846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:42.325398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:42.326340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:42.327545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:42.328079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:42.476731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:42.485322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31973526-bc0c-4879-9057-64df6fabbad7 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.172599 Jul 30 21:36:42.485916 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2905/5866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:42 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:43.506381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:43.506927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:43.514090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:43.514562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:43.515374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:43.515834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:43.649470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:43.651943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=67 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:43.658977 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd466bdd-098d-4195-b98b-d1b603c0cef3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.156688 Jul 30 21:36:43.659587 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2962/5867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:43 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:44.680441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:44.681022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:44.688635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:44.689108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:44.689898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:44.690350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:44.821938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:44.829428 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-52ec7f83-22ae-43e5-bc46-b1455731b128 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.153043 Jul 30 21:36:44.829997 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2906/5868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:44 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:45.850465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:45.851565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:45.854494 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:45.860427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:45.860904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:45.861702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:45.862164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:45.995321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:46.003777 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20fe918d-703b-4dff-a015-3afea3cfcbf2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.157593 Jul 30 21:36:46.004354 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2963/5869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:45 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:46.196719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-49bb5486-d587-4cbf-b46a-e88e196dcc0c req-315ad9e0-3b68-4922-975b-6d4d795d4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4954e9a3-7b91-442f-a685-26ae5e61fd4c", "name": "network-vif-plugged", "status": "completed", "tag": "fa41aac6-c6e7-4d10-8c26-7ea3a8829205"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:46.209714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-49bb5486-d587-4cbf-b46a-e88e196dcc0c req-315ad9e0-3b68-4922-975b-6d4d795d4f6b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:46.210180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-49bb5486-d587-4cbf-b46a-e88e196dcc0c req-315ad9e0-3b68-4922-975b-6d4d795d4f6b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:46.221657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-49bb5486-d587-4cbf-b46a-e88e196dcc0c req-315ad9e0-3b68-4922-975b-6d4d795d4f6b service nova] Creating event network-vif-plugged:fa41aac6-c6e7-4d10-8c26-7ea3a8829205 for instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c on nch2-master-1 Jul 30 21:36:46.226920 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-49bb5486-d587-4cbf-b46a-e88e196dcc0c req-315ad9e0-3b68-4922-975b-6d4d795d4f6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034443 Jul 30 21:36:46.228074 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2907/5870] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:36:47.026182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:47.026944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:47.039069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:47.039732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:47.040855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:47.040855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:47.240290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:47.248818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f62b011e-4322-4b51-abdf-046788d1cd53 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1373 microversion: 2.1 time: 0.226712 Jul 30 21:36:47.249675 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2964/5871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:47 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:48.272076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:48.272791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:48.275651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.281704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:48.282180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:48.282971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:48.283460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:48.429336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:48.444948 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e81bf55d-91e2-47c2-a309-d2b125cd4df4 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1546 microversion: 2.1 time: 0.177257 Jul 30 21:36:48.445616 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2908/5872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:48 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:48.465721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:36:48.466906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:48.468829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.469511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:48.477042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:48.477516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:48.478309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:48.478763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:48.621911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:36:48.629932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ab0ae93-bc21-4f4f-b20a-b4468c5491d3 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1546 microversion: 2.1 time: 0.168046 Jul 30 21:36:48.630527 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2965/5873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:36:48 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:36:57.365243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:36:57.368070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:36:57.371066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=39 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:57.377308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:57.378008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:57.379794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:36:57.379794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:36:57.383873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:57.432541 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-311d23d5-9da2-462f-bb73-afa9f8e2c61f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action" status: 200 len: 24570 microversion: 2.1 time: 0.071774 Jul 30 21:36:57.433213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2909/5874] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:36:57 2022] POST /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:37:09.285245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:09.285793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:09.287813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-316b3aea-b82a-4db7-9d59-9c9748d63ee4 req-8649e60b-465d-4833-ad51-314b25e4a8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:09.288614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=5 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:09.290070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=19 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:09.297068 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:09.297532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:09.298328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:09.298457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:09.298777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:09.299234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:09.302395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-316b3aea-b82a-4db7-9d59-9c9748d63ee4 req-8649e60b-465d-4833-ad51-314b25e4a8e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:09.302941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-316b3aea-b82a-4db7-9d59-9c9748d63ee4 req-8649e60b-465d-4833-ad51-314b25e4a8e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:09.321481 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-316b3aea-b82a-4db7-9d59-9c9748d63ee4 req-8649e60b-465d-4833-ad51-314b25e4a8e3 service nova] Creating event network-changed:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:37:09.329104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:37:09.331086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-316b3aea-b82a-4db7-9d59-9c9748d63ee4 req-8649e60b-465d-4833-ad51-314b25e4a8e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046899 Jul 30 21:37:09.332739 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2910/5875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:09.418436 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d7d3bfe3-bc08-43ed-8a7a-32439596ec26 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 204 len: 0 microversion: 2.1 time: 0.136979 Jul 30 21:37:09.419955 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2966/5876] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:09 2022] DELETE /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:37:09.430198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:09.431031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:09.438574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:09.439043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:09.439864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:09.440316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:09.586785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:09.594936 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-35e9cd6e-386a-4ca4-8972-34a1934fc564 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1688 microversion: 2.1 time: 0.170328 Jul 30 21:37:09.595542 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2911/5877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:09 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:10.617236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:10.617981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:10.625881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:10.626357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:10.627150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:10.627638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:10.846040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:10.854707 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11e2f21f-be04-430a-8c53-af6db9caa8d2 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1688 microversion: 2.1 time: 0.241749 Jul 30 21:37:10.867780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2967/5878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:10 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:11.494758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6955163e-5216-4faf-8b99-304704457e74 req-8bcbd5fc-cc34-4fce-bb34-9d0aaf3d382a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be3df60-cfd4-445f-94be-bdabac5d92a0", "name": "network-vif-deleted", "tag": "8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:11.510072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6955163e-5216-4faf-8b99-304704457e74 req-8bcbd5fc-cc34-4fce-bb34-9d0aaf3d382a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:11.510072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6955163e-5216-4faf-8b99-304704457e74 req-8bcbd5fc-cc34-4fce-bb34-9d0aaf3d382a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:11.521591 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6955163e-5216-4faf-8b99-304704457e74 req-8bcbd5fc-cc34-4fce-bb34-9d0aaf3d382a service nova] Creating event network-vif-deleted:8873b5f3-5ccb-478e-8cd7-d9f7fa1f461b for instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 on nch1-master-1 Jul 30 21:37:11.526713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6955163e-5216-4faf-8b99-304704457e74 req-8bcbd5fc-cc34-4fce-bb34-9d0aaf3d382a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Jul 30 21:37:11.527305 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2912/5879] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:11.878391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:11.879023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:11.886418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:11.886888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:11.888390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:11.889160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:11.930211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:11.930892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:11.931533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lazy-loading 'fault' on Instance uuid 0be3df60-cfd4-445f-94be-bdabac5d92a0 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:37:11.975590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f113fc80feb42148c3dad0c33417dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a16baf2cd6043c79dbe21fafc13eb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:11.982539 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-13c99a24-dc4b-4111-b84d-3e68a3ab561f tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 200 len: 1356 microversion: 2.1 time: 0.108695 Jul 30 21:37:11.983112 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2968/5880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:11 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:13.005583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:13.006323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] [instance: 0be3df60-cfd4-445f-94be-bdabac5d92a0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:13.014217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:13.014694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:13.015525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:13.015991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:13.031969 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] HTTP exception thrown: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Request method failure captured: Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 HTTP/1.1 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aKp90dBlJxMh9WaS3Gkq8gfM6d3-8CW3esqUHxEuCANA_gqkiFmN_HnVJHO6yowKHncdygk0zqfSahCnQ0Jc7c0nZC3rQBEysFKa_cSm1_zBYPdjJVetekWVSZ7A9FqS6XppBVFwcCGkdqB6qkkULx-peDevL2cETeLnN9aiv-ImQs Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4a16baf2cd6043c79dbe21fafc13eb28", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a16baf2cd6043c79dbe21fafc13eb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4a16baf2cd6043c79dbe21fafc13eb28 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2028387396 Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 9f113fc80feb42148c3dad0c33417dfe Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2028387396-project Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0be3df60-cfd4-445f-94be-bdabac5d92a0'} Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:13.033643 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Returning 404 to user: Instance 0be3df60-cfd4-445f-94be-bdabac5d92a0 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2454da47-171a-4717-b8b4-111174e5b08e tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0" status: 404 len: 111 microversion: 2.1 time: 0.034389 Jul 30 21:37:13.039195 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2913/5881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:12 2022] GET /compute/v2.1/servers/0be3df60-cfd4-445f-94be-bdabac5d92a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:17.468294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:17.468911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:17.478374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:17.478949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:17.479808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:17.480262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:17.506252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0f76d4eb-872b-4b3c-b692-55e4c161e171 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] Calling method '.version_select at 0x7fbb4fe00dc0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:17.526538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:37:17.548445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0f76d4eb-872b-4b3c-b692-55e4c161e171 tempest-TestNetworkAdvancedServerOps-2028387396 tempest-TestNetworkAdvancedServerOps-2028387396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1706468018" status: 202 len: 0 microversion: 2.1 time: 0.045681 Jul 30 21:37:17.553513 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2914/5882] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 21:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1706468018 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:37:17.627606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fc6edb93-44f4-4065-b5ed-a9a8c84cce52 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 204 len: 0 microversion: 2.1 time: 0.163474 Jul 30 21:37:17.628990 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2969/5883] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:17 2022] DELETE /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:37:17.638434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:17.639267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:17.646705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:17.647444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:17.649364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:17.649893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:17.801870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:17.811650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b51b160-b929-46f2-9cd3-665c92bf3a93 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1552 microversion: 2.1 time: 0.178136 Jul 30 21:37:17.812344 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2915/5884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:17 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:18.834052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:18.834917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:18.842534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:18.843091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:18.843983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:18.844507 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:18.986888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:18.991638 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bd9e6b88-4fb9-4aa8-a421-3e056591f36b tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 200 len: 1552 microversion: 2.1 time: 0.161893 Jul 30 21:37:18.992530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2970/5885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:18 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:19.530274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b1c2c80f-8c80-42fc-9e5a-0db32d29580e req-d71af33c-bbe8-40a8-8452-f03bb01225f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4954e9a3-7b91-442f-a685-26ae5e61fd4c", "name": "network-vif-deleted", "tag": "fa41aac6-c6e7-4d10-8c26-7ea3a8829205"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:19.540935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1c2c80f-8c80-42fc-9e5a-0db32d29580e req-d71af33c-bbe8-40a8-8452-f03bb01225f5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:19.541397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1c2c80f-8c80-42fc-9e5a-0db32d29580e req-d71af33c-bbe8-40a8-8452-f03bb01225f5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:19.554415 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b1c2c80f-8c80-42fc-9e5a-0db32d29580e req-d71af33c-bbe8-40a8-8452-f03bb01225f5 service nova] Creating event network-vif-deleted:fa41aac6-c6e7-4d10-8c26-7ea3a8829205 for instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c on nch2-master-1 Jul 30 21:37:19.560663 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b1c2c80f-8c80-42fc-9e5a-0db32d29580e req-d71af33c-bbe8-40a8-8452-f03bb01225f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Jul 30 21:37:19.561528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2916/5886] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:20.017404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:20.018127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 4954e9a3-7b91-442f-a685-26ae5e61fd4c] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:20.025701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:20.026166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:20.026948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:20.027500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:20.046221 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] HTTP exception thrown: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Request method failure captured: Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c HTTP/1.1 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aQhaWo3gvWj44rRZSH6YJ6KNjpKHC_5oUyH_GxabLmN1rdD_Do_lQsZgdSDxCco5YfZhFMMGqXnO-T1VyhP0Vp2PR3dEgOJEghEb7pcq55yaog9e8KBKJa5aKSnSKFDK1UKaLRP1uP8EAe550pzNUc6fsmPOm0_ZjTj654pTNdeFoE Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7353cff71bc74e7386a4ebba1f6034c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 713a3b0b01bd4a7aa128101b5b86be0f Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '4954e9a3-7b91-442f-a685-26ae5e61fd4c'} Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:20.048023 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Returning 404 to user: Instance 4954e9a3-7b91-442f-a685-26ae5e61fd4c could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30fb6276-69fe-4275-8396-92e7dfd9d6ea tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c" status: 404 len: 111 microversion: 2.1 time: 0.040036 Jul 30 21:37:20.053867 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2971/5887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:20 2022] GET /compute/v2.1/servers/4954e9a3-7b91-442f-a685-26ae5e61fd4c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:20.238217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-40db2744-9228-497c-920b-f93072a0cd7f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '.version_select at 0x7fbb4fe008b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:20.263906 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-40db2744-9228-497c-920b-f93072a0cd7f tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1732114993" status: 202 len: 0 microversion: 2.1 time: 0.030216 Jul 30 21:37:20.264817 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2917/5888] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:37:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1732114993 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:37:22.240656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:22.241239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:22.244231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7b412135-ddd8-4ebf-a5f7-76440a5e26e3 req-7921bc69-6e45-4317-acba-06fa92e43033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9f957b-fcb3-4e45-bcc6-194e79e31f34", "tag": "b8849011-2341-430b-b0f5-2bc3ee44e72b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:22.249484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:22.250182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:22.251150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:22.251791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:22.263717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b412135-ddd8-4ebf-a5f7-76440a5e26e3 req-7921bc69-6e45-4317-acba-06fa92e43033 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:22.265186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7b412135-ddd8-4ebf-a5f7-76440a5e26e3 req-7921bc69-6e45-4317-acba-06fa92e43033 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:22.284145 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7b412135-ddd8-4ebf-a5f7-76440a5e26e3 req-7921bc69-6e45-4317-acba-06fa92e43033 service nova] Creating event network-changed:b8849011-2341-430b-b0f5-2bc3ee44e72b for instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 on nch2-master-1 Jul 30 21:37:22.289863 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7b412135-ddd8-4ebf-a5f7-76440a5e26e3 req-7921bc69-6e45-4317-acba-06fa92e43033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050625 Jul 30 21:37:22.291182 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2918/5889] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:37:22.302403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:37:22.400006 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-453a9d44-63a1-4994-b8a5-4fec0d6b72a9 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 204 len: 0 microversion: 2.1 time: 0.163321 Jul 30 21:37:22.400934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2972/5890] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:22 2022] DELETE /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:37:22.412903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:22.414132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:22.425756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:22.426233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:22.427045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:22.427577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:22.594866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:22.604111 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c7f52d86-e401-4637-aa94-b1dfefa7c1fc tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1670 microversion: 2.1 time: 0.196079 Jul 30 21:37:22.604694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2919/5891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:22 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:23.627501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:23.629040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:23.636138 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:23.636825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:23.638433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:23.639235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:23.944892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:23.953210 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-834d4168-8ee8-4c30-a55e-f44d5115f076 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1670 microversion: 2.1 time: 0.330755 Jul 30 21:37:23.954113 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2973/5892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:23 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1670 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:24.858200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-73d8c591-dbe3-4e84-937c-32d75b2a9118 req-b7b092ef-6a36-4408-a969-2f7ff39bfd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f957b-fcb3-4e45-bcc6-194e79e31f34", "name": "network-vif-deleted", "tag": "b8849011-2341-430b-b0f5-2bc3ee44e72b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:24.868576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-73d8c591-dbe3-4e84-937c-32d75b2a9118 req-b7b092ef-6a36-4408-a969-2f7ff39bfd7b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:24.869618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-73d8c591-dbe3-4e84-937c-32d75b2a9118 req-b7b092ef-6a36-4408-a969-2f7ff39bfd7b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:24.884860 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-73d8c591-dbe3-4e84-937c-32d75b2a9118 req-b7b092ef-6a36-4408-a969-2f7ff39bfd7b service nova] Creating event network-vif-deleted:b8849011-2341-430b-b0f5-2bc3ee44e72b for instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 on nch2-master-1 Jul 30 21:37:24.891491 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-73d8c591-dbe3-4e84-937c-32d75b2a9118 req-b7b092ef-6a36-4408-a969-2f7ff39bfd7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248491 Jul 30 21:37:24.893765 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2920/5893] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:37:24.975522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:24.976360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:24.994785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:24.995663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:25.000319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:25.000857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:25.061535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:25.062299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:25.062782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lazy-loading 'fault' on Instance uuid de9f957b-fcb3-4e45-bcc6-194e79e31f34 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:37:25.129629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:25.144522 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4ecba950-e37a-4c10-8c81-c00f935f18fe tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 200 len: 1337 microversion: 2.1 time: 0.173100 Jul 30 21:37:25.146358 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2974/5894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:24 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:26.170204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:26.170946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: de9f957b-fcb3-4e45-bcc6-194e79e31f34] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:26.180723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:26.181521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:26.182507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:26.182968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:26.198659 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] HTTP exception thrown: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Request method failure captured: Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 HTTP/1.1 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aQhaWo3gvWj44rRZSH6YJ6KNjpKHC_5oUyH_GxabLmN1rdD_Do_lQsZgdSDxCco5YfZhFMMGqXnO-T1VyhP0Vp2PR3dEgOJEghEb7pcq55yaog9e8KBKJa5aKSnSKFDK1UKaLRP1uP8EAe550pzNUc6fsmPOm0_ZjTj654pTNdeFoE Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7353cff71bc74e7386a4ebba1f6034c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 713a3b0b01bd4a7aa128101b5b86be0f Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'de9f957b-fcb3-4e45-bcc6-194e79e31f34'} Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:26.200797 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Returning 404 to user: Instance de9f957b-fcb3-4e45-bcc6-194e79e31f34 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b93565e-4427-4aad-8daf-0b71981236b0 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34" status: 404 len: 111 microversion: 2.1 time: 0.039430 Jul 30 21:37:26.206448 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2921/5895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:26 2022] GET /compute/v2.1/servers/de9f957b-fcb3-4e45-bcc6-194e79e31f34 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:26.453462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15c43f14-031a-460e-891a-d44bcfa8a646 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '.version_select at 0x7fbb4fb3e0d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:26.501273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15c43f14-031a-460e-891a-d44bcfa8a646 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-155214344" status: 202 len: 0 microversion: 2.1 time: 0.052237 Jul 30 21:37:26.503117 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2975/5896] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 21:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-155214344 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:37:38.503905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ebe0fbec-ca9e-4349-9fe8-5a102b59b529 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: .version_select at 0x7fbb4fdbb700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1778573472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7zlqGHwc+t6qoCdvfqFbV72vHuJDmEsmUQR33+JxVHzUBTeuJbxO/zfNhnlO7/XEXKRVD3uBNLYvWZtycVLAzWBX1QDuSGgFJ+x8ZwBBe6jzQ4wBFZUHOhvoNHqUQuw=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:38.516382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:38.517495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:38.532492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ebe0fbec-ca9e-4349-9fe8-5a102b59b529 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:37:38.540102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ebe0fbec-ca9e-4349-9fe8-5a102b59b529 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:37:38.582436 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ebe0fbec-ca9e-4349-9fe8-5a102b59b529 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.083459 Jul 30 21:37:38.591216 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2922/5897] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:37:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:39.736633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:39.738222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:39.743575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:39.744626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:39.754567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:39.755302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:39.756293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:39.756954 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:39.805428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:37:39.862319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-541432699", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "45f5e5c7-5bfa-451d-8c71-d4ea09971689", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:39.927306 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f72002a-9287-4736-8252-6ff97c380407 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 204 len: 0 microversion: 2.1 time: 0.193733 Jul 30 21:37:39.928417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2976/5898] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:39 2022] DELETE /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:37:39.943998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:39.944829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:39.965533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:39.969244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:39.973019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:39.973702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:40.007268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:37:40.385723 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:40.396188 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5c135ec7-60a6-4821-9ddc-ab3f01386f91 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1733 microversion: 2.1 time: 0.462748 Jul 30 21:37:40.396885 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2977/5899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:39 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1733 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:40.408337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1471514712", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "d24860c5-e892-4e99-a831-2aa3e594b6ae"}], "key_name": "tempest-TestNetworkBasicOps-1778573472", "security_groups": [{"name": "tempest-secgroup-smoke-57697613"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:40.473241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:37:40.473901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:37:40.474572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:37:40.475069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:37:40.475726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:37:40.486558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:40.487114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:40.488045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:40.488573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:40.507874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:37:40.514600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:37:40.528632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:37:40.530778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='45f5e5c7-5bfa-451d-8c71-d4ea09971689',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:37:40.538798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] validate_networks() for [('d24860c5-e892-4e99-a831-2aa3e594b6ae', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:37:40.630020 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-019c40d6-10e3-4580-b43f-03395e652ec0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774814 Jul 30 21:37:40.631111 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2923/5900] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:37:40.644846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddfc4904-3826-46fa-9fdc-42e6fa689551 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:40.645717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddfc4904-3826-46fa-9fdc-42e6fa689551 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:40.730948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ddfc4904-3826-46fa-9fdc-42e6fa689551 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:40.742399 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddfc4904-3826-46fa-9fdc-42e6fa689551 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1056 microversion: 2.1 time: 0.100848 Jul 30 21:37:40.758184 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2924/5901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:40 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1056 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:41.060296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:37:41.061650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:37:41.062719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:37:41.064991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:37:41.065447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:37:41.082986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.083699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.085156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.085795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.121602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:37:41.128847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Getting quotas for user 713a3b0b01bd4a7aa128101b5b86be0f and project 7353cff71bc74e7386a4ebba1f6034c0. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:37:41.159180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:37:41.162029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:37:41.274377 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f7432fc-bdd8-46bc-826a-c7f1c3b15aed tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.869337 Jul 30 21:37:41.278911 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2978/5902] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:37:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:37:41.292453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5bd254f7-6e6d-41aa-a127-104c83a0f890 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:41.294253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5bd254f7-6e6d-41aa-a127-104c83a0f890 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:41.422553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5bd254f7-6e6d-41aa-a127-104c83a0f890 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:41.426135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:41.430925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:41.434389 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5bd254f7-6e6d-41aa-a127-104c83a0f890 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1249 microversion: 2.1 time: 0.148571 Jul 30 21:37:41.440429 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2925/5903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:41 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1249 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:41.457590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.458321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.459506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.459974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.762061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:41.772735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:41.776656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:41.814598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-886dfe80-57a4-40d1-8ee2-58faed52a3cc tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1733 microversion: 2.1 time: 0.396628 Jul 30 21:37:41.817869 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2979/5904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:41 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1733 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:41.825683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.828948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.831655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:41.833471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:41.984803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:42.000882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ba1cc80-caa0-4b6e-931f-3f5ce40a5f46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1108 microversion: 2.1 time: 0.235153 Jul 30 21:37:42.003544 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2926/5905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:41 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1108 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:42.471202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:42.476990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:42.498678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:42.500188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:42.501676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:42.503126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:42.613303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:42.628458 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a564cd5-e9ba-4fee-9326-990f0904fe87 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1301 microversion: 2.1 time: 0.170958 Jul 30 21:37:42.629755 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2980/5906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:42 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1301 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:42.840682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:42.842197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:42.859632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:42.860102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:42.860924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:42.862316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.025038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:43.026378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:43.041165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:43.041323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.046075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:43.046771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.156040 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:43.204888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d6482a58-4cdc-4a8d-9f5b-d662c3a2d14c tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1665 microversion: 2.1 time: 0.370014 Jul 30 21:37:43.205538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2927/5907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:42 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1665 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:43.314698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:43.344406 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-636a18d2-64b6-490b-b4e6-0ab96a15003a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1126 microversion: 2.1 time: 0.323589 Jul 30 21:37:43.346854 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2981/5908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:43 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1126 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:43.421135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a4e68009-cb25-4ba0-b9c3-014bb8aaecbf req-f9a0b77c-2c43-472c-b384-ecac83815d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88175784-be66-4f78-ade7-1d4b95fa50f5", "name": "network-vif-deleted", "tag": "43e10e99-a93c-409d-9147-2a0032513557"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:43.443889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a4e68009-cb25-4ba0-b9c3-014bb8aaecbf req-f9a0b77c-2c43-472c-b384-ecac83815d78 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:43.447410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a4e68009-cb25-4ba0-b9c3-014bb8aaecbf req-f9a0b77c-2c43-472c-b384-ecac83815d78 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.470405 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a4e68009-cb25-4ba0-b9c3-014bb8aaecbf req-f9a0b77c-2c43-472c-b384-ecac83815d78 service nova] Creating event network-vif-deleted:43e10e99-a93c-409d-9147-2a0032513557 for instance 88175784-be66-4f78-ade7-1d4b95fa50f5 on nch2-master-1 Jul 30 21:37:43.476658 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a4e68009-cb25-4ba0-b9c3-014bb8aaecbf req-f9a0b77c-2c43-472c-b384-ecac83815d78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060907 Jul 30 21:37:43.477489 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2928/5909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:37:43.651213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:43.653289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:43.665161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:43.676423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.677318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:43.677784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:43.961826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:43.976023 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3ee86ba6-73f0-4c6b-9833-a89b60c2668d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1307 microversion: 2.1 time: 0.326150 Jul 30 21:37:43.982753 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2982/5910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:43 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:44.233003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:44.234857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:44.252985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:44.256991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:44.259945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:44.262600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:44.371603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:44.372485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:44.395018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:44.395722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:44.396714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:44.400113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:44.425691 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:44.427722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:44.428212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lazy-loading 'fault' on Instance uuid 88175784-be66-4f78-ade7-1d4b95fa50f5 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:37:44.568678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ec28438dc45a48433b159e5f04d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5105e54fdfa345c4891676afaf2dcd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:44.577951 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9df5a2d5-96c6-4fc6-9670-396396aa472f tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 200 len: 1388 microversion: 2.1 time: 0.353189 Jul 30 21:37:44.585817 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2929/5911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:44 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 1388 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:45.017150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:45.017678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:45.018674 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:45.034458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:45.037659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:45.038481 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4252630-8408-4985-969e-ab15373178b8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1168 microversion: 2.1 time: 0.671735 Jul 30 21:37:45.039819 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2983/5912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:44 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1168 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:45.041764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:45.043771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:45.311604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:45.325102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f086beb6-01fb-4247-bad7-ae6040527136 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.319630 Jul 30 21:37:45.346645 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2930/5913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:45 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:45.438211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cfce6f48-9710-4f83-a24c-61d227de903d req-6d1ed8a3-f471-4965-a7d3-1424fc9879ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc73ce3-7228-4cbd-9286-ddfbac95542d", "tag": "61cef442-1769-4067-a65d-ada7eb1cd92a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:45.466772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cfce6f48-9710-4f83-a24c-61d227de903d req-6d1ed8a3-f471-4965-a7d3-1424fc9879ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:45.467554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cfce6f48-9710-4f83-a24c-61d227de903d req-6d1ed8a3-f471-4965-a7d3-1424fc9879ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:45.489704 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cfce6f48-9710-4f83-a24c-61d227de903d req-6d1ed8a3-f471-4965-a7d3-1424fc9879ba service nova] Creating event network-changed:61cef442-1769-4067-a65d-ada7eb1cd92a for instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d on nch1-master-1 Jul 30 21:37:45.496428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cfce6f48-9710-4f83-a24c-61d227de903d req-6d1ed8a3-f471-4965-a7d3-1424fc9879ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070666 Jul 30 21:37:45.498032 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2984/5914] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:45.606637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:45.607667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:45.614287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:45.615021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:45.616143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:45.616676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:45.633364 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] HTTP exception thrown: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Request method failure captured: Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 HTTP/1.1 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aNyB0lT-XWd811DIwODwfAuZzWBqO4-CE77AOF_-oAb1bUxJ2jMo_B2gubCQkB2NIBtpAnd_jxdbXXvXU5Ub4fesTj09VjgZC82t9AFIWRlZvDYhEASKbj1hLzpYkYFXoldVU4s-46kqJRTN4BZuAQBMZvLurhrvp_ngbdpOABT99g Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5105e54fdfa345c4891676afaf2dcd5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b1ec28438dc45a48433b159e5f04d6b Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '88175784-be66-4f78-ade7-1d4b95fa50f5'} Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:45.635430 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:45.638629 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:45.641010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Returning 404 to user: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:45.642094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a09ac87a-4f28-4a3c-98ce-131a5aebec9d tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 404 len: 111 microversion: 2.1 time: 0.039946 Jul 30 21:37:45.643324 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2931/5915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:45 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:46.061608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:46.063919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:46.073843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.074725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.075794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.077194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.147820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f23c4752-8ac8-4b15-a22f-8c5ad4b98189 req-b160c0b1-bdc9-451a-ae1c-231edc1be5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83460d14-11de-4609-8a0f-03addcaa2f0a", "tag": "c0c197ad-02f5-4568-ae06-9aceb7bd024b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:46.160182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f23c4752-8ac8-4b15-a22f-8c5ad4b98189 req-b160c0b1-bdc9-451a-ae1c-231edc1be5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.166153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f23c4752-8ac8-4b15-a22f-8c5ad4b98189 req-b160c0b1-bdc9-451a-ae1c-231edc1be5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.193215 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f23c4752-8ac8-4b15-a22f-8c5ad4b98189 req-b160c0b1-bdc9-451a-ae1c-231edc1be5e1 service nova] Creating event network-changed:c0c197ad-02f5-4568-ae06-9aceb7bd024b for instance 83460d14-11de-4609-8a0f-03addcaa2f0a on nch1-master-1 Jul 30 21:37:46.199582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f23c4752-8ac8-4b15-a22f-8c5ad4b98189 req-b160c0b1-bdc9-451a-ae1c-231edc1be5e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061693 Jul 30 21:37:46.200895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2932/5916] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:46.362399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:46.363317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:46.371574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.372356 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.373482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.374386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.531454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:46.540796 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e62c2cb9-74cc-4dd8-bd56-61ff6384bb01 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1168 microversion: 2.1 time: 0.484462 Jul 30 21:37:46.552295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2985/5917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:46 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1168 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:46.656034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:46.678802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca7277cb-0324-41d7-ac48-2810e4438687 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.322154 Jul 30 21:37:46.694729 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2933/5918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:46 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:46.748214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:46.749623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:46.756175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.756879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.758018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.758554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.773989 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] HTTP exception thrown: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Request method failure captured: Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 HTTP/1.1 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aNyB0lT-XWd811DIwODwfAuZzWBqO4-CE77AOF_-oAb1bUxJ2jMo_B2gubCQkB2NIBtpAnd_jxdbXXvXU5Ub4fesTj09VjgZC82t9AFIWRlZvDYhEASKbj1hLzpYkYFXoldVU4s-46kqJRTN4BZuAQBMZvLurhrvp_ngbdpOABT99g Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5105e54fdfa345c4891676afaf2dcd5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8b1ec28438dc45a48433b159e5f04d6b Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '88175784-be66-4f78-ade7-1d4b95fa50f5'} Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:46.775911 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.780360 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.781721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Returning 404 to user: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:46.782601 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5dd65424-7ecc-4b11-a13e-bdec1cc61ae0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 404 len: 111 microversion: 2.1 time: 0.038806 Jul 30 21:37:46.783173 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2986/5919] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:46 2022] DELETE /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:37:46.791799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:46.793084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] [instance: 88175784-be66-4f78-ade7-1d4b95fa50f5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:46.801009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.801475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.802267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:46.802719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:46.822119 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] HTTP exception thrown: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Request method failure captured: Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 HTTP/1.1 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aNyB0lT-XWd811DIwODwfAuZzWBqO4-CE77AOF_-oAb1bUxJ2jMo_B2gubCQkB2NIBtpAnd_jxdbXXvXU5Ub4fesTj09VjgZC82t9AFIWRlZvDYhEASKbj1hLzpYkYFXoldVU4s-46kqJRTN4BZuAQBMZvLurhrvp_ngbdpOABT99g Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5105e54fdfa345c4891676afaf2dcd5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5105e54fdfa345c4891676afaf2dcd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 5105e54fdfa345c4891676afaf2dcd5e Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestServerBasicOps-1050245912 Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8b1ec28438dc45a48433b159e5f04d6b Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestServerBasicOps-1050245912-project Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '88175784-be66-4f78-ade7-1d4b95fa50f5'} Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:37:46.823917 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Returning 404 to user: Instance 88175784-be66-4f78-ade7-1d4b95fa50f5 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb366a02-ad6c-4b5f-aec7-af6d8ffa47a0 tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5" status: 404 len: 111 microversion: 2.1 time: 0.037845 Jul 30 21:37:46.826943 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2934/5920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:46 2022] GET /compute/v2.1/servers/88175784-be66-4f78-ade7-1d4b95fa50f5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:37:47.006547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-91debdc8-112c-49ba-9088-7990628b6d9a tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] Calling method '.version_select at 0x7fbb4fe2d550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:47.033447 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-91debdc8-112c-49ba-9088-7990628b6d9a tempest-TestServerBasicOps-1050245912 tempest-TestServerBasicOps-1050245912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-270708493" status: 202 len: 0 microversion: 2.1 time: 0.032966 Jul 30 21:37:47.034046 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2987/5921] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 30 21:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-270708493 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:37:47.563094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:47.564486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:47.578220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:47.578872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:47.580205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:47.580892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:47.703169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:47.703835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:47.718180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:47.718661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:47.719493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:47.723440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:47.793418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:47.801246 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04ba41e3-52b0-4b56-917c-70ac7b9142dc tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1214 microversion: 2.1 time: 0.243039 Jul 30 21:37:47.801850 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2935/5922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:47 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:48.028499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:48.036241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a329feae-8d53-4e0a-8880-0597722ec671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.337936 Jul 30 21:37:48.036822 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2988/5923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:47 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:48.822444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:48.825480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:48.833598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:48.834472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:48.835920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:48.836535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:49.010417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:49.019922 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c8e74cce-8bdc-4f4f-ad19-641b3f8e9802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.201636 Jul 30 21:37:49.020835 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2936/5924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:48 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:49.058581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:49.059774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:49.066997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:49.067513 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:49.068317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:49.068780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:49.304592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:49.312766 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-54791424-f4b0-4cd9-a705-c8046270fc84 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.258801 Jul 30 21:37:49.313280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2989/5925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:49 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:50.041665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:50.043704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:50.051112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:50.051719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:50.052595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:50.053268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:50.196506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:50.206765 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f9adc6c7-8482-4095-8c9a-6c6699ae48b6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.168028 Jul 30 21:37:50.211774 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2937/5926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:50 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:50.334082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:50.335248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:50.345452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:50.345926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:50.346731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:50.347304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:50.921173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:50.929774 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0fe3e1c7-760c-469f-9df7-d9a75f127671 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.599614 Jul 30 21:37:50.931019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2990/5927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:50 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:51.230530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:51.231885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:51.234177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:51.240072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:51.240534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:51.241623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:51.242077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:51.388410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:51.396515 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c880fea9-6952-41cf-a37d-54f614dda3a7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.170547 Jul 30 21:37:51.397098 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2938/5928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:51 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:51.954899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:51.955748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:51.962249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:51.962946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:51.966671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:51.968765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:51.969864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:51.970487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:52.160313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:52.171105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7205555-a8f2-459d-8806-fd7af2d9d18c tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.220393 Jul 30 21:37:52.183324 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2991/5929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:51 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:52.419854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:52.421357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:52.424633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:52.439005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:52.440203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:52.441974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:52.442922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:52.659533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:52.662290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-4b740310-773f-46c0-8766-c13edd4d9448 req-2381baf9-d85d-497c-8e52-7ba82c48f420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83460d14-11de-4609-8a0f-03addcaa2f0a", "name": "network-vif-plugged", "status": "completed", "tag": "c0c197ad-02f5-4568-ae06-9aceb7bd024b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:52.671007 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f650d0c5-8eda-4483-b4bc-77d89d576b49 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.255275 Jul 30 21:37:52.671806 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2939/5930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:52 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:52.677754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4b740310-773f-46c0-8766-c13edd4d9448 req-2381baf9-d85d-497c-8e52-7ba82c48f420 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:52.678324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-4b740310-773f-46c0-8766-c13edd4d9448 req-2381baf9-d85d-497c-8e52-7ba82c48f420 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:52.693028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-4b740310-773f-46c0-8766-c13edd4d9448 req-2381baf9-d85d-497c-8e52-7ba82c48f420 service nova] Creating event network-vif-plugged:c0c197ad-02f5-4568-ae06-9aceb7bd024b for instance 83460d14-11de-4609-8a0f-03addcaa2f0a on nch1-master-1 Jul 30 21:37:52.700574 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-4b740310-773f-46c0-8766-c13edd4d9448 req-2381baf9-d85d-497c-8e52-7ba82c48f420 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204099 Jul 30 21:37:52.701377 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2992/5931] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:53.194389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:53.194959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:53.201796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:53.202222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:53.203011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:53.203500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:53.418772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:53.426496 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8a9550ac-a390-46f0-97e7-e090e7c4d897 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1373 microversion: 2.1 time: 0.236310 Jul 30 21:37:53.427428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2940/5932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:53 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1373 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:53.693508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:53.694367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:53.708497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:53.709035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:53.709963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:53.710581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:53.904588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:53.912395 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-805b8c3e-0a62-4659-8b8a-43332faf1b04 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.224255 Jul 30 21:37:53.923725 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2993/5933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:53 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:54.450699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:54.451994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:54.460476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.461228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.462235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.462705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.688390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:54.696765 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0fac518f-daae-4083-bd02-56100b9ab2a8 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1546 microversion: 2.1 time: 0.251711 Jul 30 21:37:54.697621 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2941/5934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:54 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:54.717061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:54.717687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:54.725072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.725541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.726324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.727318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.743021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-842da4ed-6b8e-46a2-b3c4-b223a6cd6fdf req-870e958a-a778-46cf-881a-b62e5207138f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc73ce3-7228-4cbd-9286-ddfbac95542d", "name": "network-vif-plugged", "status": "completed", "tag": "61cef442-1769-4067-a65d-ada7eb1cd92a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:54.757180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-842da4ed-6b8e-46a2-b3c4-b223a6cd6fdf req-870e958a-a778-46cf-881a-b62e5207138f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.757643 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-842da4ed-6b8e-46a2-b3c4-b223a6cd6fdf req-870e958a-a778-46cf-881a-b62e5207138f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.759274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:54.771899 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-842da4ed-6b8e-46a2-b3c4-b223a6cd6fdf req-870e958a-a778-46cf-881a-b62e5207138f service nova] Creating event network-vif-plugged:61cef442-1769-4067-a65d-ada7eb1cd92a for instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d on nch1-master-1 Jul 30 21:37:54.779060 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-842da4ed-6b8e-46a2-b3c4-b223a6cd6fdf req-870e958a-a778-46cf-881a-b62e5207138f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039366 Jul 30 21:37:54.779694 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2942/5935] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:54.935570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:54.936549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:54.944715 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.945184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:54.946051 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:54.946511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:55.063086 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:55.071488 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-872d637f-0e17-4e29-9a14-cb76113948eb tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1546 microversion: 2.1 time: 0.358224 Jul 30 21:37:55.074395 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2994/5936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:54 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1546 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:55.115554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:55.125328 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f056bdab-0f2f-4649-875a-f73906e3823e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.194823 Jul 30 21:37:55.133674 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2943/5937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:54 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:56.148662 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:56.149988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:56.173203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:56.174238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:56.175181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:56.175861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:56.407912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:56.416426 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-706cad31-34e5-4fd3-afeb-a6b623468887 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1202 microversion: 2.1 time: 0.272029 Jul 30 21:37:56.417016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2995/5938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:56 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:56.862932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6c48c3be-0349-4a45-a6c8-051fcec3297e req-f2e1e91f-da3e-4f6f-8d98-a90d2c6c8765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83460d14-11de-4609-8a0f-03addcaa2f0a", "tag": "c0c197ad-02f5-4568-ae06-9aceb7bd024b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:37:56.879312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6c48c3be-0349-4a45-a6c8-051fcec3297e req-f2e1e91f-da3e-4f6f-8d98-a90d2c6c8765 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:56.879994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6c48c3be-0349-4a45-a6c8-051fcec3297e req-f2e1e91f-da3e-4f6f-8d98-a90d2c6c8765 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:56.892299 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6c48c3be-0349-4a45-a6c8-051fcec3297e req-f2e1e91f-da3e-4f6f-8d98-a90d2c6c8765 service nova] Creating event network-changed:c0c197ad-02f5-4568-ae06-9aceb7bd024b for instance 83460d14-11de-4609-8a0f-03addcaa2f0a on nch1-master-1 Jul 30 21:37:56.897932 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6c48c3be-0349-4a45-a6c8-051fcec3297e req-f2e1e91f-da3e-4f6f-8d98-a90d2c6c8765 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040197 Jul 30 21:37:56.898861 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2944/5939] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:37:57.441515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:57.442684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:57.454337 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:57.455096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:57.456314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:57.457255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:57.618605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:57.629979 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8d000892-74a6-4ec6-9ff3-daa00fc13856 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1389 microversion: 2.1 time: 0.194171 Jul 30 21:37:57.631262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2996/5940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:57 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:57.651767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:57.652807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:57.659705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:57.660462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:57.661339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:57.661879 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.097590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:58.101837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:58.108489 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-27431509-b2a3-4a4e-bf0d-485bb013031f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1389 microversion: 2.1 time: 0.461030 Jul 30 21:37:58.110382 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2945/5941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:57 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1389 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:58.138326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:58.139306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:58.152549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.152978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.153774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.154229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.374901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:58.382872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8e200655-060e-4d0d-a431-d2c5ba6af242 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1389 microversion: 2.1 time: 0.250781 Jul 30 21:37:58.383787 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2997/5942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:58 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1389 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:37:58.464735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:58.465271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:58.471752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.472229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.473041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.473579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.501718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:37:58.591930 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-06b13bfc-3f92-4379-9190-ae15821fdb94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 204 len: 0 microversion: 2.1 time: 0.131802 Jul 30 21:37:58.593873 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2946/5943] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:37:58 2022] DELETE /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:37:58.601417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:58.602767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:58.609965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.610601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.611566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:58.612164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:58.859266 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:37:58.868857 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ab0e800-b47a-4de5-9425-82979505402a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1395 microversion: 2.1 time: 0.271221 Jul 30 21:37:58.869572 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2998/5944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:58 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1395 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:37:59.892154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:37:59.893712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:37:59.901865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:59.902339 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:37:59.903161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:37:59.903822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:00.076896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:00.087861 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6985b8e0-75a9-4daf-b5ad-b89189c57f23 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1395 microversion: 2.1 time: 0.200068 Jul 30 21:38:00.089405 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2947/5945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:37:59 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1395 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:00.985055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2e6cf88b-7bec-40c5-a056-6f02310b38d9 req-45cb1e17-9e01-4cd6-b2ff-de9342fcbd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc73ce3-7228-4cbd-9286-ddfbac95542d", "name": "network-vif-deleted", "tag": "61cef442-1769-4067-a65d-ada7eb1cd92a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:01.005473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2e6cf88b-7bec-40c5-a056-6f02310b38d9 req-45cb1e17-9e01-4cd6-b2ff-de9342fcbd80 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:01.006154 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2e6cf88b-7bec-40c5-a056-6f02310b38d9 req-45cb1e17-9e01-4cd6-b2ff-de9342fcbd80 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:01.025746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2e6cf88b-7bec-40c5-a056-6f02310b38d9 req-45cb1e17-9e01-4cd6-b2ff-de9342fcbd80 service nova] Creating event network-vif-deleted:61cef442-1769-4067-a65d-ada7eb1cd92a for instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d on nch1-master-1 Jul 30 21:38:01.033016 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2e6cf88b-7bec-40c5-a056-6f02310b38d9 req-45cb1e17-9e01-4cd6-b2ff-de9342fcbd80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054147 Jul 30 21:38:01.034414 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 2999/5946] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:01.110432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:01.111100 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:01.125234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:01.126998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:01.127850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:01.129623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:01.231212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:01.246369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4a0a10f8-f85b-4a94-8de4-01facf022e94 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 200 len: 1187 microversion: 2.1 time: 0.140049 Jul 30 21:38:01.246972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2948/5947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:01 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:02.270768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:02.271744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:02.279329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.280108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.281013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.281677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.297863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d HTTP/1.1 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '9dc73ce3-7228-4cbd-9286-ddfbac95542d'} Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.299810 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.303062 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.304371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:38:02.305572 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a4af5c3a-5a45-46ea-a7d4-86230900bece tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 404 len: 111 microversion: 2.1 time: 0.041062 Jul 30 21:38:02.310099 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3000/5948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:02 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:38:02.340098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:02.341324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:02.348803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.349401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.350297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.351069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.365992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d HTTP/1.1 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '9dc73ce3-7228-4cbd-9286-ddfbac95542d'} Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:38:02.368021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.371906 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.373346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:38:02.374486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ffe802a-2baa-4689-91f7-2181cf1a4acb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 404 len: 111 microversion: 2.1 time: 0.038885 Jul 30 21:38:02.375059 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2949/5949] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:38:02 2022] DELETE /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:38:02.383398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:02.384231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 9dc73ce3-7228-4cbd-9286-ddfbac95542d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:02.390685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.391347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.392279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:02.392869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:02.407818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d HTTP/1.1 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '9dc73ce3-7228-4cbd-9286-ddfbac95542d'} Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:02.409816 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. Jul 30 21:38:02.413724 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:02.414941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 9dc73ce3-7228-4cbd-9286-ddfbac95542d could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:38:02.415987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c9bf058-f2de-4997-b011-38a110457715 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d" status: 404 len: 111 microversion: 2.1 time: 0.036552 Jul 30 21:38:02.417245 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3001/5950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:02 2022] GET /compute/v2.1/servers/9dc73ce3-7228-4cbd-9286-ddfbac95542d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:38:07.580516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1848392020", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a9951e2-181f-496b-9841-f6f5f0a12efb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:07.647492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:38:08.049442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:38:08.049915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:38:08.050403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:38:08.050819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:38:08.051514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:38:08.060770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:08.061237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:08.062054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:08.062504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:08.081915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:38:08.084314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:08.089080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:38:08.151807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:38:08.153893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a9951e2-181f-496b-9841-f6f5f0a12efb',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:38:08.295434 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718701 Jul 30 21:38:08.296131 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2950/5951] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:38:08.307004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f080f583-8a7a-4d97-915e-8b4e3b42e998 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:08.307700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f080f583-8a7a-4d97-915e-8b4e3b42e998 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:08.373598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f080f583-8a7a-4d97-915e-8b4e3b42e998 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:08.382943 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f080f583-8a7a-4d97-915e-8b4e3b42e998 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1071 microversion: 2.1 time: 0.079899 Jul 30 21:38:08.383941 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3002/5952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:08 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1071 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:38:09.405198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:09.406350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:09.413638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:09.414104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:09.414905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:09.415384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:09.505196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:09.515602 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0626d719-b8f0-497c-a12c-752bd9819494 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1187 microversion: 2.1 time: 0.115117 Jul 30 21:38:09.527328 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2951/5953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:09 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:10.536834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:10.537488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:10.542054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:10.547894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:10.548365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:10.549157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:10.549613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:10.561848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-bc915167-c272-435e-9ae4-c36ca8df2083 req-5ffbd67a-ae0c-4c84-91c8-0c9eaa0d1f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bf8830-55dc-41ed-9c45-e56350313db6", "tag": "8f8f8f13-1298-4221-ac39-a2db5027a711"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:10.573840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bc915167-c272-435e-9ae4-c36ca8df2083 req-5ffbd67a-ae0c-4c84-91c8-0c9eaa0d1f27 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:10.575058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-bc915167-c272-435e-9ae4-c36ca8df2083 req-5ffbd67a-ae0c-4c84-91c8-0c9eaa0d1f27 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:10.589741 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-bc915167-c272-435e-9ae4-c36ca8df2083 req-5ffbd67a-ae0c-4c84-91c8-0c9eaa0d1f27 service nova] Creating event network-changed:8f8f8f13-1298-4221-ac39-a2db5027a711 for instance 75bf8830-55dc-41ed-9c45-e56350313db6 on nch2-master-1 Jul 30 21:38:10.595744 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-bc915167-c272-435e-9ae4-c36ca8df2083 req-5ffbd67a-ae0c-4c84-91c8-0c9eaa0d1f27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038348 Jul 30 21:38:10.596366 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2952/5954] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:38:10.811153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:10.819042 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85bb5ff4-0df1-4709-8482-7c9a07bfce26 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.286199 Jul 30 21:38:10.819717 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3003/5955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:10 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:11.841536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:11.842353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:11.848714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:11.849190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:11.849977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:11.850436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:11.997469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:12.008094 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ca5c735-2d63-4acb-87ca-09fe35aadcd3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.171615 Jul 30 21:38:12.008685 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2953/5956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:11 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:13.028974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:13.029641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:13.036737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:13.037208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:13.037995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:13.038451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:13.165970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:13.173583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-733be7c1-10c5-4264-bd38-c359d4d504d4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.148620 Jul 30 21:38:13.174162 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3004/5957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:13 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:14.194619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:14.195317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:14.202341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:14.202813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:14.203634 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:14.204091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:14.347343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:14.355129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-babad2f1-f3e7-4b57-9309-e8ff3370b435 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.164497 Jul 30 21:38:14.355750 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2954/5958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:14 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:38:15.376142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:15.376792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:15.383965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:15.384435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:15.385889 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:15.386341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:15.520024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:15.527598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c0b4ab63-b97f-443f-866a-de1888de2d6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.155760 Jul 30 21:38:15.528167 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3005/5959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:15 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:16.548380 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:16.549022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:16.556330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:16.556796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:16.557588 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:16.558037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:16.715915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:16.723909 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2df69e82-5cb7-43bd-8ad8-375338a21fb0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.179489 Jul 30 21:38:16.724572 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2955/5960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:16 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:16.820377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-487e927f-e72c-4d6b-a663-bf93ae90f8ff req-36c54aed-934c-4cbb-824e-25ad43771006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bf8830-55dc-41ed-9c45-e56350313db6", "name": "network-vif-plugged", "status": "completed", "tag": "8f8f8f13-1298-4221-ac39-a2db5027a711"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:16.833608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-487e927f-e72c-4d6b-a663-bf93ae90f8ff req-36c54aed-934c-4cbb-824e-25ad43771006 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:16.834065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-487e927f-e72c-4d6b-a663-bf93ae90f8ff req-36c54aed-934c-4cbb-824e-25ad43771006 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:16.845330 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-487e927f-e72c-4d6b-a663-bf93ae90f8ff req-36c54aed-934c-4cbb-824e-25ad43771006 service nova] Creating event network-vif-plugged:8f8f8f13-1298-4221-ac39-a2db5027a711 for instance 75bf8830-55dc-41ed-9c45-e56350313db6 on nch2-master-1 Jul 30 21:38:16.850373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-487e927f-e72c-4d6b-a663-bf93ae90f8ff req-36c54aed-934c-4cbb-824e-25ad43771006 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Jul 30 21:38:16.851371 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3006/5961] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:17.744918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:17.745554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:17.752924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:17.753398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:17.754191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:17.754654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:17.884540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:17.892733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8dbfe7fe-cb39-4698-970e-344ad3fc7e3a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1217 microversion: 2.1 time: 0.151788 Jul 30 21:38:17.893314 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2956/5962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:17 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:18.914680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:18.915439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:18.918001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:18.923741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:18.924216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:18.925008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:18.925466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.058927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:19.066674 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ea245bc8-802d-4b82-b967-042aff0abc2d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1403 microversion: 2.1 time: 0.156489 Jul 30 21:38:19.067265 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3007/5963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:18 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:19.087170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:19.087901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:19.089924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:19.090609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:19.097576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.098047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.098835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.099343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.230920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:19.231112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:19.233413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:19.238703 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-51c939a2-de7a-4371-bcfe-5a43f2981311 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1403 microversion: 2.1 time: 0.155565 Jul 30 21:38:19.239281 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2957/5964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:19 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:19.239541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.240012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.240796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.241248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.259153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-364844070"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:19.262036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:19.268145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.268621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.269422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:19.269886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:19.295415 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5703154-9cf5-4b3d-895a-2f0705d4aa1e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a/action" status: 200 len: 24570 microversion: 2.1 time: 0.068609 Jul 30 21:38:19.296283 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3008/5965] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:38:19 2022] POST /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 21:38:19.362610 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Attempting to quiesce instance before volume snapshot. Jul 30 21:38:19.387205 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 30 21:38:19.457343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Creating snapshot from volume 0a9951e2-181f-496b-9841-f6f5f0a12efb. {{(pid=130983) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Jul 30 21:38:20.220939 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6/action" status: 202 len: 0 microversion: 2.1 time: 0.965591 Jul 30 21:38:20.221614 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2958/5966] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:38:19 2022] POST /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 30 21:38:21.418696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-940602556", "imageRef": "6c945ffa-6abf-45f8-a223-6c5f8f4d9d54", "flavorRef": "452", "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:21.476989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:38:21.950724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:38:21.951159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:38:21.951727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:38:21.952152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:38:21.952581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:38:21.963381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:21.963853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:21.964672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:21.965125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:21.982650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:38:21.988292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:38:22.001651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:38:22.004681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f895c02e-4229-41e8-a0ac-285e78ccdb91',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:38:22.084624 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-34a0d004-0a05-472e-818b-2a838d168587 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670062 Jul 30 21:38:22.085209 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3009/5967] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:38:22.097816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e67a1705-8db4-4fb5-a473-eee4bee36301 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:22.098540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e67a1705-8db4-4fb5-a473-eee4bee36301 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:22.156866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e67a1705-8db4-4fb5-a473-eee4bee36301 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:22.164823 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e67a1705-8db4-4fb5-a473-eee4bee36301 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1229 microversion: 2.1 time: 0.072024 Jul 30 21:38:22.165412 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2959/5968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:22 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1229 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:23.187135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:23.187930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:23.207417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:23.208022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:23.208884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:23.209351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:23.285097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:23.294424 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4013fee8-6117-466c-b9bd-e8b218c2034c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1299 microversion: 2.1 time: 0.112837 Jul 30 21:38:23.295446 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3010/5969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:23 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:24.317254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:24.318031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:24.325880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:24.326397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:24.327245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:24.327736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:24.479569 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:24.488306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82db020f-0355-46c9-957c-5428b270fe6a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1341 microversion: 2.1 time: 0.175010 Jul 30 21:38:24.489381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2960/5970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:24 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:24.766913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d9f738d0-d27f-4975-bf68-51827ad60b3e req-08325bcb-9c37-4e6c-8102-d006c06946d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411f1459-d726-442a-9554-3f1941d5cf58", "tag": "c142475e-a40d-4056-8755-94d0e7cfcdce"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:24.779172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d9f738d0-d27f-4975-bf68-51827ad60b3e req-08325bcb-9c37-4e6c-8102-d006c06946d0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:24.779702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d9f738d0-d27f-4975-bf68-51827ad60b3e req-08325bcb-9c37-4e6c-8102-d006c06946d0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:24.792995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=71 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:24.801038 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d9f738d0-d27f-4975-bf68-51827ad60b3e req-08325bcb-9c37-4e6c-8102-d006c06946d0 service nova] Creating event network-changed:c142475e-a40d-4056-8755-94d0e7cfcdce for instance 411f1459-d726-442a-9554-3f1941d5cf58 on nch2-master-1 Jul 30 21:38:24.806109 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d9f738d0-d27f-4975-bf68-51827ad60b3e req-08325bcb-9c37-4e6c-8102-d006c06946d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042809 Jul 30 21:38:24.806603 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3011/5971] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:25.509179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:25.509836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:25.517165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:25.517652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:25.518543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:25.519019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:25.655596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:25.658082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:25.666382 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7d7a4b8-2d32-4ecf-8fdf-9741d07ad40a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1341 microversion: 2.1 time: 0.161163 Jul 30 21:38:25.666986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2961/5972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:25 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:25.751690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:25.754157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:25.760574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:25.761047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:25.761826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:25.762341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:25.812339 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d83d7a77-4cca-48bc-a462-8f2de4e7ce3e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "POST /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a/action" status: 200 len: 32645 microversion: 2.1 time: 0.065139 Jul 30 21:38:25.812971 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3012/5973] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:38:25 2022] POST /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 21:38:26.689479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:26.690825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:26.700352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:26.700975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:26.701794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:26.702427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:26.856736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:26.857941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:26.859348 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:26.868204 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-605aaaf9-c3f1-45c0-bb9d-84fb82f36f63 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1341 microversion: 2.1 time: 0.183722 Jul 30 21:38:26.873205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:26.875910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2962/5974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:26 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:26.876619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:26.877625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:26.878301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:26.885995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-72ff235c-7173-4abd-b4c2-2f0c5e771ac7 req-074898f9-0e77-443f-9efa-8f55c65476b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83460d14-11de-4609-8a0f-03addcaa2f0a", "tag": "c0c197ad-02f5-4568-ae06-9aceb7bd024b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:26.898754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-72ff235c-7173-4abd-b4c2-2f0c5e771ac7 req-074898f9-0e77-443f-9efa-8f55c65476b1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:26.899379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-72ff235c-7173-4abd-b4c2-2f0c5e771ac7 req-074898f9-0e77-443f-9efa-8f55c65476b1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:26.912697 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-72ff235c-7173-4abd-b4c2-2f0c5e771ac7 req-074898f9-0e77-443f-9efa-8f55c65476b1 service nova] Creating event network-changed:c0c197ad-02f5-4568-ae06-9aceb7bd024b for instance 83460d14-11de-4609-8a0f-03addcaa2f0a on nch1-master-1 Jul 30 21:38:26.914139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:38:26.919423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-72ff235c-7173-4abd-b4c2-2f0c5e771ac7 req-074898f9-0e77-443f-9efa-8f55c65476b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041981 Jul 30 21:38:26.923749 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2963/5975] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:27.038382 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac7f7728-beff-43c2-b859-c7a3542c5a8e tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 204 len: 0 microversion: 2.1 time: 0.186288 Jul 30 21:38:27.049751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:27.050735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:27.054106 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3013/5976] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:38:26 2022] DELETE /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:38:27.058039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:27.060319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:27.061345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:27.062022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:27.225372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:27.239988 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f0e1d7a-be43-48d3-b29d-dc7e258c221d tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1671 microversion: 2.1 time: 0.193998 Jul 30 21:38:27.241213 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2964/5977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:27 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:27.891828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:27.893477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:27.903471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:27.903986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:27.904822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:27.905320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:28.093367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:28.101713 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19cd55e9-05d6-4496-aa23-c5144cf2d4b5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1387 microversion: 2.1 time: 0.215385 Jul 30 21:38:28.102315 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3014/5978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:27 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1387 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:28.266666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:28.267368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:28.274462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:28.274950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:28.275783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:28.276257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:28.491263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a3b0b01bd4a7aa128101b5b86be0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7353cff71bc74e7386a4ebba1f6034c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:28.500290 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60e60f2f-ef84-4f7e-a582-026f4a5d5d81 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 200 len: 1671 microversion: 2.1 time: 0.238018 Jul 30 21:38:28.500963 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2965/5979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:28 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:28.885553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c075cc8e-ab4b-4955-b759-e836f358358f req-90586e5f-8799-4c14-a54a-c80c49c48c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83460d14-11de-4609-8a0f-03addcaa2f0a", "name": "network-vif-deleted", "tag": "c0c197ad-02f5-4568-ae06-9aceb7bd024b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:28.896399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c075cc8e-ab4b-4955-b759-e836f358358f req-90586e5f-8799-4c14-a54a-c80c49c48c4e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:28.897048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c075cc8e-ab4b-4955-b759-e836f358358f req-90586e5f-8799-4c14-a54a-c80c49c48c4e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:28.909661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c075cc8e-ab4b-4955-b759-e836f358358f req-90586e5f-8799-4c14-a54a-c80c49c48c4e service nova] Creating event network-vif-deleted:c0c197ad-02f5-4568-ae06-9aceb7bd024b for instance 83460d14-11de-4609-8a0f-03addcaa2f0a on nch1-master-1 Jul 30 21:38:28.915583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c075cc8e-ab4b-4955-b759-e836f358358f req-90586e5f-8799-4c14-a54a-c80c49c48c4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Jul 30 21:38:28.916199 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3015/5980] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:29.123131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:29.124147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:29.130874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:29.131399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:29.132222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:29.132704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:29.295041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:29.304780 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4334bef7-f0f0-4b2a-bdd2-4ef83f0ef00d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.185936 Jul 30 21:38:29.305638 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2966/5981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:29 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:29.523076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:29.523716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] [instance: 83460d14-11de-4609-8a0f-03addcaa2f0a] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:29.530161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:29.530634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:29.531524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:29.531987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:29.546116 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] HTTP exception thrown: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Request method failure captured: Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a HTTP/1.1 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aQhaWo3gvWj44rRZSH6YJ6KNjpKHC_5oUyH_GxabLmN1rdD_Do_lQsZgdSDxCco5YfZhFMMGqXnO-T1VyhP0Vp2PR3dEgOJEghEb7pcq55yaog9e8KBKJa5aKSnSKFDK1UKaLRP1uP8EAe550pzNUc6fsmPOm0_ZjTj654pTNdeFoE Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7353cff71bc74e7386a4ebba1f6034c0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7353cff71bc74e7386a4ebba1f6034c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 7353cff71bc74e7386a4ebba1f6034c0 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkBasicOps-1497763664 Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 713a3b0b01bd4a7aa128101b5b86be0f Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkBasicOps-1497763664-project Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '83460d14-11de-4609-8a0f-03addcaa2f0a'} Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:29.547946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Returning 404 to user: Instance 83460d14-11de-4609-8a0f-03addcaa2f0a could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14f13df9-e376-4556-8b28-c88733ed5837 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a" status: 404 len: 111 microversion: 2.1 time: 0.031373 Jul 30 21:38:29.551946 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3016/5982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:29 2022] GET /compute/v2.1/servers/83460d14-11de-4609-8a0f-03addcaa2f0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:38:29.731146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ac80f26-07ef-4029-b932-55228b2039e2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] Calling method '.version_select at 0x7fbb5c0171f0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:29.758022 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ac80f26-07ef-4029-b932-55228b2039e2 tempest-TestNetworkBasicOps-1497763664 tempest-TestNetworkBasicOps-1497763664-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1778573472" status: 202 len: 0 microversion: 2.1 time: 0.031748 Jul 30 21:38:29.758643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2967/5983] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 21:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1778573472 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:38:30.327036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:30.327767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:30.334632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:30.335101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:30.336101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:30.336554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:30.557830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:30.566263 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ced20864-82d9-4117-a11e-a2f6b7c26d46 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.243465 Jul 30 21:38:30.566970 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3017/5984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:30 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:31.589605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:31.590267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:31.598697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:31.599201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:31.601462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:31.602604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:31.742722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:31.751316 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7bb0a203-72e6-413c-9a21-7bed9465728f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.167009 Jul 30 21:38:31.751924 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2968/5985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:31 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:32.776552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:32.777916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:32.787979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:32.789375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:32.791416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:32.792072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:32.793809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:32.794796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:33.088669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:33.098081 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f69f253b-3991-475d-98b1-555f34b56251 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.326191 Jul 30 21:38:33.098676 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3018/5986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:32 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:34.119178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:34.119948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:34.125455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:34.128318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:34.128807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:34.129630 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:34.130862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:34.270522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:34.279074 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1c03175-8b69-4958-81b1-e3f9eb5899c7 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.163817 Jul 30 21:38:34.279689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2969/5987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:34 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:34.713831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-625e0838-7c3f-450c-9c1f-cf366099c30e req-0528b17f-3c82-4960-8493-f256b470e5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411f1459-d726-442a-9554-3f1941d5cf58", "name": "network-vif-plugged", "status": "completed", "tag": "c142475e-a40d-4056-8755-94d0e7cfcdce"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:34.727676 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-625e0838-7c3f-450c-9c1f-cf366099c30e req-0528b17f-3c82-4960-8493-f256b470e5ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:34.728333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-625e0838-7c3f-450c-9c1f-cf366099c30e req-0528b17f-3c82-4960-8493-f256b470e5ca service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:34.741778 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-625e0838-7c3f-450c-9c1f-cf366099c30e req-0528b17f-3c82-4960-8493-f256b470e5ca service nova] Creating event network-vif-plugged:c142475e-a40d-4056-8755-94d0e7cfcdce for instance 411f1459-d726-442a-9554-3f1941d5cf58 on nch2-master-1 Jul 30 21:38:34.748124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-625e0838-7c3f-450c-9c1f-cf366099c30e req-0528b17f-3c82-4960-8493-f256b470e5ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Jul 30 21:38:34.749795 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3019/5988] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:38:35.300254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:35.300910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:35.308941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:35.309424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:35.310239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:35.310716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:35.448814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:35.456448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fc5958c-8ff5-4a6b-a688-834347b4b94b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1375 microversion: 2.1 time: 0.160299 Jul 30 21:38:35.457030 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2970/5989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:35 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:36.478618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:36.479396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:36.486531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.486992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.487803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.488252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.618278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:36.626798 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2996911c-9ea3-4f51-b6eb-90320033b82b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1562 microversion: 2.1 time: 0.153440 Jul 30 21:38:36.627389 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3020/5990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:36 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:36.646759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:36.647452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:36.654493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.654982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.655833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.656311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.786930 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:36.795215 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0cb28afd-c92c-4084-81dd-2e40a7737989 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1562 microversion: 2.1 time: 0.152420 Jul 30 21:38:36.795838 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2971/5991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:36 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:36.871517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:36.872039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:36.878426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.878874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.879692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:36.880148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:36.908449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:38:36.988260 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 204 len: 0 microversion: 2.1 time: 0.120351 Jul 30 21:38:36.988845 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3021/5992] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:38:36 2022] DELETE /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:38:37.001430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:37.002297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:37.010379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:37.011245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:37.012731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:37.013641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:37.177398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:37.186172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a363f7c1-7cee-4aa5-a60c-94c208298e76 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1568 microversion: 2.1 time: 0.192697 Jul 30 21:38:37.186808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2972/5993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:36 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:38.209685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:38.210329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:38.217708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:38.218179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:38.218970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:38.219467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:38.351934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:38.360242 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f9fb657-fff2-42bf-a15d-1aec2c8deb2c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1568 microversion: 2.1 time: 0.155012 Jul 30 21:38:38.360806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3022/5994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:38 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:39.198430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f0b82d21-8b79-4629-8cee-941b37374ccd req-559b2c16-650d-4b70-bd5c-a8cecc5b981c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411f1459-d726-442a-9554-3f1941d5cf58", "name": "network-vif-deleted", "tag": "c142475e-a40d-4056-8755-94d0e7cfcdce"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:38:39.215473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:39.224401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0b82d21-8b79-4629-8cee-941b37374ccd req-559b2c16-650d-4b70-bd5c-a8cecc5b981c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:39.225062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0b82d21-8b79-4629-8cee-941b37374ccd req-559b2c16-650d-4b70-bd5c-a8cecc5b981c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:39.240139 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f0b82d21-8b79-4629-8cee-941b37374ccd req-559b2c16-650d-4b70-bd5c-a8cecc5b981c service nova] Creating event network-vif-deleted:c142475e-a40d-4056-8755-94d0e7cfcdce for instance 411f1459-d726-442a-9554-3f1941d5cf58 on nch2-master-1 Jul 30 21:38:39.254376 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f0b82d21-8b79-4629-8cee-941b37374ccd req-559b2c16-650d-4b70-bd5c-a8cecc5b981c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058897 Jul 30 21:38:39.254477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2973/5995] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:38:39.381167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:39.381934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:39.390707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:39.391544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:39.392420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:39.392967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:39.474774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:38:39.486584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f20e9a3c-2b24-4f8f-bc58-94365bb11e1b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 200 len: 1360 microversion: 2.1 time: 0.109733 Jul 30 21:38:39.487193 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3023/5996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:39 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 1360 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:38:40.508806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:38:40.509531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:38:40.516326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:40.516801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:40.517599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:38:40.518061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:38:40.534754 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 HTTP/1.1 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '411f1459-d726-442a-9554-3f1941d5cf58'} Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:38:40.536600 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d37f94a2-c7a2-411a-8613-18b54b5fa0ff tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 404 len: 111 microversion: 2.1 time: 0.034473 Jul 30 21:38:40.540594 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2974/5997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:38:40 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:11.550840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:11.551437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:11.553653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:11.554536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:11.561121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:11.561595 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:11.562396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:11.562861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:11.590236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:39:11.663787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 204 len: 0 microversion: 2.1 time: 0.116857 Jul 30 21:39:11.664383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3024/5998] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:39:11 2022] DELETE /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:39:11.673419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:11.674058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:11.676648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:11.677318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=61 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:11.683538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:11.684017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:11.684802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:11.685262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:11.817664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:11.825441 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4062dcb6-16c6-4824-b4b7-ab8c718fb6bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1409 microversion: 2.1 time: 0.155930 Jul 30 21:39:11.826010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2975/5999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:11 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:39:12.846566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:12.847370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:12.854371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:12.854850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:12.855672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:12.856128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:12.993007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:13.001623 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-16d349b1-9dea-4a8b-9434-176cabd6d2c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1409 microversion: 2.1 time: 0.159360 Jul 30 21:39:13.002201 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3025/6000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:12 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:13.671445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7baa9acf-cbb5-4fe8-949d-d0d08e19cb34 req-a69162b0-716b-4aa2-95ea-1bdd20c02ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bf8830-55dc-41ed-9c45-e56350313db6", "name": "network-vif-deleted", "tag": "8f8f8f13-1298-4221-ac39-a2db5027a711"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:13.683868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7baa9acf-cbb5-4fe8-949d-d0d08e19cb34 req-a69162b0-716b-4aa2-95ea-1bdd20c02ccb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:13.684340 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7baa9acf-cbb5-4fe8-949d-d0d08e19cb34 req-a69162b0-716b-4aa2-95ea-1bdd20c02ccb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:13.696787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7baa9acf-cbb5-4fe8-949d-d0d08e19cb34 req-a69162b0-716b-4aa2-95ea-1bdd20c02ccb service nova] Creating event network-vif-deleted:8f8f8f13-1298-4221-ac39-a2db5027a711 for instance 75bf8830-55dc-41ed-9c45-e56350313db6 on nch2-master-1 Jul 30 21:39:13.702141 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7baa9acf-cbb5-4fe8-949d-d0d08e19cb34 req-a69162b0-716b-4aa2-95ea-1bdd20c02ccb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Jul 30 21:39:13.702745 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2976/6001] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:39:14.023691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:14.029282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:14.043698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:14.044210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:14.045336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:14.045937 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:14.083941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:14.084416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:14.085064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lazy-loading 'fault' on Instance uuid 75bf8830-55dc-41ed-9c45-e56350313db6 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:39:14.131120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:14.139922 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d9ef3798-5d0c-42c8-b297-5389df0a5fae tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 200 len: 1207 microversion: 2.1 time: 0.120816 Jul 30 21:39:14.140509 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3026/6002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:14 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 1207 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:15.163327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:15.163989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:15.173549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.174048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.174866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.175368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.190210 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 HTTP/1.1 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '75bf8830-55dc-41ed-9c45-e56350313db6'} Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.192405 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b3fad1a-d1ba-4408-a3da-175a8c78d8b3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 404 len: 111 microversion: 2.1 time: 0.035876 Jul 30 21:39:15.196748 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2977/6003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:15 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:15.224523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:15.225043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:15.232735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.233207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.233995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.234452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.247993 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 HTTP/1.1 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '411f1459-d726-442a-9554-3f1941d5cf58'} Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:39:15.249709 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-148f4408-258c-4841-b690-b747f8735d9c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 404 len: 111 microversion: 2.1 time: 0.030720 Jul 30 21:39:15.254762 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3027/6004] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:39:15 2022] DELETE /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:15.260242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:15.260894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 411f1459-d726-442a-9554-3f1941d5cf58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:15.267157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.267745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.268497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.268971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.282990 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 HTTP/1.1 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '411f1459-d726-442a-9554-3f1941d5cf58'} Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.284620 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 411f1459-d726-442a-9554-3f1941d5cf58 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2eda990a-4e62-4bb0-b1ed-4fc328d56710 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58" status: 404 len: 111 microversion: 2.1 time: 0.029919 Jul 30 21:39:15.288766 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2978/6005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:15 2022] GET /compute/v2.1/servers/411f1459-d726-442a-9554-3f1941d5cf58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:15.761257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:15.761779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:15.767894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.768348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.769166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.769618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.787015 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 HTTP/1.1 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '75bf8830-55dc-41ed-9c45-e56350313db6'} Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:39:15.788600 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5d5221a-aa98-4e83-bd9e-f496cb975b52 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 404 len: 111 microversion: 2.1 time: 0.033240 Jul 30 21:39:15.792862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3028/6006] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:39:15 2022] DELETE /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:15.798799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:15.799502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 75bf8830-55dc-41ed-9c45-e56350313db6] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:15.805734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.806224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.807032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:15.807540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:15.821034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 HTTP/1.1 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '75bf8830-55dc-41ed-9c45-e56350313db6'} Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:39:15.823079 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 75bf8830-55dc-41ed-9c45-e56350313db6 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bfcea49d-7494-4dd7-9c76-37fe72f7b729 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jul 30 21:39:15.827153 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2979/6007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:15 2022] GET /compute/v2.1/servers/75bf8830-55dc-41ed-9c45-e56350313db6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:39:15.901616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7150bef0-4690-4df3-a4c7-bc0da18665b1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: .version_select at 0x7fbb5d3890d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-159368749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxJU0U0x7CAwAizMcs40yG6y6UvGM/E9jrf/WBzjdUh1NL8/vjQ0aJTeZOvPONvsK2ej+WI2OO7nUnSMlKmG81pM/yYP6J5jgFt7JyeLmmSmx8dt9olVHAP3YJ0QRH4cA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:15.917058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7150bef0-4690-4df3-a4c7-bc0da18665b1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:39:15.922241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-7150bef0-4690-4df3-a4c7-bc0da18665b1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:39:15.945736 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7150bef0-4690-4df3-a4c7-bc0da18665b1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048691 Jul 30 21:39:15.946333 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3029/6008] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:39:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:39:18.491549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-679229445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159368749", "security_groups": [{"name": "tempest-secgroup-smoke-2067208921"}], "block_device_mapping_v2": [{"uuid": "2d47a2ac-e152-4e83-b953-0485a902e560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:18.612021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:39:18.973328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:39:18.973790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:39:18.974300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:39:18.974745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:39:18.975226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:39:18.984998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:18.985491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:18.986442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:18.986927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:19.004407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:39:19.009825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:39:19.068368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:39:19.070529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d47a2ac-e152-4e83-b953-0485a902e560',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:39:19.195926 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708295 Jul 30 21:39:19.196577 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2980/6009] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:39:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:39:19.208456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-471ddd58-836d-44be-8e59-94b3f0d093f5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:19.209085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-471ddd58-836d-44be-8e59-94b3f0d093f5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:19.265888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-471ddd58-836d-44be-8e59-94b3f0d093f5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:19.272932 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-471ddd58-836d-44be-8e59-94b3f0d093f5 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1093 microversion: 2.1 time: 0.069458 Jul 30 21:39:19.273511 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3030/6010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:19 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:20.294709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:20.294709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:20.303436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:20.304572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:20.305497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:20.306350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:20.375192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:20.384111 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b9a1e68-5502-4755-933e-1f4e9497f46e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1209 microversion: 2.1 time: 0.093963 Jul 30 21:39:20.384866 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2981/6011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:20 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:21.406329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:21.407182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:21.414272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:21.414828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:21.415644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:21.416130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:21.453082 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3a604fb1-015d-4358-a704-ece33a1da77c req-45a5991b-461e-4d7f-84df-95f57cc039c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594747fb-8d67-4006-8c15-25cb428a347f", "tag": "0c185e38-7bf1-4b8b-b5b8-9f600f050b20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:21.462951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3a604fb1-015d-4358-a704-ece33a1da77c req-45a5991b-461e-4d7f-84df-95f57cc039c4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:21.464173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3a604fb1-015d-4358-a704-ece33a1da77c req-45a5991b-461e-4d7f-84df-95f57cc039c4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:21.476149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3a604fb1-015d-4358-a704-ece33a1da77c req-45a5991b-461e-4d7f-84df-95f57cc039c4 service nova] Creating event network-changed:0c185e38-7bf1-4b8b-b5b8-9f600f050b20 for instance 594747fb-8d67-4006-8c15-25cb428a347f on nch2-master-1 Jul 30 21:39:21.481420 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3a604fb1-015d-4358-a704-ece33a1da77c req-45a5991b-461e-4d7f-84df-95f57cc039c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033809 Jul 30 21:39:21.482248 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2982/6012] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:39:22.014383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:22.021960 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40a95283-15de-434c-9871-f1ca3644eed4 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.619733 Jul 30 21:39:22.022505 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3031/6013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:21 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:23.045650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:23.046509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:23.053037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:23.053515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:23.054314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:23.054775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:23.198532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:23.206280 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0923a273-bcca-44de-a90e-683804bc9228 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.166598 Jul 30 21:39:23.206882 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2983/6014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:23 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:24.227168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:24.227827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:24.235012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:24.235527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:24.236315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:24.236774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:24.371692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:24.379749 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dd2287d8-f093-4f36-b68e-65e98bf9b9c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.156524 Jul 30 21:39:24.380330 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3032/6015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:24 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:25.401220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:25.402012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:25.409177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:25.409668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:25.410473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:25.410945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:25.541884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:25.549632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d5b5294-6981-4077-8809-15230cbf923b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.152923 Jul 30 21:39:25.550212 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2984/6016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:25 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:26.570934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:26.572156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:26.581302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:26.582043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:26.583309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:26.584021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:26.716415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:26.724018 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0fa36cbd-b1f6-453a-a5ff-ed772bf92f97 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.157349 Jul 30 21:39:26.724596 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3033/6017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:26 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:39:26.943664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-e8717ed7-239c-478f-a790-ed1d13311955 req-89997ab7-a1d2-4048-a4c3-8428481282b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594747fb-8d67-4006-8c15-25cb428a347f", "name": "network-vif-plugged", "status": "completed", "tag": "0c185e38-7bf1-4b8b-b5b8-9f600f050b20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:26.957366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e8717ed7-239c-478f-a790-ed1d13311955 req-89997ab7-a1d2-4048-a4c3-8428481282b1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:26.957851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-e8717ed7-239c-478f-a790-ed1d13311955 req-89997ab7-a1d2-4048-a4c3-8428481282b1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:26.969288 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-e8717ed7-239c-478f-a790-ed1d13311955 req-89997ab7-a1d2-4048-a4c3-8428481282b1 service nova] Creating event network-vif-plugged:0c185e38-7bf1-4b8b-b5b8-9f600f050b20 for instance 594747fb-8d67-4006-8c15-25cb428a347f on nch2-master-1 Jul 30 21:39:26.974912 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-e8717ed7-239c-478f-a790-ed1d13311955 req-89997ab7-a1d2-4048-a4c3-8428481282b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035147 Jul 30 21:39:26.975818 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2985/6018] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:39:27.745064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:27.745619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:27.752966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:27.753439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:27.754228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:27.754687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:27.888929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:27.896609 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e4b7be00-8814-4561-a9fd-5488d800414c tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1265 microversion: 2.1 time: 0.156126 Jul 30 21:39:27.897194 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3034/6019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:27 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:28.917152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:28.917889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:28.925316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:28.925754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:28.926584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:28.927055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:28.994887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:29.016749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:29.064223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:29.072559 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cebdae0d-1a83-4e0e-8a7d-32f8d8d075b2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1451 microversion: 2.1 time: 0.159757 Jul 30 21:39:29.073147 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2986/6020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:28 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:29.094485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:39:29.095120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:39:29.102229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:29.102697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:29.103552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:29.104007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:29.235677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:39:29.243627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98756194-8ec8-4d45-97f5-f23e3ce7c1db tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1451 microversion: 2.1 time: 0.153026 Jul 30 21:39:29.244207 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3035/6021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:39:29 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:39:31.021980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b74a3763-3129-4504-a643-65dff82c806f req-e414bc8a-3232-4d0c-9b00-af08c13313d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594747fb-8d67-4006-8c15-25cb428a347f", "tag": "0c185e38-7bf1-4b8b-b5b8-9f600f050b20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:39:31.032260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b74a3763-3129-4504-a643-65dff82c806f req-e414bc8a-3232-4d0c-9b00-af08c13313d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:39:31.032732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b74a3763-3129-4504-a643-65dff82c806f req-e414bc8a-3232-4d0c-9b00-af08c13313d3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:39:31.044562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b74a3763-3129-4504-a643-65dff82c806f req-e414bc8a-3232-4d0c-9b00-af08c13313d3 service nova] Creating event network-changed:0c185e38-7bf1-4b8b-b5b8-9f600f050b20 for instance 594747fb-8d67-4006-8c15-25cb428a347f on nch2-master-1 Jul 30 21:39:31.049518 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b74a3763-3129-4504-a643-65dff82c806f req-e414bc8a-3232-4d0c-9b00-af08c13313d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Jul 30 21:39:31.050132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2987/6022] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:41:35.784527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:35.785468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:35.786224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:35.790590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:35.791134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:35.800856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:35.801318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:35.802101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:35.802550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:35.832522 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:41:35.894939 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [095607c8-8532-4803-83b4-f062521275a7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 21:41:36.902107 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [095607c8-8532-4803-83b4-f062521275a7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 51686. Jul 30 21:41:36.922368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-862f0920-066e-43b4-81af-b902bffb2476 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 204 len: 0 microversion: 2.1 time: 1.139774 Jul 30 21:41:36.923130 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3036/6023] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:41:35 2022] DELETE /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:41:36.930133 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 21:41:36.931175 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 30 21:41:36.931822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:36.932666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=46 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:36.937764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:36.938489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:36.946427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:36.946905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:36.947725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:36.948186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:37.211163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:37.218871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4b213c59-cbf2-4e3f-b03e-d678dd0579c6 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1575 microversion: 2.1 time: 0.290877 Jul 30 21:41:37.219459 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2988/6024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:36 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1575 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:41:38.240812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:38.241533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:38.250071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:38.250481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:38.251269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:38.251752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:38.843238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:38.850981 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3c1d331-8d13-41f6-8f36-0067664864e2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1575 microversion: 2.1 time: 0.614639 Jul 30 21:41:38.851739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3037/6025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:38 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1575 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:39.571155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b1459c23-b2ac-4e59-a4fd-cfb9488ee628 req-944b26a0-8b0f-433e-ba4f-3d89efc49037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594747fb-8d67-4006-8c15-25cb428a347f", "name": "network-vif-deleted", "tag": "0c185e38-7bf1-4b8b-b5b8-9f600f050b20"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:41:39.583358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1459c23-b2ac-4e59-a4fd-cfb9488ee628 req-944b26a0-8b0f-433e-ba4f-3d89efc49037 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:39.583915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b1459c23-b2ac-4e59-a4fd-cfb9488ee628 req-944b26a0-8b0f-433e-ba4f-3d89efc49037 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:39.597768 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 51706. Jul 30 21:41:39.600447 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b1459c23-b2ac-4e59-a4fd-cfb9488ee628 req-944b26a0-8b0f-433e-ba4f-3d89efc49037 service nova] Creating event network-vif-deleted:0c185e38-7bf1-4b8b-b5b8-9f600f050b20 for instance 594747fb-8d67-4006-8c15-25cb428a347f on nch2-master-1 Jul 30 21:41:39.604367 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 51704. Jul 30 21:41:39.606617 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b1459c23-b2ac-4e59-a4fd-cfb9488ee628 req-944b26a0-8b0f-433e-ba4f-3d89efc49037 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 Jul 30 21:41:39.607233 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2989/6026] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:41:39.872929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:39.873566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:39.880992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:39.881490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:39.882285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:39.882747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:39.914895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:39.915402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:39.915877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lazy-loading 'fault' on Instance uuid 594747fb-8d67-4006-8c15-25cb428a347f {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:41:39.958269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:39.966545 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5bcc0417-ae48-48d2-a364-31d9fe96fb14 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 200 len: 1229 microversion: 2.1 time: 0.097698 Jul 30 21:41:39.967183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3038/6027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:39 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:40.989816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:40.990477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:40.997142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:40.997960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:40.998417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:40.998881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:41.013314 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f HTTP/1.1 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '594747fb-8d67-4006-8c15-25cb428a347f'} Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:41:41.014995 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-667ebf5f-553e-4237-9c0b-d1b0a481f187 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 404 len: 111 microversion: 2.1 time: 0.032548 Jul 30 21:41:41.020236 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2990/6028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:40 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:41:41.065004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-993828643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159368749", "security_groups": [{"name": "tempest-secgroup-smoke-2067208921"}], "block_device_mapping_v2": [{"uuid": "2d47a2ac-e152-4e83-b953-0485a902e560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:41:41.181260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:41:41.555587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:41:41.556093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:41:41.556623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:41:41.557087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:41:41.557526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:41:41.567862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:41.568336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:41.569163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:41.569623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:41.586780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:41:41.592055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:41:41.650210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:41:41.652383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d47a2ac-e152-4e83-b953-0485a902e560',volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:41:41.784088 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-606d5196-70ff-437a-b172-093327c38c6d tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723544 Jul 30 21:41:41.784765 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3039/6029] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:41:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 21:41:41.795837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fb2b77d8-cde8-4ec3-aa8c-e72090f0e2cb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:41.796493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fb2b77d8-cde8-4ec3-aa8c-e72090f0e2cb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:41.850557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fb2b77d8-cde8-4ec3-aa8c-e72090f0e2cb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:41.857533 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fb2b77d8-cde8-4ec3-aa8c-e72090f0e2cb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1093 microversion: 2.1 time: 0.065575 Jul 30 21:41:41.858107 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2991/6030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:41 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:42.880333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:42.881215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:42.894278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:42.895205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:42.896611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:42.897190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:42.972416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:42.980550 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28f029b1-87e9-42b4-81e2-1833b495684b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1209 microversion: 2.1 time: 0.106423 Jul 30 21:41:42.981392 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3040/6031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:42 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:44.003655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:44.004497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:44.013385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:44.013957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:44.014854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:44.015509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:44.162510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:44.172310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b14c1b86-6e1c-4ce2-a04d-0651133fd234 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.173300 Jul 30 21:41:44.173066 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2992/6032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:43 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:44.198854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-5c1bad3c-b078-4cc4-9e95-03e7a200f820 req-eb84c3d9-0ffc-4afe-820d-17a42db3c963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970618c5-1f0c-4960-9d9f-955c7d0bc10d", "tag": "58312c7c-973b-4a77-aa3d-2cb3b99dab0a"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:41:44.212126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5c1bad3c-b078-4cc4-9e95-03e7a200f820 req-eb84c3d9-0ffc-4afe-820d-17a42db3c963 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:44.212593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-5c1bad3c-b078-4cc4-9e95-03e7a200f820 req-eb84c3d9-0ffc-4afe-820d-17a42db3c963 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:44.227780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-5c1bad3c-b078-4cc4-9e95-03e7a200f820 req-eb84c3d9-0ffc-4afe-820d-17a42db3c963 service nova] Creating event network-changed:58312c7c-973b-4a77-aa3d-2cb3b99dab0a for instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d on nch2-master-1 Jul 30 21:41:44.232974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-5c1bad3c-b078-4cc4-9e95-03e7a200f820 req-eb84c3d9-0ffc-4afe-820d-17a42db3c963 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047922 Jul 30 21:41:44.233853 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3041/6033] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:41:45.194505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:45.195242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:45.202905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:45.203418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:45.204222 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:45.204685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:45.339138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:45.347513 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cfb8c38f-f59f-4812-9107-fe4b6cde5b47 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.156931 Jul 30 21:41:45.348089 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2993/6034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:45 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:46.369204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:46.369955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:46.377447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:46.377926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:46.378801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:46.379267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:46.513790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:46.521461 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abd1b446-0433-4918-876d-351d4ccc7e38 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.156761 Jul 30 21:41:46.522045 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3042/6035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:46 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:47.543196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:47.543872 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:47.550504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:47.550990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:47.551832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:47.552307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:47.690462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:47.698102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0362a5d1-dd4d-4318-886a-5084d2e8cdac tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.159884 Jul 30 21:41:47.698674 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2994/6036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:47 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:48.718639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:48.719197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:48.725967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:48.726425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:48.727197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:48.727667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:48.863054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:48.870722 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5d0bb3c-81bf-438d-bf0c-70b5105f9325 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.156339 Jul 30 21:41:48.871317 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3043/6037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:48 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:49.571580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-34a6e17e-b249-4ba9-be3c-ac21485aa824 req-205ba42b-4897-409b-b5a2-fbcc4dcd8c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970618c5-1f0c-4960-9d9f-955c7d0bc10d", "name": "network-vif-plugged", "status": "completed", "tag": "58312c7c-973b-4a77-aa3d-2cb3b99dab0a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:41:49.582537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-34a6e17e-b249-4ba9-be3c-ac21485aa824 req-205ba42b-4897-409b-b5a2-fbcc4dcd8c62 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:49.583013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-34a6e17e-b249-4ba9-be3c-ac21485aa824 req-205ba42b-4897-409b-b5a2-fbcc4dcd8c62 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:49.594831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-34a6e17e-b249-4ba9-be3c-ac21485aa824 req-205ba42b-4897-409b-b5a2-fbcc4dcd8c62 service nova] Creating event network-vif-plugged:58312c7c-973b-4a77-aa3d-2cb3b99dab0a for instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d on nch2-master-1 Jul 30 21:41:49.599882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-34a6e17e-b249-4ba9-be3c-ac21485aa824 req-205ba42b-4897-409b-b5a2-fbcc4dcd8c62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032272 Jul 30 21:41:49.600477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2995/6038] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:41:49.896173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:49.896808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:49.903929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:49.904403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:49.905192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:49.905648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:50.039790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:50.047746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76dc69d6-87e6-4f3c-874f-151a3b6154ed tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1265 microversion: 2.1 time: 0.155445 Jul 30 21:41:50.048364 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3044/6039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:49 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:41:51.069995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:51.070783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:51.077150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:51.077629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:51.078495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:51.079003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:51.209299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:51.217055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3ec262f-0593-4886-822a-d25e4362674e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1451 microversion: 2.1 time: 0.152201 Jul 30 21:41:51.217620 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2996/6040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:51 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:41:51.238265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:41:51.238911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:41:51.246036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:51.246508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:51.247308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:51.247776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:51.376964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:41:51.384934 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c143a02e-d943-4bde-ac62-b3ae64cea48e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1451 microversion: 2.1 time: 0.150650 Jul 30 21:41:51.385512 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3045/6041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:41:51 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:41:53.288373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:53.295899 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-760fc67c-dfb3-4d15-a7f1-0ac19f962a14 req-4a83b804-b554-4257-8e98-bc23b47a24e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970618c5-1f0c-4960-9d9f-955c7d0bc10d", "tag": "58312c7c-973b-4a77-aa3d-2cb3b99dab0a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:41:53.306581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-760fc67c-dfb3-4d15-a7f1-0ac19f962a14 req-4a83b804-b554-4257-8e98-bc23b47a24e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:41:53.307323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-760fc67c-dfb3-4d15-a7f1-0ac19f962a14 req-4a83b804-b554-4257-8e98-bc23b47a24e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:41:53.320320 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-760fc67c-dfb3-4d15-a7f1-0ac19f962a14 req-4a83b804-b554-4257-8e98-bc23b47a24e3 service nova] Creating event network-changed:58312c7c-973b-4a77-aa3d-2cb3b99dab0a for instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d on nch2-master-1 Jul 30 21:41:53.326095 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-760fc67c-dfb3-4d15-a7f1-0ac19f962a14 req-4a83b804-b554-4257-8e98-bc23b47a24e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038457 Jul 30 21:41:53.326885 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2997/6042] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:41:57.551734 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:41:57.557291 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:43:36.304931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:36.305717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:36.306544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:36.307506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:36.312858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1356090886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159368749", "security_groups": [{"name": "tempest-secgroup-smoke-2067208921"}], "block_device_mapping_v2": [{"uuid": "5412cf53-2389-453b-9c5e-00272002546c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3b147ad-0993-4d46-9fc9-908f71543d3b"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:43:36.435577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] validate_networks() for [('c3b147ad-0993-4d46-9fc9-908f71543d3b', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:43:36.870710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:43:36.871201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:43:36.871718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:43:36.872139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:43:36.872585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:43:36.881938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:36.882495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:36.883354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:36.884067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:36.902765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:43:36.910854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Getting quotas for user e062653d52144a3a91277e045033f27a and project cc59858bd4e749cab7d1d772d65e4111. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:43:36.980319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:43:36.982434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5412cf53-2389-453b-9c5e-00272002546c',volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:43:37.119397 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-942c0eb5-7685-4e66-9a6d-1828e0729479 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815670 Jul 30 21:43:37.120272 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3046/6043] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:43:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:43:37.130056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=22 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:37.131498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=38 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:37.137277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03f0bd7a-305a-4408-b26c-ee1f98c37344 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:37.138028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03f0bd7a-305a-4408-b26c-ee1f98c37344 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:37.195079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03f0bd7a-305a-4408-b26c-ee1f98c37344 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:37.203336 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03f0bd7a-305a-4408-b26c-ee1f98c37344 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1094 microversion: 2.1 time: 0.075673 Jul 30 21:43:37.205115 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2998/6044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:37 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:38.224825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:38.225462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:38.236832 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:38.237426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:38.238241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:38.238701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:38.315325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:38.323824 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90c64d98-a835-4291-9a53-cd05c91d8ce9 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1210 microversion: 2.1 time: 0.102992 Jul 30 21:43:38.324403 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3047/6045] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:38 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:39.072757 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:43:39.073546 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 21:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:43:39.348826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:39.350114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:39.360527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:39.361236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:39.362160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:39.362729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:39.576152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:39.584772 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d71485e-b13f-4471-a87e-f31452c01b80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.243125 Jul 30 21:43:39.585422 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 2999/6046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:39 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:39.741152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d6fef093-28e8-4c9f-b026-da4743e79ecd req-8ffb123e-4233-4824-b158-b844bc397125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4fb1bf8-9a10-4f47-8f1d-f383ec912601", "tag": "df1c0b28-f635-40f2-a444-eba4b267374b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:43:39.751860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6fef093-28e8-4c9f-b026-da4743e79ecd req-8ffb123e-4233-4824-b158-b844bc397125 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:39.752316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d6fef093-28e8-4c9f-b026-da4743e79ecd req-8ffb123e-4233-4824-b158-b844bc397125 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:39.763131 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d6fef093-28e8-4c9f-b026-da4743e79ecd req-8ffb123e-4233-4824-b158-b844bc397125 service nova] Creating event network-changed:df1c0b28-f635-40f2-a444-eba4b267374b for instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 on nch1-master-1 Jul 30 21:43:39.768839 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d6fef093-28e8-4c9f-b026-da4743e79ecd req-8ffb123e-4233-4824-b158-b844bc397125 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106093 Jul 30 21:43:39.769851 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3048/6047] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:43:40.606366 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:40.607015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:40.613433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:40.613923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:40.614730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:40.615203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:41.141663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:41.149569 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-634b59a3-3132-4996-8fff-8396ce74b19e tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.547344 Jul 30 21:43:41.150166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3000/6048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:40 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:42.172376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:42.173094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:42.179544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:42.180022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:42.180801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:42.181251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:42.315690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:42.323349 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d826f78-a759-459d-ab64-780c41bb4e6b tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.157057 Jul 30 21:43:42.323933 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3049/6049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:42 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:43.346311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:43.346960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:43.354109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:43.354595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:43.355427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:43.355905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:43.490164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:43.497843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7af9e996-8906-46f0-87b9-bbef75e44aa1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.156825 Jul 30 21:43:43.498416 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3001/6050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:43 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:44.518028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:44.518673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:44.525894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:44.526369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:44.527157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:44.527648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:44.658281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:44.665910 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-090ab171-55e9-4b19-81c6-db8cf26fe7f2 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.151862 Jul 30 21:43:44.666486 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3050/6051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:44 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:45.686189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:45.687508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:45.694470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:45.694955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:45.695785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:45.696251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:45.794924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-09b23464-07f3-4edd-92d4-f9bacf919fb5 req-1844cabe-7fb7-4f6f-b40c-13b1a1923375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fb1bf8-9a10-4f47-8f1d-f383ec912601", "name": "network-vif-plugged", "status": "completed", "tag": "df1c0b28-f635-40f2-a444-eba4b267374b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:43:45.806788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09b23464-07f3-4edd-92d4-f9bacf919fb5 req-1844cabe-7fb7-4f6f-b40c-13b1a1923375 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:45.808038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09b23464-07f3-4edd-92d4-f9bacf919fb5 req-1844cabe-7fb7-4f6f-b40c-13b1a1923375 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:45.820656 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-09b23464-07f3-4edd-92d4-f9bacf919fb5 req-1844cabe-7fb7-4f6f-b40c-13b1a1923375 service nova] Creating event network-vif-plugged:df1c0b28-f635-40f2-a444-eba4b267374b for instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 on nch1-master-1 Jul 30 21:43:45.825637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-09b23464-07f3-4edd-92d4-f9bacf919fb5 req-1844cabe-7fb7-4f6f-b40c-13b1a1923375 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112357 Jul 30 21:43:45.826600 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3051/6052] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:43:45.848373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:45.856160 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d70d05c-8cc1-4f7e-87a8-6e96cffa362a tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.173970 Jul 30 21:43:45.856921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3002/6053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:45 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:46.878177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:46.878884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:46.885730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:46.886192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:46.887013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:46.887500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:46.892776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:46.920262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:47.034006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:47.041689 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-12f5b331-a1b5-417b-921e-cf79fa260802 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1266 microversion: 2.1 time: 0.168608 Jul 30 21:43:47.042267 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3052/6054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:46 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:48.063902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:48.064551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:48.067409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:48.073238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:48.073726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:48.074533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:48.075013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:48.208620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:48.216585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8c66d7c8-d66a-4373-a89c-b1541d053eaa tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1453 microversion: 2.1 time: 0.156659 Jul 30 21:43:48.217198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3003/6055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:48 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:48.237333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:43:48.237969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:43:48.245139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:48.245868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:48.247135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:48.247800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:48.379915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:43:48.388491 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e5fea0e-6ee1-4e83-9b27-9f1bd630bf4f tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1453 microversion: 2.1 time: 0.155089 Jul 30 21:43:48.389258 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3053/6056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:43:48 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:43:49.979389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-59f483cb-30c2-4856-8a29-3d6763be8778 req-a65964cd-d8b3-47a4-819a-ec8a8513bf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4fb1bf8-9a10-4f47-8f1d-f383ec912601", "tag": "df1c0b28-f635-40f2-a444-eba4b267374b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:43:49.990247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-59f483cb-30c2-4856-8a29-3d6763be8778 req-a65964cd-d8b3-47a4-819a-ec8a8513bf06 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:43:49.990717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-59f483cb-30c2-4856-8a29-3d6763be8778 req-a65964cd-d8b3-47a4-819a-ec8a8513bf06 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:43:50.002309 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-59f483cb-30c2-4856-8a29-3d6763be8778 req-a65964cd-d8b3-47a4-819a-ec8a8513bf06 service nova] Creating event network-changed:df1c0b28-f635-40f2-a444-eba4b267374b for instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 on nch1-master-1 Jul 30 21:43:50.007788 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-59f483cb-30c2-4856-8a29-3d6763be8778 req-a65964cd-d8b3-47a4-819a-ec8a8513bf06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032170 Jul 30 21:43:50.011643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3004/6057] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:45:17.565686 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:45:17.566367 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:45:18.659744 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:45:18.660368 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 21:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:45:26.932622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:26.934002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=36 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:26.934189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=16 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:26.935062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:26.938506 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:45:26.939381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:45:26.940341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2ce4a2a9-4f6b-4212-8df6-9b058a82e172 req-33fcd825-7ff0-485b-9592-c5b75d29e673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4fb1bf8-9a10-4f47-8f1d-f383ec912601", "tag": "df1c0b28-f635-40f2-a444-eba4b267374b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:45:26.947446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:26.948332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:26.949121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:26.949796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:26.953851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2ce4a2a9-4f6b-4212-8df6-9b058a82e172 req-33fcd825-7ff0-485b-9592-c5b75d29e673 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:26.954404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2ce4a2a9-4f6b-4212-8df6-9b058a82e172 req-33fcd825-7ff0-485b-9592-c5b75d29e673 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:26.966368 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2ce4a2a9-4f6b-4212-8df6-9b058a82e172 req-33fcd825-7ff0-485b-9592-c5b75d29e673 service nova] Creating event network-changed:df1c0b28-f635-40f2-a444-eba4b267374b for instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 on nch1-master-1 Jul 30 21:45:26.971945 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2ce4a2a9-4f6b-4212-8df6-9b058a82e172 req-33fcd825-7ff0-485b-9592-c5b75d29e673 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041306 Jul 30 21:45:26.972735 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3005/6058] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:45:26.980777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:45:27.076663 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 204 len: 0 microversion: 2.1 time: 0.146429 Jul 30 21:45:27.077323 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3054/6059] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:45:26 2022] DELETE /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:45:27.087718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:45:27.088560 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:45:27.095971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:27.096542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:27.097519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:27.098106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:27.255417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:45:27.263796 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-167d5d6f-b61e-4f24-8b7f-6b44b2e2ac80 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1578 microversion: 2.1 time: 0.181468 Jul 30 21:45:27.264376 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3006/6060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:45:27 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:45:28.286596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:45:28.287454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:45:28.298901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:28.299385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:28.300165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:28.300614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:28.439702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:45:28.448920 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6024a15d-c63a-4b7f-8cce-6a77869fd319 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1578 microversion: 2.1 time: 0.166492 Jul 30 21:45:28.449758 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3055/6061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:45:28 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:45:29.031571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-778b82ab-2785-4ba6-a668-faf44162d61b req-0a6f0c0e-aa30-4e07-9231-844442985f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fb1bf8-9a10-4f47-8f1d-f383ec912601", "name": "network-vif-deleted", "tag": "df1c0b28-f635-40f2-a444-eba4b267374b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:45:29.045543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-778b82ab-2785-4ba6-a668-faf44162d61b req-0a6f0c0e-aa30-4e07-9231-844442985f19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:29.046028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-778b82ab-2785-4ba6-a668-faf44162d61b req-0a6f0c0e-aa30-4e07-9231-844442985f19 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:29.060724 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-778b82ab-2785-4ba6-a668-faf44162d61b req-0a6f0c0e-aa30-4e07-9231-844442985f19 service nova] Creating event network-vif-deleted:df1c0b28-f635-40f2-a444-eba4b267374b for instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 on nch1-master-1 Jul 30 21:45:29.066015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-778b82ab-2785-4ba6-a668-faf44162d61b req-0a6f0c0e-aa30-4e07-9231-844442985f19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038488 Jul 30 21:45:29.066612 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3007/6062] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:45:29.470675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:45:29.471491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:45:29.479236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:29.479746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:29.480630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:29.481091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:29.514106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:29.514575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:29.515057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lazy-loading 'fault' on Instance uuid d4fb1bf8-9a10-4f47-8f1d-f383ec912601 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:45:29.559548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:45:29.566770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5ee56f96-9bf3-4142-a911-d9d763733fa3 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 200 len: 1184 microversion: 2.1 time: 0.100426 Jul 30 21:45:29.567364 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3056/6063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:45:29 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:45:30.591871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:45:30.592599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: d4fb1bf8-9a10-4f47-8f1d-f383ec912601] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:45:30.600062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:30.600535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:30.601324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:45:30.601820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:45:30.615562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 HTTP/1.1 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'd4fb1bf8-9a10-4f47-8f1d-f383ec912601'} Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:45:30.617264 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance d4fb1bf8-9a10-4f47-8f1d-f383ec912601 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8aa2448a-99f4-497d-9923-c3237c91b8c8 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601" status: 404 len: 111 microversion: 2.1 time: 0.031190 Jul 30 21:45:30.621756 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3008/6064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:45:30 2022] GET /compute/v2.1/servers/d4fb1bf8-9a10-4f47-8f1d-f383ec912601 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:03.552491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:03.553666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:03.555137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-92b6ba54-de6e-4c01-a0d5-ec7997f117f2 req-f4c6a080-ec19-418f-9a05-c72a54fdfd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970618c5-1f0c-4960-9d9f-955c7d0bc10d", "tag": "58312c7c-973b-4a77-aa3d-2cb3b99dab0a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:03.557658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:03.558503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:03.561625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:03.562378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:03.563518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:03.564018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:03.564893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:03.565354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:03.574740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-92b6ba54-de6e-4c01-a0d5-ec7997f117f2 req-f4c6a080-ec19-418f-9a05-c72a54fdfd4e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:03.575226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-92b6ba54-de6e-4c01-a0d5-ec7997f117f2 req-f4c6a080-ec19-418f-9a05-c72a54fdfd4e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:03.586867 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-92b6ba54-de6e-4c01-a0d5-ec7997f117f2 req-f4c6a080-ec19-418f-9a05-c72a54fdfd4e service nova] Creating event network-changed:58312c7c-973b-4a77-aa3d-2cb3b99dab0a for instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d on nch2-master-1 Jul 30 21:46:03.592640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-92b6ba54-de6e-4c01-a0d5-ec7997f117f2 req-f4c6a080-ec19-418f-9a05-c72a54fdfd4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041470 Jul 30 21:46:03.593407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:46:03.593721 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3009/6065] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:46:03.678385 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c4bf5041-484d-49a4-a75e-acec6fe2d674 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 204 len: 0 microversion: 2.1 time: 0.130076 Jul 30 21:46:03.679988 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3057/6066] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:46:03 2022] DELETE /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:46:03.689576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:03.690254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:03.696797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:03.697535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:03.698449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:03.698934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:03.848573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:03.856990 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5421a38a-29a3-441e-b4c4-339e8f629750 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1575 microversion: 2.1 time: 0.172043 Jul 30 21:46:03.857609 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3010/6067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:03 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:04.878727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:04.879716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:04.886925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:04.887434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:04.888231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:04.888692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:05.123269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:05.131143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-93d87303-216c-4635-87fb-70f0c339d2a0 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1575 microversion: 2.1 time: 0.256792 Jul 30 21:46:05.132010 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3058/6068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:04 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:05.841213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b6ef7214-dec7-43df-8df7-c416cb57be4a req-67342ce0-6e00-4d9d-aa7c-59256660813a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970618c5-1f0c-4960-9d9f-955c7d0bc10d", "name": "network-vif-deleted", "tag": "58312c7c-973b-4a77-aa3d-2cb3b99dab0a"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:05.851542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b6ef7214-dec7-43df-8df7-c416cb57be4a req-67342ce0-6e00-4d9d-aa7c-59256660813a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:05.852619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b6ef7214-dec7-43df-8df7-c416cb57be4a req-67342ce0-6e00-4d9d-aa7c-59256660813a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:05.864248 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b6ef7214-dec7-43df-8df7-c416cb57be4a req-67342ce0-6e00-4d9d-aa7c-59256660813a service nova] Creating event network-vif-deleted:58312c7c-973b-4a77-aa3d-2cb3b99dab0a for instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d on nch2-master-1 Jul 30 21:46:05.869950 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b6ef7214-dec7-43df-8df7-c416cb57be4a req-67342ce0-6e00-4d9d-aa7c-59256660813a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193737 Jul 30 21:46:05.870553 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3011/6069] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:06.153116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:06.153757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:06.160969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:06.161439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:06.162312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:06.162756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:06.195517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:06.195970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:06.196436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lazy-loading 'fault' on Instance uuid 970618c5-1f0c-4960-9d9f-955c7d0bc10d {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:46:06.240473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e062653d52144a3a91277e045033f27a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc59858bd4e749cab7d1d772d65e4111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:06.247621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72baf200-6569-44cb-acd2-fd2c0d256cfe tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 200 len: 1183 microversion: 2.1 time: 0.098902 Jul 30 21:46:06.248202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3059/6070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:06 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 1183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:07.269970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:07.270628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 970618c5-1f0c-4960-9d9f-955c7d0bc10d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:07.277815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.278301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.279109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.279613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.293016 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d HTTP/1.1 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '970618c5-1f0c-4960-9d9f-955c7d0bc10d'} Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.294666 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 970618c5-1f0c-4960-9d9f-955c7d0bc10d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e42ee851-2ad2-417e-9975-ea45c60c92c1 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d" status: 404 len: 111 microversion: 2.1 time: 0.031489 Jul 30 21:46:07.299087 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3012/6071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:07 2022] GET /compute/v2.1/servers/970618c5-1f0c-4960-9d9f-955c7d0bc10d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:07.736801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:07.737326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:07.744707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.745174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.745950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.746397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.760115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f HTTP/1.1 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '594747fb-8d67-4006-8c15-25cb428a347f'} Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:46:07.762031 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-647c9347-b358-46a0-b86b-8317df01c5fb tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 404 len: 111 microversion: 2.1 time: 0.030659 Jul 30 21:46:07.765781 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3060/6072] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:46:07 2022] DELETE /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:07.772120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:07.772771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] [instance: 594747fb-8d67-4006-8c15-25cb428a347f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:07.778986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.779518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.780317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:07.780788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:07.795037 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] HTTP exception thrown: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Request method failure captured: Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f HTTP/1.1 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aSYkKa9MBg74AQUbOc8OFPQbnhzzFDj4b4kRck2WrXfto_6uA1FdW0eS06Nw4IeFgFKoyfqaWkxx5MUMjg2XFXrHNk2Fjw6gUViSqn4kuhe-co8zY8zJlBl5VJOnPxd552-lkGl2xJdkfDIhKccTUrh_Zuj37a5T8YKDfiKMb2ebN8 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc59858bd4e749cab7d1d772d65e4111", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc59858bd4e749cab7d1d772d65e4111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cc59858bd4e749cab7d1d772d65e4111 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489719531 Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: e062653d52144a3a91277e045033f27a Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestVolumeBootPattern-1489719531-project Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '594747fb-8d67-4006-8c15-25cb428a347f'} Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:07.796652 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Returning 404 to user: Instance 594747fb-8d67-4006-8c15-25cb428a347f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15759590-37cb-4a0c-8e0e-f85e598585bf tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f" status: 404 len: 111 microversion: 2.1 time: 0.030615 Jul 30 21:46:07.801049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3013/6073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:07 2022] GET /compute/v2.1/servers/594747fb-8d67-4006-8c15-25cb428a347f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:09.095977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70335a7b-d43b-427d-8d7d-2ef4093a5928 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] Calling method '.version_select at 0x7fbb4fb0ab80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:09.126843 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70335a7b-d43b-427d-8d7d-2ef4093a5928 tempest-TestVolumeBootPattern-1489719531 tempest-TestVolumeBootPattern-1489719531-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-159368749" status: 202 len: 0 microversion: 2.1 time: 0.034810 Jul 30 21:46:09.131358 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3061/6074] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 30 21:46:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-159368749 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:46:27.978978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:27.979806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=14 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:28.094607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2109594919", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:28.148267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] validate_networks() for None {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:46:28.425876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:46:28.426327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:46:28.426834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:46:28.427272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:46:28.427742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:46:28.437355 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:28.437840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:28.438682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:28.439152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:28.457505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Getting quotas for project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:46:28.462816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Getting quotas for user 7bec108879034d339f614b54e83ef240 and project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:46:28.476430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:46:28.478804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:46:28.527943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-070de67a-6ff9-4c59-9507-de6592c34266 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554450 Jul 30 21:46:28.528608 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3014/6075] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:46:28.539050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:28.540281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:28.544649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a6be1213-8006-478a-9f34-5d99278c15d1 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:28.545286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a6be1213-8006-478a-9f34-5d99278c15d1 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:28.604790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a6be1213-8006-478a-9f34-5d99278c15d1 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:28.611747 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a6be1213-8006-478a-9f34-5d99278c15d1 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1222 microversion: 2.1 time: 0.074619 Jul 30 21:46:28.612320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3062/6076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:28 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:29.633585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae2578c9-1841-4f6d-bc72-7b7c107a53f9 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:29.634836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae2578c9-1841-4f6d-bc72-7b7c107a53f9 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:29.691238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae2578c9-1841-4f6d-bc72-7b7c107a53f9 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:29.699915 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae2578c9-1841-4f6d-bc72-7b7c107a53f9 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1222 microversion: 2.1 time: 0.070514 Jul 30 21:46:29.700495 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3015/6077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:29 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:30.721886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1e4bed7c-97e4-4f77-89f3-11c239f46706 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:30.722531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1e4bed7c-97e4-4f77-89f3-11c239f46706 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:30.785213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1e4bed7c-97e4-4f77-89f3-11c239f46706 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:30.793426 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1e4bed7c-97e4-4f77-89f3-11c239f46706 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1222 microversion: 2.1 time: 0.075356 Jul 30 21:46:30.794056 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3063/6078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:30 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:31.814894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e07eaa47-26f6-4531-a203-5fda8ff865a5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:31.815566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e07eaa47-26f6-4531-a203-5fda8ff865a5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:31.868740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e07eaa47-26f6-4531-a203-5fda8ff865a5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:31.877133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e07eaa47-26f6-4531-a203-5fda8ff865a5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1222 microversion: 2.1 time: 0.066544 Jul 30 21:46:31.877934 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3016/6079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:31 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:32.898378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:32.898999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:32.906009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:32.906472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:32.907247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:32.907721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:32.968988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:32.976517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67266cd1-8682-427a-a0e2-64459afc893e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1226 microversion: 2.1 time: 0.082087 Jul 30 21:46:32.977095 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3064/6080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:32 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:34.000553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:34.000924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:34.008563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:34.009053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:34.010415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:34.010890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:34.073720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:34.087354 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-50e21220-4e25-49ee-96ba-3b5e0075335c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1280 microversion: 2.1 time: 0.093189 Jul 30 21:46:34.096140 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3017/6081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:33 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:35.109579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:35.110198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:35.117242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:35.117710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:35.118491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:35.118978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:35.324218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:35.332588 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b442742-941b-48bb-ba99-2b263e841c25 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.226943 Jul 30 21:46:35.343425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3065/6082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:35 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:35.344341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a2114eed-8618-4bb8-8277-0fd63ce7c915 req-6e727816-c66e-493f-a30c-0118ca2e19e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feedb29b-3e94-475d-98d0-db9f2e8cd78e", "tag": "86fd8697-fbca-4e65-ae97-a6f77186f459"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:35.357215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a2114eed-8618-4bb8-8277-0fd63ce7c915 req-6e727816-c66e-493f-a30c-0118ca2e19e4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:35.357697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a2114eed-8618-4bb8-8277-0fd63ce7c915 req-6e727816-c66e-493f-a30c-0118ca2e19e4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:35.369825 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a2114eed-8618-4bb8-8277-0fd63ce7c915 req-6e727816-c66e-493f-a30c-0118ca2e19e4 service nova] Creating event network-changed:86fd8697-fbca-4e65-ae97-a6f77186f459 for instance feedb29b-3e94-475d-98d0-db9f2e8cd78e on nch2-master-1 Jul 30 21:46:35.374962 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a2114eed-8618-4bb8-8277-0fd63ce7c915 req-6e727816-c66e-493f-a30c-0118ca2e19e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037063 Jul 30 21:46:35.375625 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3018/6083] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:46:36.354465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:36.355093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:36.362187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:36.362648 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:36.363459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:36.363910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:36.500209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:36.507922 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7a9e1a7e-a25e-483a-9787-8df24c2b7f82 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.157782 Jul 30 21:46:36.508503 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3066/6084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:36 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:37.529342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:37.530080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:37.537398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:37.537895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:37.538728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:37.539460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:37.788555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:37.796608 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-058f2059-fe69-4d8c-b7dd-19a237b8054e tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.271664 Jul 30 21:46:37.797179 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3019/6085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:37 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:38.817727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:38.818353 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:38.825930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:38.826391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:38.827164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:38.827643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:39.032345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:39.040404 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ca882bf6-4eb8-43d3-a4e5-e7d760becc4f tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.226529 Jul 30 21:46:39.041222 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3067/6086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:38 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:40.061219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:40.061853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:40.063906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:40.069659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:40.070136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:40.070928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:40.071419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:40.201010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:40.208562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8fe7dc6f-ce7f-4fb0-a788-67cc98c46711 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.151571 Jul 30 21:46:40.209172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3020/6087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:40 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:41.085838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b5fdc661-da08-4d28-b058-375b40f5c92e req-e8fe7d61-16ba-4892-a4f6-9ba30ca50fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feedb29b-3e94-475d-98d0-db9f2e8cd78e", "name": "network-vif-plugged", "status": "completed", "tag": "86fd8697-fbca-4e65-ae97-a6f77186f459"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:41.092265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:41.099644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b5fdc661-da08-4d28-b058-375b40f5c92e req-e8fe7d61-16ba-4892-a4f6-9ba30ca50fce service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:41.100215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b5fdc661-da08-4d28-b058-375b40f5c92e req-e8fe7d61-16ba-4892-a4f6-9ba30ca50fce service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:41.112401 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b5fdc661-da08-4d28-b058-375b40f5c92e req-e8fe7d61-16ba-4892-a4f6-9ba30ca50fce service nova] Creating event network-vif-plugged:86fd8697-fbca-4e65-ae97-a6f77186f459 for instance feedb29b-3e94-475d-98d0-db9f2e8cd78e on nch2-master-1 Jul 30 21:46:41.117760 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b5fdc661-da08-4d28-b058-375b40f5c92e req-e8fe7d61-16ba-4892-a4f6-9ba30ca50fce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Jul 30 21:46:41.118602 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3068/6088] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:41.232097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:41.232751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:41.239842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:41.240324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:41.241136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:41.241607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:41.378002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:41.385702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-641bcc8d-4080-4899-889f-e3f03df58957 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1322 microversion: 2.1 time: 0.159516 Jul 30 21:46:41.386275 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3021/6089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:41 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:42.406550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:42.407260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:42.414304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.414764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.415575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.416520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.549226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:42.557366 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7748b572-a9ce-4d73-8890-0dcba01779aa tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1471 microversion: 2.1 time: 0.154501 Jul 30 21:46:42.557938 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3069/6090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:42 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:42.579791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=10 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:42.629265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-360aa01b-8f91-41c7-ba53-f98919443563 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '.version_select at 0x7fbb5c033280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:42.696672 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-360aa01b-8f91-41c7-ba53-f98919443563 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/6d3141efeb044988a1ff104123a61866" status: 200 len: 371 microversion: 2.1 time: 0.121353 Jul 30 21:46:42.697244 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3022/6091] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:46:42 2022] GET /compute/v2.1/os-quota-sets/6d3141efeb044988a1ff104123a61866 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:42.708546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26b76313-088a-4d03-80f3-70c6fbf6ebe3 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-763763632", "id": 145820927, "os-flavor-access:is_public": "True"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:42.711508 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:46:42.711508 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:46:42.733385 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26b76313-088a-4d03-80f3-70c6fbf6ebe3 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.028538 Jul 30 21:46:42.733967 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3070/6092] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:46:42 2022] POST /compute/v2.1/flavors => generated 434 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:42.746647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "145820927"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:42.749991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:42.756509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.757162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.757961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.758422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.896468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e61b96047d1489288d77933432b767e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3141efeb044988a1ff104123a61866', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:42.903650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-763763632 {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:46:42.910126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.910598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.911475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:42.911937 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:42.932656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Getting quotas for project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:46:42.937751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Getting quotas for user 7bec108879034d339f614b54e83ef240 and project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:46:42.949594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.compute.api [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] ram quota exceeded for 6d3141efeb044988a1ff104123a61866, tried to resize instance. Jul 30 21:46:42.950156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Request method failure captured: Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action HTTP/1.1 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 38 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aazbPmr1mc31VKzboq2m13tdIxTreH5xY9tufQAvLX0XLkqQxSXcU5SoIpVuHBDXkC4CwsIEMP_KGy2ixb6WBVgtqtzCZ-qoAVLhIFLVA-xjyHyKQx2_iYmZzIjmwCN55sOUbW774vgu5VCfkCDXmJb3R6LDWCtaFtftq36JB4BCNo Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 6d3141efeb044988a1ff104123a61866 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,admin,member Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,admin,member Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6d3141efeb044988a1ff104123a61866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6d3141efeb044988a1ff104123a61866", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d3141efeb044988a1ff104123a61866"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d3141efeb044988a1ff104123a61866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 6d3141efeb044988a1ff104123a61866 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-1564002183-project-admin Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7e61b96047d1489288d77933432b767e Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1564002183-project-admin Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: {"resize": {"flavorRef": "145820927"}} Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'feedb29b-3e94-475d-98d0-db9f2e8cd78e', 'body': {'resize': {'flavorRef': '145820927'}}} Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:42.952288 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-616f3ada-b7b0-48b9-85a6-772347f72f1f tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action" status: 403 len: 118 microversion: 2.1 time: 0.212207 Jul 30 21:46:42.956391 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3023/6093] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:46:42 2022] POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action => generated 118 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:42.963591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-56f5fe28-36fb-4da3-9db5-cb0810507b15 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:42.964385 ncdv-master-1 devstack@n-api.service[130984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:46:42.964385 ncdv-master-1 devstack@n-api.service[130984]: warnings.warn(msg) Jul 30 21:46:42.981312 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-56f5fe28-36fb-4da3-9db5-cb0810507b15 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/145820927" status: 202 len: 0 microversion: 2.1 time: 0.022027 Jul 30 21:46:42.981880 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3071/6094] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:46:42 2022] DELETE /compute/v2.1/flavors/145820927 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:46:42.989647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aeebeff6-da5f-42b2-a2f6-82951faf6aae tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.010686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aeebeff6-da5f-42b2-a2f6-82951faf6aae tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024624 Jul 30 21:46:43.011273 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3024/6095] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:46:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:43.031359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30bd8afc-1fe5-48c2-85d3-4afe97231bd9 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '.version_select at 0x7fbb5d078550>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.116923 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30bd8afc-1fe5-48c2-85d3-4afe97231bd9 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/6d3141efeb044988a1ff104123a61866" status: 200 len: 371 microversion: 2.1 time: 0.089378 Jul 30 21:46:43.117516 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3072/6096] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Jul 30 21:46:43 2022] GET /compute/v2.1/os-quota-sets/6d3141efeb044988a1ff104123a61866 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:43.131996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80a2a17e-b591-40a2-8d72-48f6ee768e22 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1387413269", "id": 550100833, "os-flavor-access:is_public": "True"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:43.135605 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:46:43.135605 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:46:43.152851 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80a2a17e-b591-40a2-8d72-48f6ee768e22 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024534 Jul 30 21:46:43.153493 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3025/6097] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:46:43 2022] POST /compute/v2.1/flavors => generated 434 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:43.164975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "550100833"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:43.167401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:43.173692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.174162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.174950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.175437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.258951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e61b96047d1489288d77933432b767e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3141efeb044988a1ff104123a61866', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:43.266110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1387413269 {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:46:43.272624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.273091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.273916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.274378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.295333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Getting quotas for project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:46:43.300451 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Getting quotas for user 7bec108879034d339f614b54e83ef240 and project a7c57b1993494c8b99141f943666bd72. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:46:43.313473 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.api [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] cores quota exceeded for 6d3141efeb044988a1ff104123a61866, tried to resize instance. Jul 30 21:46:43.314028 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Request method failure captured: Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action HTTP/1.1 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 38 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aazbPmr1mc31VKzboq2m13tdIxTreH5xY9tufQAvLX0XLkqQxSXcU5SoIpVuHBDXkC4CwsIEMP_KGy2ixb6WBVgtqtzCZ-qoAVLhIFLVA-xjyHyKQx2_iYmZzIjmwCN55sOUbW774vgu5VCfkCDXmJb3R6LDWCtaFtftq36JB4BCNo Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 6d3141efeb044988a1ff104123a61866 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,admin,member Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,admin,member Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6d3141efeb044988a1ff104123a61866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6d3141efeb044988a1ff104123a61866", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d3141efeb044988a1ff104123a61866"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d3141efeb044988a1ff104123a61866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 6d3141efeb044988a1ff104123a61866 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1564002183 Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersAdminNegativeTestJSON-1564002183-project-admin Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 7e61b96047d1489288d77933432b767e Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1564002183-project-admin Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: {"resize": {"flavorRef": "550100833"}} Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'feedb29b-3e94-475d-98d0-db9f2e8cd78e', 'body': {'resize': {'flavorRef': '550100833'}}} Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:43.316228 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-faf894f5-4c57-4c5d-be7f-b72d4dc01511 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action" status: 403 len: 113 microversion: 2.1 time: 0.156625 Jul 30 21:46:43.320162 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3073/6098] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:46:43 2022] POST /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e/action => generated 113 bytes in 158 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:43.327198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5becc683-2e04-4320-a522-c9d00968d9a5 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.327985 ncdv-master-1 devstack@n-api.service[130983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 21:46:43.327985 ncdv-master-1 devstack@n-api.service[130983]: warnings.warn(msg) Jul 30 21:46:43.344835 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5becc683-2e04-4320-a522-c9d00968d9a5 tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/550100833" status: 202 len: 0 microversion: 2.1 time: 0.021515 Jul 30 21:46:43.345392 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3026/6099] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Jul 30 21:46:43 2022] DELETE /compute/v2.1/flavors/550100833 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:46:43.354802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba1786f0-251b-4d0e-854b-9a857e62164b tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.386290 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba1786f0-251b-4d0e-854b-9a857e62164b tempest-ServersAdminNegativeTestJSON-1564002183 tempest-ServersAdminNegativeTestJSON-1564002183-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036043 Jul 30 21:46:43.386902 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3074/6100] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Jul 30 21:46:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:43.413510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.414059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:43.421151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.421638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.422436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.422892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.448343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:46:43.529023 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f0fdf20-3ab4-4797-880c-2d5a4d348fc5 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "DELETE /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 204 len: 0 microversion: 2.1 time: 0.118996 Jul 30 21:46:43.529874 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3027/6101] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:46:43 2022] DELETE /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:46:43.538122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:43.538746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:43.546578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.547039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.547849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:43.548295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:43.686521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:43.694281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35bd497d-4e9e-4069-b525-35741957e256 tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1477 microversion: 2.1 time: 0.160116 Jul 30 21:46:43.695041 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3075/6102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:43 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:46:44.715918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:44.716681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:44.724112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:44.724889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:44.725698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:44.726171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:44.861424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bec108879034d339f614b54e83ef240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c57b1993494c8b99141f943666bd72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:44.870027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e07bd7c-d7c6-4124-ab2c-bf4b4065368d tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 200 len: 1477 microversion: 2.1 time: 0.157624 Jul 30 21:46:44.870624 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3028/6103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:44 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:45.330207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-22efc11b-fe79-4fb9-a1e6-d5f13f02f20b req-c03f66d0-bcf1-4096-b201-d8f2fc15490c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feedb29b-3e94-475d-98d0-db9f2e8cd78e", "name": "network-vif-deleted", "tag": "86fd8697-fbca-4e65-ae97-a6f77186f459"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:45.344430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-22efc11b-fe79-4fb9-a1e6-d5f13f02f20b req-c03f66d0-bcf1-4096-b201-d8f2fc15490c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:45.344901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-22efc11b-fe79-4fb9-a1e6-d5f13f02f20b req-c03f66d0-bcf1-4096-b201-d8f2fc15490c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:45.357414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-22efc11b-fe79-4fb9-a1e6-d5f13f02f20b req-c03f66d0-bcf1-4096-b201-d8f2fc15490c service nova] Creating event network-vif-deleted:86fd8697-fbca-4e65-ae97-a6f77186f459 for instance feedb29b-3e94-475d-98d0-db9f2e8cd78e on nch2-master-1 Jul 30 21:46:45.362563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-22efc11b-fe79-4fb9-a1e6-d5f13f02f20b req-c03f66d0-bcf1-4096-b201-d8f2fc15490c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036252 Jul 30 21:46:45.363176 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3076/6104] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:45.891724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:45.892373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] [instance: feedb29b-3e94-475d-98d0-db9f2e8cd78e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:45.899638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:45.900128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:45.900950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:45.901422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:45.915145 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] HTTP exception thrown: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Request method failure captured: Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e HTTP/1.1 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aazQeJI0dWF89XnxRnEzXAB0R9HUBkfvP-wUBqw823iJ6CBaqYhOB3qUTMPQ7x2PQO6pDlMasYSIUtUC7b30Tzw2N768gL_DVw5EmlhO1_O0NptCEiiXZuRbiTsYSzrlU03sjO1oaGBbDTNFC_zC-yeNHYzfcXM0l0dSqwoA3t5uio Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: a7c57b1993494c8b99141f943666bd72 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-590793445 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7c57b1993494c8b99141f943666bd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7c57b1993494c8b99141f943666bd72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c57b1993494c8b99141f943666bd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c57b1993494c8b99141f943666bd72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersAdminNegativeTestJSON-590793445 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: a7c57b1993494c8b99141f943666bd72 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-590793445 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersAdminNegativeTestJSON-590793445-project Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 7bec108879034d339f614b54e83ef240 Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersAdminNegativeTestJSON-590793445-project Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'feedb29b-3e94-475d-98d0-db9f2e8cd78e'} Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:46:45.916892 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] Returning 404 to user: Instance feedb29b-3e94-475d-98d0-db9f2e8cd78e could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a5b59a47-313e-4c04-848d-f15b62ee3f3c tempest-ServersAdminNegativeTestJSON-590793445 tempest-ServersAdminNegativeTestJSON-590793445-project] 10.222.0.17 "GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e" status: 404 len: 111 microversion: 2.1 time: 0.031078 Jul 30 21:46:45.921157 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3029/6105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:45 2022] GET /compute/v2.1/servers/feedb29b-3e94-475d-98d0-db9f2e8cd78e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:46:52.101728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-506160282", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "545a20a7-ba67-45c7-9c86-dffe0c505267"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:52.159725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] validate_networks() for [('545a20a7-ba67-45c7-9c86-dffe0c505267', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:46:52.578583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:46:52.579033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:46:52.579593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:46:52.580034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:46:52.580468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:46:52.590804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:52.591318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:52.592135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:52.592600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:52.611080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Getting quotas for project d275969596b84899b2ef27b6d269d3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:46:52.617055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Getting quotas for user 8505261efa7442379b2a9089ca4d56b9 and project d275969596b84899b2ef27b6d269d3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:46:52.630806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:46:52.633231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:46:52.683041 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-295cdf37-edfc-4b68-acc5-0f2271bcd70b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722796 Jul 30 21:46:52.683753 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3077/6106] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:46:52.694824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03431624-cc95-4427-a477-428597ed9b43 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:52.695520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03431624-cc95-4427-a477-428597ed9b43 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:52.702265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:52.757717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-03431624-cc95-4427-a477-428597ed9b43 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:52.766194 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03431624-cc95-4427-a477-428597ed9b43 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1214 microversion: 2.1 time: 0.075468 Jul 30 21:46:52.767162 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3030/6107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:52 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:53.788780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:53.789413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:53.797817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:53.798416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:53.799354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:53.799860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:53.883666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:53.892107 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cbebaf1f-00a5-4fe3-baec-df79d59c3ced tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1272 microversion: 2.1 time: 0.108137 Jul 30 21:46:53.894689 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3078/6108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:53 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:54.914325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:54.915259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:54.918554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:54.929188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:54.930063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:54.931075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:54.931668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:55.098900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:55.109657 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d4adb76-7783-4a03-a1e3-1309f4381635 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.198731 Jul 30 21:46:55.110250 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3031/6109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:54 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:55.166419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fbe0353c-6b32-4268-8624-3a31dc57976a req-ad546f1d-5fb1-494c-892f-45cb68caa481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:46:55.182478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fbe0353c-6b32-4268-8624-3a31dc57976a req-ad546f1d-5fb1-494c-892f-45cb68caa481 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:55.183211 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fbe0353c-6b32-4268-8624-3a31dc57976a req-ad546f1d-5fb1-494c-892f-45cb68caa481 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:55.202406 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fbe0353c-6b32-4268-8624-3a31dc57976a req-ad546f1d-5fb1-494c-892f-45cb68caa481 service nova] Creating event network-changed:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch2-master-1 Jul 30 21:46:55.208512 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fbe0353c-6b32-4268-8624-3a31dc57976a req-ad546f1d-5fb1-494c-892f-45cb68caa481 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047058 Jul 30 21:46:55.210185 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3079/6110] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:46:56.130636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:56.131326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:56.139458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:56.139942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:56.140747 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:56.141224 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:56.592834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:56.601601 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f7daf4cf-4142-4cb2-91d0-eb2d478479b8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.474787 Jul 30 21:46:56.602251 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3032/6111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:56 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:57.623342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:57.624062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:57.631443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:57.631911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:57.632687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:57.633139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:57.764501 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:57.772051 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d5999b0d-4dac-4c84-b25a-665504a1d8b2 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.153693 Jul 30 21:46:57.772618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3080/6112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:57 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:58.793652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:58.794310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:58.797211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:58.803519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:58.804012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:58.804844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:58.805316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:58.809442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:58.947342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:46:58.955198 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0440acd0-0614-44ca-8393-96c185c2ea0b tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.166033 Jul 30 21:46:58.955907 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3033/6113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:58 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:46:59.086509 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:46:59.086739 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 21:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:46:59.975914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:46:59.976543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:46:59.979371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:59.984840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:59.985309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:59.986093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:46:59.986547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:46:59.991418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=70 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:00.121588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:00.129104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9ced8dcc-7ad6-46af-81c8-5f2acd98212e tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.157197 Jul 30 21:47:00.129702 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3081/6114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:46:59 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:01.120843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aec4247c-3bdb-48ec-95b3-d29290792fa5 req-f9709a37-676d-40b4-82c0-db7409b431c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "name": "network-vif-plugged", "status": "completed", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:01.132117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aec4247c-3bdb-48ec-95b3-d29290792fa5 req-f9709a37-676d-40b4-82c0-db7409b431c3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:01.132718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aec4247c-3bdb-48ec-95b3-d29290792fa5 req-f9709a37-676d-40b4-82c0-db7409b431c3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:01.145105 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aec4247c-3bdb-48ec-95b3-d29290792fa5 req-f9709a37-676d-40b4-82c0-db7409b431c3 service nova] Creating event network-vif-plugged:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch2-master-1 Jul 30 21:47:01.150174 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aec4247c-3bdb-48ec-95b3-d29290792fa5 req-f9709a37-676d-40b4-82c0-db7409b431c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Jul 30 21:47:01.151667 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3034/6115] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:47:01.153510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:01.154139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:01.162400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:01.162868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:01.163678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:01.164125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:01.375727 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:01.383228 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-328bff3d-a7c1-42ab-b330-bc5ec0d1ba77 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.235664 Jul 30 21:47:01.383834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3082/6116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:01 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:47:02.406488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:02.407276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:02.413749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:02.414232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:02.415029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:02.415527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:02.552001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:02.559824 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-548a59e0-1991-45ab-a92c-4ac73cdf94c7 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1314 microversion: 2.1 time: 0.158937 Jul 30 21:47:02.560419 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3035/6117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:02 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:03.579686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:03.580308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:03.583036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=5 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:03.583815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=8 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:03.590357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.590819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:03.591618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.592069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:03.720722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:03.730476 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f3ec1f76-1d24-4929-be30-99d8df33a0dc tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1501 microversion: 2.1 time: 0.154643 Jul 30 21:47:03.731066 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3083/6118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:03 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:03.750993 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:03.753324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:03.755378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:03.761703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.762193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:03.763349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.763830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:03.796646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:03.802582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:47:03.808972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:47:03.809426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:47:03.809934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:47:03.810384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:47:03.810832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:47:03.873504 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7eb76a27-9cad-49a2-9024-4fbf1ed91104 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "POST /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7/action" status: 202 len: 0 microversion: 2.1 time: 0.126573 Jul 30 21:47:03.874141 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3036/6119] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:47:03 2022] POST /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:47:03.882291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:03.883027 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:03.889934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.890433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:03.891702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:03.892245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:04.034992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:04.042735 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57b850da-0bc1-43d7-bdbb-349347ed0709 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1510 microversion: 2.1 time: 0.164320 Jul 30 21:47:04.043546 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3084/6120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:03 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:05.064007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:05.064694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:05.071916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:05.072395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:05.073416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:05.073884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:05.205210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:05.212946 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82db6663-3179-473b-a849-dfe48a3b77b6 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1510 microversion: 2.1 time: 0.152941 Jul 30 21:47:05.214083 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3037/6121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:05 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:06.235712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:06.236379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:06.243644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:06.244101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:06.245515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:06.246006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:06.379902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:06.387703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-76cc1a07-a983-42d6-a8f4-d0ef1f4b7670 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.156011 Jul 30 21:47:06.388279 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3085/6122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:06 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:07.408862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:07.409510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:07.417023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:07.417513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:07.418344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:07.418840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:07.553084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:07.561129 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7543327f-5c64-4989-94b0-36f5e07f5df1 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.156300 Jul 30 21:47:07.561701 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3038/6123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:07 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:08.582732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:08.583402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:08.591043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:08.591540 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:08.592325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:08.592782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:08.722674 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:08.730400 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c198d7ca-0d5c-4344-9edc-9c74a7a75a62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.151751 Jul 30 21:47:08.730978 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3086/6124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:08 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:09.751942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:09.752585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:09.759064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:09.759587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:09.761031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:09.761503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:09.888773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:09.896357 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dbef669a-d676-4673-a298-ec86bc8298e3 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.148636 Jul 30 21:47:09.896940 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3039/6125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:09 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:10.917210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:10.917845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:10.924971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:10.925445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:10.926233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:10.926692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:11.057523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:11.065144 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b69378a-c7ae-43e4-8349-be798016c8ee tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.151912 Jul 30 21:47:11.065719 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3087/6126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:10 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:12.087350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:12.087997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:12.095599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:12.096084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:12.096882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:12.097352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:12.228748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:12.237690 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bcad8db8-63c5-4aef-8ada-87b526649120 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.154362 Jul 30 21:47:12.238282 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3040/6127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:12 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:13.258290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:13.258850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:13.266045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:13.266525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:13.267325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:13.267787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:13.398679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:13.406920 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a86442dd-776d-4c2f-8592-63ba36a54213 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.152731 Jul 30 21:47:13.407545 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3088/6128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:13 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:14.429685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:14.430330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:14.438213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:14.438701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:14.439541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:14.440019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:14.588488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:14.596205 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d780bf92-cc82-4872-8c7c-8d17c665c22d tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.171653 Jul 30 21:47:14.596785 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3041/6129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:14 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:15.617099 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:15.617756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:15.625460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:15.625930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:15.626711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:15.627166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:15.755808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:15.764367 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8adbf520-ff30-4851-8fa3-2248f83734c8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.151170 Jul 30 21:47:15.764973 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3089/6130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:15 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:16.788965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:16.789608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:16.796773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:16.797253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:16.798045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:16.798516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:16.934813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:16.942445 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-716f96aa-a7ca-4135-a575-2e524c7da454 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.157460 Jul 30 21:47:16.943026 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3042/6131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:16 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:17.963582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:17.964285 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:17.971407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:17.971876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:17.972665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:17.973123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:18.105396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:18.113143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-04107c28-d23f-444b-8b22-193ce996ba62 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.153947 Jul 30 21:47:18.113732 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3090/6132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:17 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:19.136568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:19.137215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:19.144628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:19.145119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:19.145929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:19.146406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:19.278648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:19.286423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c019070b-4b59-4ff5-9824-40a4de5bc878 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.154358 Jul 30 21:47:19.286997 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3043/6133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:19 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:20.306687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:20.307361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:20.314226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:20.314697 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:20.315524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:20.316033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:20.446605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:20.454268 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30dc7d5c-32ea-4b8d-ac07-398d8321ae6c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.151490 Jul 30 21:47:20.454851 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3091/6134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:20 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:21.474679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:21.475349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:21.483071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:21.483598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:21.484406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:21.484884 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:21.618273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:21.626004 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a217215c-e9b6-44d6-b1e2-1b9c8794115a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.155274 Jul 30 21:47:21.626986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3044/6135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:21 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:22.647418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:22.648057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:22.655162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:22.655677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:22.656472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:22.656926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:22.787302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:22.795470 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3fb0938f-13b2-4ad6-923c-55aa180b9e08 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.152069 Jul 30 21:47:22.796078 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3092/6136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:22 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:23.816589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:23.817249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:23.824880 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:23.825362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:23.826170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:23.826645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:23.961538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:23.969137 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0216dfb9-3a2c-4717-a3b6-a26bd647b14c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.156528 Jul 30 21:47:23.969725 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3045/6137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:23 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:24.989973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:24.990532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:24.998275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:24.998754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:24.999589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:25.000052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:25.138135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:25.145770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a073d1fa-1d9e-4cca-b4d3-8aae999f2dab tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.159836 Jul 30 21:47:25.146347 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3093/6138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:24 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:26.166273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:26.166915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:26.174114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:26.174604 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:26.175442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:26.175917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:26.307279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:26.314878 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aae7490d-deb7-4cc5-8f06-99c446d931f9 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.152642 Jul 30 21:47:26.315483 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3046/6139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:26 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:27.336458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:27.337083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:27.344782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:27.345254 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:27.346039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:27.346492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:27.476197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:27.484024 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-66b70c8f-fdee-4d8a-80a5-7fd17ce72d86 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.151457 Jul 30 21:47:27.484606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3094/6140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:27 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:28.505257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:28.506492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:28.513939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:28.514421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:28.515220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:28.515711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:28.649514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:28.657711 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c4776455-705f-4285-b540-d1755feef1d8 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.156621 Jul 30 21:47:28.658290 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3047/6141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:28 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:29.679402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:29.679973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:29.687677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:29.688152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:29.688940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:29.689400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:29.827183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:29.834944 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-13ae590c-17a8-4729-827e-28d3c3a81346 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.159637 Jul 30 21:47:29.835568 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3095/6142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:29 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:30.856650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:30.857291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:30.860097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=34 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:30.865920 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:30.866394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:30.867216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:30.867719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:30.872796 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:31.003496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:31.011411 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05e83b4c-e9fb-4f50-ab9f-b486688d4641 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.159197 Jul 30 21:47:31.012009 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3048/6143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:30 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:32.033968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:32.034593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:32.037316 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=30 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:32.043036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:32.043538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:32.044313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:32.044759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:32.048707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=90 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:32.172170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:32.179876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af041aa9-ee00-4559-8fe2-62fa57f81256 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1515 microversion: 2.1 time: 0.149824 Jul 30 21:47:32.180449 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3096/6144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:32 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:33.152681 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "name": "network-vif-unplugged", "status": "completed", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:33.163785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:33.164256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:33.176262 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] Creating event network-vif-unplugged:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch1-master-1 Jul 30 21:47:33.182753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] Instance 86ce185b-8292-4176-8a4a-a79269e411d7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:47:33.194104 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-efb603a2-22ff-4912-961c-4468e85bf78a req-d76b38a5-8147-4f9a-9708-940762436713 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045887 Jul 30 21:47:33.194924 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3049/6145] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:47:33.201903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:33.202636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:33.210134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:33.210614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:33.211465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:33.211926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:33.675576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:33.683963 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a62e657-d144-4cce-80e5-334c2d82f24a tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1514 microversion: 2.1 time: 0.486590 Jul 30 21:47:33.684600 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3097/6146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:33 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:47:34.707760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:34.708488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:34.715552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:34.716024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:34.716815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:34.717279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:34.852169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:34.859778 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-194b9e1e-7846-4e45-b5f7-dbabde0ecc1c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1512 microversion: 2.1 time: 0.157256 Jul 30 21:47:34.860363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3050/6147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:34 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:35.226331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:35.237825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:35.238294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:35.250914 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] Creating event network-changed:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch1-master-1 Jul 30 21:47:35.256298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] Instance 86ce185b-8292-4176-8a4a-a79269e411d7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:47:35.269054 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0e722c16-44ca-4b44-91fc-f537b6a2cf60 req-6f3c8920-28e3-4f3e-94c3-94a5b54f28e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046481 Jul 30 21:47:35.269909 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3098/6148] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:47:35.881948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:35.882572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:35.890609 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:35.891086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:35.891904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:35.892372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:36.030183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:36.038169 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d20017be-6d17-4b7a-8007-9b70eb1d0224 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1509 microversion: 2.1 time: 0.160188 Jul 30 21:47:36.038766 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3051/6149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:35 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:36.060007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:36.060614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:36.067147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:36.067655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:36.068442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:36.068901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:36.096301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:47:36.152145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.api [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Found an unconfirmed migration during delete, id: 16, status: finished Jul 30 21:47:37.485905 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c49eb220-ff90-46eb-92eb-febe1fd38504 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "DELETE /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 204 len: 0 microversion: 2.1 time: 1.430641 Jul 30 21:47:37.486618 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3099/6150] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:47:36 2022] DELETE /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 0 bytes in 1432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:47:37.495969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:37.496645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:37.503803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:37.504290 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:37.505101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:37.505576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:37.637721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:37.645689 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-46f9b8c6-0792-4a39-b31e-be981dd4fbde tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1501 microversion: 2.1 time: 0.154775 Jul 30 21:47:37.646268 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3052/6151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:37 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:38.667050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:38.667799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:38.674825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:38.675307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:38.676108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:38.676566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:38.823872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8505261efa7442379b2a9089ca4d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275969596b84899b2ef27b6d269d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:38.832951 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df688c2e-4fad-4272-a8c9-92b0c6e82232 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 200 len: 1501 microversion: 2.1 time: 0.170198 Jul 30 21:47:38.833632 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3100/6152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:38 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:38.916605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f0d56556-f2da-432e-8439-354402fc64bd req-5c8a6654-577f-4805-a45f-c1bc12353971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "name": "network-vif-plugged", "status": "completed", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:38.929700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0d56556-f2da-432e-8439-354402fc64bd req-5c8a6654-577f-4805-a45f-c1bc12353971 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:38.930378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f0d56556-f2da-432e-8439-354402fc64bd req-5c8a6654-577f-4805-a45f-c1bc12353971 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:38.945143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f0d56556-f2da-432e-8439-354402fc64bd req-5c8a6654-577f-4805-a45f-c1bc12353971 service nova] Creating event network-vif-plugged:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch1-master-1 Jul 30 21:47:38.951116 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f0d56556-f2da-432e-8439-354402fc64bd req-5c8a6654-577f-4805-a45f-c1bc12353971 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039715 Jul 30 21:47:38.951962 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3053/6153] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:47:39.202398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-138169f7-579c-4ff5-91ec-a213b2690b4d req-0b265840-a8ac-4d19-9016-c6373ba04ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce185b-8292-4176-8a4a-a79269e411d7", "name": "network-vif-deleted", "tag": "2cde5a36-3baf-4e1f-8cdd-16110624b909"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:39.214530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-138169f7-579c-4ff5-91ec-a213b2690b4d req-0b265840-a8ac-4d19-9016-c6373ba04ed0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.215346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-138169f7-579c-4ff5-91ec-a213b2690b4d req-0b265840-a8ac-4d19-9016-c6373ba04ed0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.228428 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-138169f7-579c-4ff5-91ec-a213b2690b4d req-0b265840-a8ac-4d19-9016-c6373ba04ed0 service nova] Creating event network-vif-deleted:2cde5a36-3baf-4e1f-8cdd-16110624b909 for instance 86ce185b-8292-4176-8a4a-a79269e411d7 on nch1-master-1 Jul 30 21:47:39.235044 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-138169f7-579c-4ff5-91ec-a213b2690b4d req-0b265840-a8ac-4d19-9016-c6373ba04ed0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037844 Jul 30 21:47:39.236017 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3101/6154] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:47:39.855566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:39.856296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:39.862939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.863464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.864266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.864736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.878634 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] HTTP exception thrown: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Request method failure captured: Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 HTTP/1.1 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5abL97cGIdiXabVxXFOS0v75JinGDRxbQobrBdiyqMnbSHVO3JcCOw6cPQOQEHtpMbm3wCipj8zAJxw2tfTPSw-AUU_AiX3N_Ph55Qzxvbx0ZiwARVD5bk2CMjye-YhrGEqK-jzCDi0xahIPiJ8PMKGqoUxw2u0twJpCsZLxHaOCbzY Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d275969596b84899b2ef27b6d269d3f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8505261efa7442379b2a9089ca4d56b9 Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '86ce185b-8292-4176-8a4a-a79269e411d7'} Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.880310 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Returning 404 to user: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e4950acc-1770-46c6-9a67-1973a5d18b8c tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 404 len: 111 microversion: 2.1 time: 0.031135 Jul 30 21:47:39.885107 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3054/6155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:39 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:47:39.898210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:39.898831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:39.905277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.905748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.906528 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.906981 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.920779 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] HTTP exception thrown: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Request method failure captured: Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 HTTP/1.1 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5abL97cGIdiXabVxXFOS0v75JinGDRxbQobrBdiyqMnbSHVO3JcCOw6cPQOQEHtpMbm3wCipj8zAJxw2tfTPSw-AUU_AiX3N_Ph55Qzxvbx0ZiwARVD5bk2CMjye-YhrGEqK-jzCDi0xahIPiJ8PMKGqoUxw2u0twJpCsZLxHaOCbzY Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d275969596b84899b2ef27b6d269d3f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 8505261efa7442379b2a9089ca4d56b9 Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '86ce185b-8292-4176-8a4a-a79269e411d7'} Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:47:39.922424 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Returning 404 to user: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9fba712e-9bf7-4c72-8990-d3de07a9ba57 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "DELETE /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 404 len: 111 microversion: 2.1 time: 0.030820 Jul 30 21:47:39.926619 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3102/6156] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:47:39 2022] DELETE /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:47:39.932984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:39.933618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] [instance: 86ce185b-8292-4176-8a4a-a79269e411d7] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:39.939799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.940271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.941058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:39.941522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:39.954955 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] HTTP exception thrown: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Request method failure captured: Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 HTTP/1.1 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5abL97cGIdiXabVxXFOS0v75JinGDRxbQobrBdiyqMnbSHVO3JcCOw6cPQOQEHtpMbm3wCipj8zAJxw2tfTPSw-AUU_AiX3N_Ph55Qzxvbx0ZiwARVD5bk2CMjye-YhrGEqK-jzCDi0xahIPiJ8PMKGqoUxw2u0twJpCsZLxHaOCbzY Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d275969596b84899b2ef27b6d269d3f3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d275969596b84899b2ef27b6d269d3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d275969596b84899b2ef27b6d269d3f3 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-DeleteServersTestJSON-551239133 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 8505261efa7442379b2a9089ca4d56b9 Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-DeleteServersTestJSON-551239133-project Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '86ce185b-8292-4176-8a4a-a79269e411d7'} Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:47:39.956523 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] Returning 404 to user: Instance 86ce185b-8292-4176-8a4a-a79269e411d7 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4d36402e-9b44-4266-931b-812668d65776 tempest-DeleteServersTestJSON-551239133 tempest-DeleteServersTestJSON-551239133-project] 10.222.0.17 "GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7" status: 404 len: 111 microversion: 2.1 time: 0.029571 Jul 30 21:47:39.960381 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3055/6157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:39 2022] GET /compute/v2.1/servers/86ce185b-8292-4176-8a4a-a79269e411d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:47:48.544632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1391941807", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b2fd7180-74e3-4b1c-bee2-6ebc16347967"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:48.606523 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] validate_networks() for [('b2fd7180-74e3-4b1c-bee2-6ebc16347967', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:47:49.005466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:47:49.005908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:47:49.006400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:47:49.006824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:47:49.007252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:47:49.017177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:49.017641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:49.018457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:49.018907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:49.035673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for project d6fde8f046df422fa52fe982d42e95a5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:47:49.041458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for user 45bbff38b6eb4ef6a4e32a1569d32493 and project d6fde8f046df422fa52fe982d42e95a5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:47:49.053965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:47:49.056897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:47:49.099683 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c703606a-eb15-43fa-925e-716cf12bd6c7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700314 Jul 30 21:47:49.100348 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3103/6158] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:47:49.112522 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-16195c2a-910c-4e73-84aa-0aa332e43b82 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:49.113461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-16195c2a-910c-4e73-84aa-0aa332e43b82 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:49.172128 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-16195c2a-910c-4e73-84aa-0aa332e43b82 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:49.179229 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-16195c2a-910c-4e73-84aa-0aa332e43b82 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1218 microversion: 2.1 time: 0.070940 Jul 30 21:47:49.179876 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3056/6159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:49 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:50.202538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:50.203751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:50.212010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:50.212579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:50.213447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:50.213930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:50.284509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:50.296241 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ae148fea-baad-4a40-8b08-da3a869a3d4a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1276 microversion: 2.1 time: 0.099424 Jul 30 21:47:50.299844 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3104/6160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:50 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:51.320080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:51.320976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:51.324915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=33 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:51.336733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:51.337886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:51.338713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:51.339186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:51.558948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:51.562671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-b7c0d3c2-7893-4991-ae58-30e54924eef5 req-e181f364-a967-4b97-ae96-ac16a087b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:51.567871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f63ee95-ab69-4201-be30-3e29fbe69679 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.251734 Jul 30 21:47:51.568476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3057/6161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:51 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:51.576365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b7c0d3c2-7893-4991-ae58-30e54924eef5 req-e181f364-a967-4b97-ae96-ac16a087b828 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:51.577792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-b7c0d3c2-7893-4991-ae58-30e54924eef5 req-e181f364-a967-4b97-ae96-ac16a087b828 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:51.590906 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-b7c0d3c2-7893-4991-ae58-30e54924eef5 req-e181f364-a967-4b97-ae96-ac16a087b828 service nova] Creating event network-changed:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch1-master-1 Jul 30 21:47:51.596323 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-b7c0d3c2-7893-4991-ae58-30e54924eef5 req-e181f364-a967-4b97-ae96-ac16a087b828 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038460 Jul 30 21:47:51.596938 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3105/6162] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:47:52.588912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:52.589557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:52.596584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:52.597062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:52.597859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:52.598319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:52.730612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:52.739537 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c0615274-4491-409c-a99f-b0ada77ce41f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.154542 Jul 30 21:47:52.740129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3058/6163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:52 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:53.762023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:53.762753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:53.770475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:53.770941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:53.771755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:53.772208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:53.902035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:53.909546 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18c8b392-2b02-4b75-90b8-47e21af079ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.152411 Jul 30 21:47:53.910125 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3106/6164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:53 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:54.930094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:54.930863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:54.937938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:54.938426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:54.939231 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:54.939799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:55.085926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:55.095846 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-89ea0a27-0272-4a01-9999-aea7ca48b184 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.169673 Jul 30 21:47:55.096440 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3059/6165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:54 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:56.116673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:56.117341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:56.124577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:56.125049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:56.125835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:56.126292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:56.577502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:56.585046 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-612ed944-a8af-4772-a619-d52c60e6106e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.472369 Jul 30 21:47:56.585621 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3107/6166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:56 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:56.938554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5045225f-2f60-4a94-80da-0f9f4c0c7703 req-2f83211c-e548-4cc7-9dac-d71d9ebef0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "name": "network-vif-plugged", "status": "completed", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:56.950504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5045225f-2f60-4a94-80da-0f9f4c0c7703 req-2f83211c-e548-4cc7-9dac-d71d9ebef0c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:56.950990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5045225f-2f60-4a94-80da-0f9f4c0c7703 req-2f83211c-e548-4cc7-9dac-d71d9ebef0c8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:56.963114 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5045225f-2f60-4a94-80da-0f9f4c0c7703 req-2f83211c-e548-4cc7-9dac-d71d9ebef0c8 service nova] Creating event network-vif-plugged:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch1-master-1 Jul 30 21:47:56.968218 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5045225f-2f60-4a94-80da-0f9f4c0c7703 req-2f83211c-e548-4cc7-9dac-d71d9ebef0c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Jul 30 21:47:56.968820 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3060/6167] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:47:57.606056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:57.606679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:57.613678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:57.614142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:57.614908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:57.615386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:57.748093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:57.755722 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c66a03b6-7e01-42bc-ad5a-ecc70e6abb6e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1318 microversion: 2.1 time: 0.153556 Jul 30 21:47:57.756310 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3108/6168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:57 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:58.778866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:58.779830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:58.786494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:58.786916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:58.787742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:58.788211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:58.916277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:58.923997 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e218069b-85a2-4cc9-8c67-b2096b84289a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1509 microversion: 2.1 time: 0.150962 Jul 30 21:47:58.924575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3061/6169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:58 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:58.944582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:58.945206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:58.952684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:58.953172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:58.953940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:58.954389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.026816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:59.048969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:59.087340 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:59.095417 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6704effb-3dfe-4693-8211-003e1eadbc3e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1509 microversion: 2.1 time: 0.154624 Jul 30 21:47:59.095982 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3109/6170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:58 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:59.115483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:59.117990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:59.124755 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.125238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.126041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.126510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.179011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:59.191030 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fa7cc5e3-a180-4671-b150-0322a286c201 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "PUT /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1081 microversion: 2.1 time: 0.079593 Jul 30 21:47:59.191834 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3062/6171] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 30 21:47:59 2022] PUT /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1081 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:59.209031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:59.209656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:59.215762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.216224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.217021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.217470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.345736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:59.353814 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ce84d5f0-847a-4bec-a5b1-2425360653cc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1507 microversion: 2.1 time: 0.148636 Jul 30 21:47:59.354391 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3110/6172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:59 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:59.374823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:59.375807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:59.382333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.382815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.383652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.384193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.521529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:59.529691 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-975a0a00-391b-4a62-b4df-255fe67dfb7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1507 microversion: 2.1 time: 0.159365 Jul 30 21:47:59.530386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3063/6173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:59 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:47:59.549902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:47:59.552623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:59.559321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.559799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.560571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.561019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.640495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:59.646471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Old instance type m1.heat2, new instance type m1.heat {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:47:59.653203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:47:59.653631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:47:59.654111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:47:59.654527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:47:59.654944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:47:59.760842 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb41d371-a729-4d8d-ac68-caf55beb2d25 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8/action" status: 202 len: 0 microversion: 2.1 time: 0.214549 Jul 30 21:47:59.761519 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3111/6174] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:47:59 2022] POST /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:47:59.770211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:47:59.770932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:47:59.778636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.779127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.779977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:47:59.780458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:47:59.944861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:47:59.953207 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1bc2eceb-5076-4e90-8f0a-b8abf97371c9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1518 microversion: 2.1 time: 0.186980 Jul 30 21:47:59.953791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3064/6175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:47:59 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:00.975248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:00.975903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:00.984367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:00.984838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:00.985618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:00.986073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:00.988691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:01.130400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:01.139594 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1679b753-4574-4bfc-9fdd-4e02424b0eee tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1518 microversion: 2.1 time: 0.168320 Jul 30 21:48:01.140174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3112/6176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:00 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:02.160549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:02.161110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:02.163892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=36 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:02.169903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:02.170404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:02.171198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:02.171701 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:02.309442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:02.317204 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1d14e87a-0949-4092-b852-1080d94943e6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.160716 Jul 30 21:48:02.317786 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3065/6177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:02 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:03.339706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:03.340332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:03.343013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:03.348328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:03.348792 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:03.349558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:03.350002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:03.482778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:03.490373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7e0ebc3d-3caa-4697-ba94-10f7d87f5f7e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.155087 Jul 30 21:48:03.490938 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3113/6178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:03 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:04.511762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:04.512333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:04.519633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:04.520107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:04.520892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:04.521354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:04.649096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:04.657406 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05077477-bcb5-46ca-a5f6-5db69702eeaa tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.150277 Jul 30 21:48:04.657987 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3066/6179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:04 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:05.678275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:05.678946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:05.686431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:05.686906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:05.687732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:05.688191 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:05.825689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:05.833149 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7cf3fd5-50d8-4909-8238-ee9939ff3477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.158797 Jul 30 21:48:05.833722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3114/6180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:05 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:06.854908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:06.855570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:06.862563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:06.863036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:06.863862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:06.864323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:07.000456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:07.008374 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-114c49f9-56a7-41e5-8399-d28835b83247 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.157518 Jul 30 21:48:07.008941 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3067/6181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:06 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:08.030816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:08.031477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:08.038567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:08.039034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:08.039841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:08.040300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:08.173737 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:08.181387 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-59c6976a-7643-45bc-b396-8d7c8aa6f3ab tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.154518 Jul 30 21:48:08.182054 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3115/6182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:08 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:09.202527 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:09.203165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:09.210363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:09.210840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:09.211662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:09.212129 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:09.342684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:09.350306 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5646f0d1-6a9a-46e7-82b9-38d7762e7495 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.151831 Jul 30 21:48:09.350879 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3068/6183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:09 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:10.372389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:10.373016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:10.380335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:10.380803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:10.381583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:10.382038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:10.511550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:10.519270 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b5ac31bd-22d0-4f0a-8b66-549f9d3ced63 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.151319 Jul 30 21:48:10.519862 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3116/6184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:10 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:11.540342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:11.540971 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:11.547466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:11.547950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:11.548749 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:11.549218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:11.681146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:11.689308 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63338fc3-8bb5-48ec-95a7-1071dddc0bf7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.153106 Jul 30 21:48:11.689881 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3069/6185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:11 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:12.710869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:12.711516 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:12.718604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:12.719119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:12.719924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:12.720370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:12.850213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:12.858277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4c78e81c-6374-4a91-b323-519d5a8adb0d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.151381 Jul 30 21:48:12.858842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3117/6186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:12 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:13.878835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:13.879507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:13.887262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:13.887779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:13.888833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:13.889302 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:14.023952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:14.031654 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e91e852-f65c-45b2-85d8-d17bb6025b76 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.156717 Jul 30 21:48:14.032249 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3070/6187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:13 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:15.052558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:15.053193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:15.061253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:15.061722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:15.062539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:15.062992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:15.197103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:15.204708 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8991bc3b-0222-46cb-9b73-415df103ab7f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.156060 Jul 30 21:48:15.205277 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3118/6188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:15 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:16.225493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:16.226139 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:16.233271 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:16.233759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:16.234570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:16.235189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:16.367263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:16.375549 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-84adb43b-d778-46a9-b16e-0a6c4206587b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.154062 Jul 30 21:48:16.376133 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3071/6189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:16 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:17.397190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:17.397815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:17.404874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:17.405335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:17.406101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:17.406547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:17.538908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:17.547068 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-690c94ae-3339-421d-84ee-37fad3086057 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.153860 Jul 30 21:48:17.547669 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3119/6190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:17 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:18.569186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:18.569827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:18.577626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:18.578107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:18.578893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:18.579392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:18.716809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:18.725147 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5bacd989-c37e-4992-bf66-e3ddca0ab2b4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.159965 Jul 30 21:48:18.725742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3072/6191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:18 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:19.746031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:19.746684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:19.753968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:19.754449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:19.755240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:19.755721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:19.898123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:19.905772 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-461d1f1a-fce9-4a5d-98ca-37b9616402f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.163701 Jul 30 21:48:19.906339 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3120/6192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:19 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:20.925986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:20.926633 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:20.933906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:20.934390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:20.935197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:20.935699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:20.954136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:21.073571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:21.081716 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fe562fc-28e4-4a6b-b403-7c72526d8a7d tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.159758 Jul 30 21:48:21.082297 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3073/6193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:20 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:22.102448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:22.103070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:22.110762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:22.111223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:22.112022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:22.112469 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:22.242143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:22.249914 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7f287cbe-38dd-41cb-b4a4-65fba4fa94ae tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.151299 Jul 30 21:48:22.250434 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3121/6194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:22 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:23.270893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:23.271482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:23.278557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:23.279037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:23.279865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:23.280332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:23.411865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:23.420069 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b12d2a6f-6f92-4b0e-9dc6-09bb5e785f78 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.153191 Jul 30 21:48:23.420646 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3074/6195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:23 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:24.441619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:24.442255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:24.449964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:24.450436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:24.451218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:24.451702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:24.582708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:24.590398 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fe57282f-b8f2-43f7-b4d3-44a02d6cfb32 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.152763 Jul 30 21:48:24.590981 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3122/6196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:24 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:25.613997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:25.614636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:25.621514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:25.622002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:25.622797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:25.623265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:25.752750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:25.760559 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a1c1bae8-e03b-4f74-84f1-1dc08b202376 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.153095 Jul 30 21:48:25.761132 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3075/6197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:25 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:26.782905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:26.783565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:26.790644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:26.791113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:26.791923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:26.792375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:26.933071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:26.940850 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7051271b-9c9b-4e09-9504-30f35188803b tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.161873 Jul 30 21:48:26.941424 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3123/6198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:26 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:27.961881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:27.962529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:27.970418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:27.970898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:27.971742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:27.972207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:28.109774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:28.117435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2138b1a5-b935-4341-b9c3-34d4b16562e5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.159646 Jul 30 21:48:28.118014 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3076/6199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:27 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:29.138961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:29.139638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:29.146789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:29.147263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:29.148141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:29.148601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:29.279328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:29.286925 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-528fd666-6141-48a5-a30b-39b1dead98df tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.152817 Jul 30 21:48:29.287536 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3124/6200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:29 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:30.307956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:30.308619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:30.315740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:30.316233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:30.317035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:30.317508 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:30.450245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:30.457900 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0675c192-fe7e-4070-9059-ba431258716e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.153889 Jul 30 21:48:30.458477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3077/6201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:30 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:31.479785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:31.480422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:31.487477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:31.487948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:31.488732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:31.489188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:31.491808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=78 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:31.624380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:31.632052 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f255e124-3ced-4493-adc8-5f6d87d468f7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.156674 Jul 30 21:48:31.632635 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3125/6202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:31 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:32.653362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:32.656245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:32.659175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=26 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:32.667029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:32.667537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:32.668539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:32.668999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:32.805334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:32.813490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b41f73e-89dc-4d28-8af4-27b9337d5913 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1523 microversion: 2.1 time: 0.164119 Jul 30 21:48:32.814076 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3078/6203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:32 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:33.835274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:33.836078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:33.839898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=26 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:33.845847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:33.846320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:33.847118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:33.847642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:34.053287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:34.061477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2c70d8fe-d0db-4d1e-9ff0-d7f82e1fb285 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1522 microversion: 2.1 time: 0.230150 Jul 30 21:48:34.062060 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3126/6204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:33 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:34.319533 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "name": "network-vif-unplugged", "status": "completed", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:34.330551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:34.331105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:34.343991 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] Creating event network-vif-unplugged:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch2-master-1 Jul 30 21:48:34.349712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:48:34.361679 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a75415d6-a30d-4711-8c28-facb1072287d req-cdf55012-0530-4aed-af22-bdda1c83544f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046121 Jul 30 21:48:34.362361 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3079/6205] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:35.083858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:35.084671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:35.092281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:35.092753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:35.093536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:35.093988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:35.235782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:35.243532 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-804f0be1-7d16-4365-8255-21d6e21db961 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1522 microversion: 2.1 time: 0.163825 Jul 30 21:48:35.244103 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3127/6206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:35 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:36.266845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:36.267540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:36.274013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:36.274502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:36.275331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:36.276451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:36.379008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:36.390016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:36.390472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:36.402024 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] Creating event network-changed:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch2-master-1 Jul 30 21:48:36.407689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:48:36.411251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:36.419218 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fc30041d-0db9-42cd-8074-7462228231b9 req-b298f656-1cca-4255-aeb2-ca01b5813b0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043965 Jul 30 21:48:36.419898 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3128/6207] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:36.420805 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b5304e2a-da27-47bb-8e6c-b68c50985719 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1520 microversion: 2.1 time: 0.160289 Jul 30 21:48:36.421684 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3080/6208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:36 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:37.443127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:37.443853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:37.450950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.451442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.452335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.452809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.574069 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:48:37.574295 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 (ip 10.222.0.17) !!! Jul 30 21:48:37.587477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:37.595105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9773a5df-bbc9-4dfa-bf05-6b26deeb0e31 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1517 microversion: 2.1 time: 0.157161 Jul 30 21:48:37.595718 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3129/6209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:37 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:37.615252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:37.615858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:37.623425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.623910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.624739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.625209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.684485 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a06c3fde-9949-4a6a-91ef-ed187ffb0c24 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8/action" status: 204 len: 0 microversion: 2.1 time: 0.072969 Jul 30 21:48:37.685220 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3081/6210] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:48:37 2022] POST /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:48:37.694493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:37.695060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:37.701912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.702470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.703431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:37.703949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:37.841054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:37.848939 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f2b557e-99c5-4441-8b8c-2fb9d9f9f804 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1517 microversion: 2.1 time: 0.159495 Jul 30 21:48:37.849511 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3130/6211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:37 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:38.871732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:38.872396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:38.878947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:38.879459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:38.880264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:38.880735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:39.021337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:39.029135 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bec6e03b-a0a3-4388-8bf0-83a559aa4c84 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1517 microversion: 2.1 time: 0.162748 Jul 30 21:48:39.029732 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3082/6212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:38 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:40.049881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:40.050430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:40.057624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:40.058078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:40.058848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:40.059390 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:40.190113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:40.198226 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f219b81-021b-4cb2-a4af-88083f7e8533 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1509 microversion: 2.1 time: 0.151731 Jul 30 21:48:40.198849 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3131/6213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:40 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:40.219274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:40.219945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:40.226370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:40.226854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:40.227684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:40.228154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:40.358093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:40.365759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8441a60e-e1ae-402f-bd3f-2777a56ca9f6 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1509 microversion: 2.1 time: 0.150622 Jul 30 21:48:40.366337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3083/6214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:40 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:40.389563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-deb64e25-a22f-431c-bb16-e3bc6b525e97 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'create', calling method: .version_select at 0x7fbb5cf93b80>, body: {"keypair": {"name": "tempest-keypair-990753429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNBqwpFD+6JowQ1IVc6jXc/ORX55+XGii/ButG8MsgIrNmLWZQRyFYsdJyE5tgNkEGNQyymwh4tVI1SlvOeB4uBBjpT393GlBNScgAqyv/HjuZ0DDBV1gHSwhSSMIcSMQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:40.405380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-deb64e25-a22f-431c-bb16-e3bc6b525e97 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for project d6fde8f046df422fa52fe982d42e95a5. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:48:40.410466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-deb64e25-a22f-431c-bb16-e3bc6b525e97 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for user 45bbff38b6eb4ef6a4e32a1569d32493 and project d6fde8f046df422fa52fe982d42e95a5. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:48:40.438273 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-deb64e25-a22f-431c-bb16-e3bc6b525e97 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053379 Jul 30 21:48:40.438886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3132/6215] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:41.563463 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-fc583a16-6dd1-4d61-9b85-daecc1e6273a req-67f6e86c-adfb-40da-8552-6b96042e3f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "name": "network-vif-plugged", "status": "completed", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:41.576144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fc583a16-6dd1-4d61-9b85-daecc1e6273a req-67f6e86c-adfb-40da-8552-6b96042e3f87 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:41.576623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-fc583a16-6dd1-4d61-9b85-daecc1e6273a req-67f6e86c-adfb-40da-8552-6b96042e3f87 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:41.590260 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-fc583a16-6dd1-4d61-9b85-daecc1e6273a req-67f6e86c-adfb-40da-8552-6b96042e3f87 service nova] Creating event network-vif-plugged:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch2-master-1 Jul 30 21:48:41.595492 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-fc583a16-6dd1-4d61-9b85-daecc1e6273a req-67f6e86c-adfb-40da-8552-6b96042e3f87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Jul 30 21:48:41.596400 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3084/6216] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:41.643321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:41.643965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:41.650964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:41.651489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:41.652275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:41.652736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:41.782471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:41.790171 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-727a88e9-19bb-4972-8074-7fd09c74f07f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 200 len: 1509 microversion: 2.1 time: 0.151245 Jul 30 21:48:41.790740 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3133/6217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:41 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:41.811549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:41.812186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:41.818632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:41.819122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:41.819960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:41.820432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:41.845722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:48:41.929934 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-765cc22c-b6d4-4c95-8489-1415eea4b234 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 204 len: 0 microversion: 2.1 time: 0.123053 Jul 30 21:48:41.930961 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3085/6218] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:48:41 2022] DELETE /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:48:41.989861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-815556374", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "b2fd7180-74e3-4b1c-bee2-6ebc16347967"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:42.046136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] validate_networks() for [('b2fd7180-74e3-4b1c-bee2-6ebc16347967', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:48:42.507461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:48:42.507894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:48:42.508379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:48:42.508800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:48:42.509221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:48:42.519056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:42.519554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:42.520367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:42.520815 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:42.539543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for project d6fde8f046df422fa52fe982d42e95a5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:48:42.544994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Getting quotas for user 45bbff38b6eb4ef6a4e32a1569d32493 and project d6fde8f046df422fa52fe982d42e95a5. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:48:42.557496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:48:42.559828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:48:42.604864 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-43d5fe09-f4c5-45f3-b011-95877cbc1618 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618819 Jul 30 21:48:42.605520 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3134/6219] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:48:42.616996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-72e9d0f5-6501-443e-8757-107087af3e18 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:42.617816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-72e9d0f5-6501-443e-8757-107087af3e18 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:42.675422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-72e9d0f5-6501-443e-8757-107087af3e18 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:42.683449 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-72e9d0f5-6501-443e-8757-107087af3e18 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1217 microversion: 2.1 time: 0.070836 Jul 30 21:48:42.684046 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3086/6220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:42 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:48:43.714669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:43.717227 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:43.727075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:43.727445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:43.728441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:43.729616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:43.773449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-abfcd7d9-694a-49e7-bc6d-c2bcf8a7f3b8 req-141ec5f6-4319-44ff-98b5-a2c3f21bc99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b963d97-fd10-4cfe-8186-0271eafed2a8", "name": "network-vif-deleted", "tag": "127a0573-b262-49c1-b5d4-463349847c8b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:43.785986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-abfcd7d9-694a-49e7-bc6d-c2bcf8a7f3b8 req-141ec5f6-4319-44ff-98b5-a2c3f21bc99b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:43.787127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-abfcd7d9-694a-49e7-bc6d-c2bcf8a7f3b8 req-141ec5f6-4319-44ff-98b5-a2c3f21bc99b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:43.801055 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-abfcd7d9-694a-49e7-bc6d-c2bcf8a7f3b8 req-141ec5f6-4319-44ff-98b5-a2c3f21bc99b service nova] Creating event network-vif-deleted:127a0573-b262-49c1-b5d4-463349847c8b for instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 on nch2-master-1 Jul 30 21:48:43.806732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-abfcd7d9-694a-49e7-bc6d-c2bcf8a7f3b8 req-141ec5f6-4319-44ff-98b5-a2c3f21bc99b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Jul 30 21:48:43.808010 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3087/6221] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:43.840920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:43.849084 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6d4a7811-1e92-46d8-84f4-5f595a80e477 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1275 microversion: 2.1 time: 0.148691 Jul 30 21:48:43.849859 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3135/6222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:43 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:44.878140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:44.878996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:44.886226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:44.886791 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:44.887676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:44.888146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:45.090883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-d44a0404-8eed-48a0-b5e0-8a1daa3401b1 req-6c0caf16-ff08-4913-9580-61b5b9fce974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c940c6-5bd6-49e7-aa38-522867fc6e53", "tag": "fc01f7e7-20d1-42e4-a936-0678860bf0e8"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:45.102804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d44a0404-8eed-48a0-b5e0-8a1daa3401b1 req-6c0caf16-ff08-4913-9580-61b5b9fce974 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:45.103258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-d44a0404-8eed-48a0-b5e0-8a1daa3401b1 req-6c0caf16-ff08-4913-9580-61b5b9fce974 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:45.115784 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-d44a0404-8eed-48a0-b5e0-8a1daa3401b1 req-6c0caf16-ff08-4913-9580-61b5b9fce974 service nova] Creating event network-changed:fc01f7e7-20d1-42e4-a936-0678860bf0e8 for instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 on nch1-master-1 Jul 30 21:48:45.122164 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-d44a0404-8eed-48a0-b5e0-8a1daa3401b1 req-6c0caf16-ff08-4913-9580-61b5b9fce974 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115280 Jul 30 21:48:45.123163 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3136/6223] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:45.152826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:45.162630 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-742b7603-7519-4ba5-bbc1-71dbc9dee458 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1317 microversion: 2.1 time: 0.289863 Jul 30 21:48:45.164155 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3088/6224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:44 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:46.186490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:46.187241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:46.193686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:46.194151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:46.194923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:46.195405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:46.330182 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:46.338247 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2f8af5f7-d57e-466d-8bf8-422b883434b8 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1317 microversion: 2.1 time: 0.157474 Jul 30 21:48:46.338837 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3137/6225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:46 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:47.360831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:47.361478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:47.368707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:47.369228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:47.370032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:47.370532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:47.506431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:47.514636 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67071e26-efb7-4098-91da-ecef403c2eeb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1317 microversion: 2.1 time: 0.157714 Jul 30 21:48:47.515333 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3089/6226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:47 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:48.534865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:48.535524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:48.542520 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:48.543508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:48.544292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:48.544743 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:48.675098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:48.683363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1ec49857-1a8c-4f66-b7d7-9ea4e1feb2a0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1317 microversion: 2.1 time: 0.152315 Jul 30 21:48:48.683966 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3138/6227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:48 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:49.270274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a8a68f49-cde1-421f-ad5c-54855e14723e req-c94aa33c-8a0a-4b8f-9978-f17ae738f0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c940c6-5bd6-49e7-aa38-522867fc6e53", "name": "network-vif-plugged", "status": "completed", "tag": "fc01f7e7-20d1-42e4-a936-0678860bf0e8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:49.280632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a8a68f49-cde1-421f-ad5c-54855e14723e req-c94aa33c-8a0a-4b8f-9978-f17ae738f0b0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:49.281112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a8a68f49-cde1-421f-ad5c-54855e14723e req-c94aa33c-8a0a-4b8f-9978-f17ae738f0b0 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:49.284965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:49.295805 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a8a68f49-cde1-421f-ad5c-54855e14723e req-c94aa33c-8a0a-4b8f-9978-f17ae738f0b0 service nova] Creating event network-vif-plugged:fc01f7e7-20d1-42e4-a936-0678860bf0e8 for instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 on nch1-master-1 Jul 30 21:48:49.301014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a8a68f49-cde1-421f-ad5c-54855e14723e req-c94aa33c-8a0a-4b8f-9978-f17ae738f0b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112918 Jul 30 21:48:49.301625 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3090/6228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:48:49.704627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:49.705281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:49.712417 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:49.712884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:49.713660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:49.714116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:49.846515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:49.854127 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-53e63457-dc36-4bac-8a44-99e829fe38f9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1317 microversion: 2.1 time: 0.153436 Jul 30 21:48:49.854739 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3139/6229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:49 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:50.877977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:50.878721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:50.886900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:50.887453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:50.888270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:50.888746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.020491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:51.028771 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c100274b-cf97-4069-adfd-03543bc470d4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1508 microversion: 2.1 time: 0.157302 Jul 30 21:48:51.029349 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3091/6230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:50 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:51.049526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:51.050311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:51.057661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.058175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.058950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.059424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.194415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:51.203130 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf903fd0-5cdf-4fdd-85b5-41a710cfa0fc tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1508 microversion: 2.1 time: 0.157732 Jul 30 21:48:51.203744 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3140/6231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:51 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:51.223364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:48:51.225781 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:51.232587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.233062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.233851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.234312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.262961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:51.269002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:48:51.275156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:48:51.275637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:48:51.276138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:48:51.276568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:48:51.277651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:48:51.340187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3497d4ff-ffdf-4aa0-95f0-d64b14d99cdf tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53/action" status: 202 len: 0 microversion: 2.1 time: 0.119728 Jul 30 21:48:51.340800 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3092/6232] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:48:51 2022] POST /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:48:51.348755 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:51.349375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:51.356095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.356558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.357330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:51.357777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:51.494870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:51.503497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6ba0a6e0-fa87-4943-a9e0-30dcebae3d68 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1515 microversion: 2.1 time: 0.158510 Jul 30 21:48:51.504083 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3141/6233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:51 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:52.525770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:52.526404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:52.534152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:52.534628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:52.535452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:52.535919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:52.665164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:52.673548 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9f3b4762-1d4d-4fbe-beee-54ae96d00096 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1515 microversion: 2.1 time: 0.151763 Jul 30 21:48:52.674135 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3093/6234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:52 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:53.694204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:53.694738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:53.697608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:53.698291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=10 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:53.704300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:53.704765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:53.705541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:53.705996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:53.841859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:53.849414 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fbd45151-5b4a-4794-9f7f-4ee17d326670 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.159281 Jul 30 21:48:53.849985 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3142/6235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:53 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:54.871151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:54.871822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:54.873870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:54.880659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:54.881143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:54.881951 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:54.882426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:55.018362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:55.027300 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-00dee1f8-fa65-48bb-8788-bb1479adc907 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.160573 Jul 30 21:48:55.027921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3094/6236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:54 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:56.048826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:56.049456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:56.056554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:56.057020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:56.057798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:56.058251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:56.194149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:56.202668 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35ff076e-975f-499d-952f-24a632629f19 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.157761 Jul 30 21:48:56.203249 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3143/6237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:56 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:57.223800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:57.224444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:57.232039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:57.232520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:57.233322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:57.233790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:57.366621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:57.374253 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-81138df1-26c5-44ad-bcf4-722498510d3c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.154485 Jul 30 21:48:57.374822 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3095/6238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:57 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:58.395977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:58.396608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:58.404110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:58.404573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:58.405351 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:58.405804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:58.421065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:58.539504 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:58.547616 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2c66b0c4-2a5d-4a8b-9f8e-4b5869b6b564 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.155591 Jul 30 21:48:58.548200 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3144/6239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:58 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:48:59.568960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:48:59.569602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:48:59.576795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:59.577277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:59.578069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:48:59.578538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:48:59.713098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:48:59.722225 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-313d6e8c-d1c9-43c9-b8d5-b727e05c34e1 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.156772 Jul 30 21:48:59.723321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3096/6240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:48:59 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:00.748180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:00.748818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:00.755969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:00.756442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:00.757228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:00.757688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:00.891178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:00.898769 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-445bb315-a665-4f46-879b-e0de02e9e02a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.155214 Jul 30 21:49:00.899375 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3145/6241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:00 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:01.919373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:01.920024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:01.927096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:01.927623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:01.928426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:01.928901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:02.066918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:02.075670 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f178f699-089f-4fe3-b345-566f2c543a90 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.160676 Jul 30 21:49:02.076196 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3097/6242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:01 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:03.096581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:03.097322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:03.104490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:03.104960 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:03.105747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:03.106204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:03.235060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:03.244505 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a69b03da-949e-4578-b067-d3713b9a969c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.151669 Jul 30 21:49:03.245089 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3146/6243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:03 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:04.267030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:04.267713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:04.270555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:04.275989 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:04.276474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:04.277897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:04.278367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:04.408341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:04.416401 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d774596-a5db-425c-abe2-57ad51c1a02c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.153426 Jul 30 21:49:04.417781 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3098/6244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:04 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:05.437221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:05.437914 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:05.440670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:05.446311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:05.446771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:05.447571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:05.448019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:05.583500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:05.591921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d734baee-98d3-4515-83bb-6e2ea8522909 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.158636 Jul 30 21:49:05.592889 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3147/6245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:05 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:06.613450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:06.614099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:06.621938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:06.622429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:06.623234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:06.623729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:06.752987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:06.760730 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b232fb69-a720-426d-8583-5ebdfa829222 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.151293 Jul 30 21:49:06.761310 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3099/6246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:06 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:07.781284 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:07.781911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:07.788856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:07.789318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:07.790121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:07.790569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:07.920649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:07.928328 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd107d98-37de-44bd-82bc-a3dee9d59755 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.151002 Jul 30 21:49:07.928910 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3148/6247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:07 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:08.949103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:08.950324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:08.957524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:08.958009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:08.958816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:08.959317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:09.093297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:09.101060 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-690f7649-2c8b-4009-997c-d84fb2278dec tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.155899 Jul 30 21:49:09.101647 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3100/6248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:08 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:10.123178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:10.123875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:10.130879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:10.131396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:10.132203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:10.132649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:10.266133 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:10.273881 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-345314b5-8071-4cd5-a7a8-f04d8c352750 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.155240 Jul 30 21:49:10.274448 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3149/6249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:10 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:11.294694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:11.295256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:11.301714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:11.302199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:11.302990 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:11.303495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:11.432244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:11.440524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-903302ff-1a78-4589-b043-439199fdf690 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.150166 Jul 30 21:49:11.441114 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3101/6250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:11 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:12.462085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:12.462710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:12.469993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:12.470461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:12.471236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:12.471711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:12.600925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:12.608649 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ac06b5f-d189-4d0f-a828-8b1e05e84fd7 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.150660 Jul 30 21:49:12.609217 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3150/6251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:12 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:13.629177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:13.629821 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:13.636859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:13.637344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:13.638147 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:13.638615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:13.776735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:13.785962 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b7ab26e2-f5c1-443a-8a1d-983c84451e48 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.160733 Jul 30 21:49:13.786552 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3102/6252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:13 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:14.806116 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:14.806763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:14.814638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:14.815103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:14.815912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:14.816363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:14.944835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:14.952368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a99044ed-01fe-4cfb-a6d3-19bb5ece4dd4 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.150215 Jul 30 21:49:14.952938 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3151/6253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:14 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:49:15.973621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:15.974269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:15.981798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:15.983075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:15.984367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:15.984847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:16.118557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:16.127676 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-583d17df-3604-43b7-b720-0272577e2d8e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.157973 Jul 30 21:49:16.128265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3103/6254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:15 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:17.149368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:17.150003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:17.158123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:17.158596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:17.159439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:17.159909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:17.295623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:17.303125 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fb701f4b-5b92-40f4-b3fa-c2efc920d776 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.157691 Jul 30 21:49:17.303722 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3152/6255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:17 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:18.324944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:18.325581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:18.332761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:18.333235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:18.334027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:18.334489 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:18.466907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:18.474471 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c76a87ef-6c82-4cbc-b661-c3f91fffb08f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.154040 Jul 30 21:49:18.475047 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3104/6256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:18 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:19.495567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:19.496215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:19.502934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:19.503428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:19.504206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:19.504657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:19.636533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:19.644452 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5cb29f28-b3e2-4cda-9229-a1091e58e382 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1520 microversion: 2.1 time: 0.153087 Jul 30 21:49:19.645025 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3153/6257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:19 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:20.525275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c940c6-5bd6-49e7-aa38-522867fc6e53", "name": "network-vif-unplugged", "status": "completed", "tag": "fc01f7e7-20d1-42e4-a936-0678860bf0e8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:20.536270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:20.536785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:20.549787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] Creating event network-vif-unplugged:fc01f7e7-20d1-42e4-a936-0678860bf0e8 for instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 on nch2-master-1 Jul 30 21:49:20.555428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:49:20.567159 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3de66609-d1c2-4f46-b6e5-a7c5647f1474 req-525d6824-fc50-4857-8db4-e44fdcedbb3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045635 Jul 30 21:49:20.568002 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3105/6258] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:20.665749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:20.666382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:20.673909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:20.674381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:20.675379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:20.675837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:20.909159 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:20.917093 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2715aab3-5239-46e5-b153-fc7c51cf9fcb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1519 microversion: 2.1 time: 0.255184 Jul 30 21:49:20.917811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3154/6259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:20 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:21.939792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:21.940449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:21.946870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:21.947391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:21.948309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:21.948790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:21.953072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:22.087814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:22.096254 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4265257d-bdda-4050-ab88-4fcfd2122d38 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1517 microversion: 2.1 time: 0.161980 Jul 30 21:49:22.096838 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3106/6260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:21 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:22.584200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c940c6-5bd6-49e7-aa38-522867fc6e53", "tag": "fc01f7e7-20d1-42e4-a936-0678860bf0e8"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:22.594729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:22.595185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:22.607118 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] Creating event network-changed:fc01f7e7-20d1-42e4-a936-0678860bf0e8 for instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 on nch2-master-1 Jul 30 21:49:22.612632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:49:22.624227 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-dbd03252-1170-4cfc-a94b-1763a1ce2354 req-a28d8eb8-5b97-4f23-8430-319bb40a2b7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043681 Jul 30 21:49:22.624819 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3155/6261] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:23.117373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:23.118044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:23.126420 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.126904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.128175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.128653 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.365566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:23.375230 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-578b7684-aab7-455b-9cff-c6da28819132 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1514 microversion: 2.1 time: 0.262093 Jul 30 21:49:23.375801 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3107/6262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:23 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:23.398263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:23.399534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:23.406963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.407467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.408287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.408744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.471862 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69514736-3ffe-4a32-8ff3-81bfdac0a1d0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "POST /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53/action" status: 204 len: 0 microversion: 2.1 time: 0.078780 Jul 30 21:49:23.472697 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3156/6263] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:49:23 2022] POST /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:49:23.482354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:23.483014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:23.489756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.490249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.491278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:23.491892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:23.679745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:23.687591 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-afdbcb4b-ad36-4819-8061-27faed00a45a tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1514 microversion: 2.1 time: 0.210669 Jul 30 21:49:23.688174 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3108/6264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:23 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:49:24.709327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:24.710042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:24.717104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:24.717564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:24.718338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:24.718785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:24.853768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:24.862193 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-181b83a2-f34d-44d0-9b22-124f1f7723b9 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1506 microversion: 2.1 time: 0.157939 Jul 30 21:49:24.862772 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3157/6265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:24 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:24.882413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:24.882998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:24.890292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:24.890775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:24.891612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:24.892087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.032978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:25.040686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddd38894-4fd3-4f83-9814-e3f4ee0dd1eb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1506 microversion: 2.1 time: 0.162221 Jul 30 21:49:25.041277 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3109/6266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:24 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:25.062010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:25.062649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:25.068814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.069288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.070076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.070536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.197118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:25.205201 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a913f714-cc2d-408d-a4ab-5b07c56532fb tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1506 microversion: 2.1 time: 0.147827 Jul 30 21:49:25.205780 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3158/6267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:25 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:25.225510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:25.226029 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:25.232277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.232753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.233535 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.233995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.258619 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:49:25.332990 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e5e3989c-21bf-4122-b396-3e9156a611d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "DELETE /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 204 len: 0 microversion: 2.1 time: 0.110798 Jul 30 21:49:25.333646 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3110/6268] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:49:25 2022] DELETE /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:49:25.350693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:25.351203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:25.357352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.357810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.358578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.359022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.385137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:49:25.400524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:25.432445 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.compute.api [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Instance is already in deleting state, ignoring this request Jul 30 21:49:25.433277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cd0b209-2206-48b9-b211-45a5b2b5c37c tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "DELETE /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 204 len: 0 microversion: 2.1 time: 0.087548 Jul 30 21:49:25.433846 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3159/6269] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:49:25 2022] DELETE /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:49:25.443369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:25.444250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:25.451169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.451661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.452470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:25.452946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:25.583762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:25.591955 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75edfc29-16eb-4760-8d71-e431c8383e2e tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1512 microversion: 2.1 time: 0.153007 Jul 30 21:49:25.592559 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3111/6270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:25 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:26.612780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:26.613561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:26.620729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:26.621197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:26.622038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:26.622543 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:26.852589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bbff38b6eb4ef6a4e32a1569d32493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fde8f046df422fa52fe982d42e95a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:26.860399 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-67aff6ba-1ce8-47b0-80ee-c6a3cb0263a3 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 200 len: 1512 microversion: 2.1 time: 0.251595 Jul 30 21:49:26.861059 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3160/6271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:26 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:27.130756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2ae7fce1-4bf1-40af-b7c6-601d9d44be58 req-a0bc4003-665d-4609-895c-3f82552a3907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c940c6-5bd6-49e7-aa38-522867fc6e53", "name": "network-vif-deleted", "tag": "fc01f7e7-20d1-42e4-a936-0678860bf0e8"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:27.145837 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2ae7fce1-4bf1-40af-b7c6-601d9d44be58 req-a0bc4003-665d-4609-895c-3f82552a3907 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:27.146325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2ae7fce1-4bf1-40af-b7c6-601d9d44be58 req-a0bc4003-665d-4609-895c-3f82552a3907 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:27.160740 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2ae7fce1-4bf1-40af-b7c6-601d9d44be58 req-a0bc4003-665d-4609-895c-3f82552a3907 service nova] Creating event network-vif-deleted:fc01f7e7-20d1-42e4-a936-0678860bf0e8 for instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 on nch2-master-1 Jul 30 21:49:27.167202 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2ae7fce1-4bf1-40af-b7c6-601d9d44be58 req-a0bc4003-665d-4609-895c-3f82552a3907 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040138 Jul 30 21:49:27.168071 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3112/6272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:49:27.881843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:27.882484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 25c940c6-5bd6-49e7-aa38-522867fc6e53] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:27.890726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:27.891197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:27.892008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:27.892461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:27.906021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] HTTP exception thrown: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Request method failure captured: Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 HTTP/1.1 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5acEZdns_uLRr2dRB-Xd_q77Lj5Yc8MjxACuOB-JO9IKV1fDMqGDOHtYzkBNrn-kqlZo37_LGR_hCzpl0OjWqLkZ6O6rQ38tTY3_joqj1u02frAh83RXaJJyppoAYo_u0cixXNLVD-tBSAMx45tKEhsk2YlSXRbyLT59q_ihjkJkJ30 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6fde8f046df422fa52fe982d42e95a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 45bbff38b6eb4ef6a4e32a1569d32493 Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '25c940c6-5bd6-49e7-aa38-522867fc6e53'} Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:27.907698 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Returning 404 to user: Instance 25c940c6-5bd6-49e7-aa38-522867fc6e53 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d0d03f73-88b2-4ed6-aeda-69891b472bd0 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53" status: 404 len: 111 microversion: 2.1 time: 0.031188 Jul 30 21:49:27.912143 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3161/6273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:27 2022] GET /compute/v2.1/servers/25c940c6-5bd6-49e7-aa38-522867fc6e53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:49:27.918363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7658216e-cf58-4870-b68c-b0f4261812ed tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '.version_select at 0x7fbb5c8ab790>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:27.942043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7658216e-cf58-4870-b68c-b0f4261812ed tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990753429" status: 202 len: 0 microversion: 2.1 time: 0.027902 Jul 30 21:49:27.942626 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3113/6274] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Jul 30 21:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990753429 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:49:28.535745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:28.536265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:28.542699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:28.543166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:28.544658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:28.545108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:28.558594 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] HTTP exception thrown: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Request method failure captured: Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: request: DELETE /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 HTTP/1.1 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5acEZdns_uLRr2dRB-Xd_q77Lj5Yc8MjxACuOB-JO9IKV1fDMqGDOHtYzkBNrn-kqlZo37_LGR_hCzpl0OjWqLkZ6O6rQ38tTY3_joqj1u02frAh83RXaJJyppoAYo_u0cixXNLVD-tBSAMx45tKEhsk2YlSXRbyLT59q_ihjkJkJ30 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6fde8f046df422fa52fe982d42e95a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 45bbff38b6eb4ef6a4e32a1569d32493 Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1b963d97-fd10-4cfe-8186-0271eafed2a8'} Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:49:28.560591 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Returning 404 to user: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e33f3b6-aa31-480c-a836-0bfb4754803f tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 404 len: 111 microversion: 2.1 time: 0.030444 Jul 30 21:49:28.564558 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3162/6275] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:49:28 2022] DELETE /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:49:28.572580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:28.573377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] [instance: 1b963d97-fd10-4cfe-8186-0271eafed2a8] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:28.580379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:28.580862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:28.581655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:28.582143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:28.595922 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] HTTP exception thrown: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Request method failure captured: Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 HTTP/1.1 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5acEZdns_uLRr2dRB-Xd_q77Lj5Yc8MjxACuOB-JO9IKV1fDMqGDOHtYzkBNrn-kqlZo37_LGR_hCzpl0OjWqLkZ6O6rQ38tTY3_joqj1u02frAh83RXaJJyppoAYo_u0cixXNLVD-tBSAMx45tKEhsk2YlSXRbyLT59q_ihjkJkJ30 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6fde8f046df422fa52fe982d42e95a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6fde8f046df422fa52fe982d42e95a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: d6fde8f046df422fa52fe982d42e95a5 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1154196136 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 45bbff38b6eb4ef6a4e32a1569d32493 Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerDiskConfigTestJSON-1154196136-project Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1b963d97-fd10-4cfe-8186-0271eafed2a8'} Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:49:28.597568 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] Returning 404 to user: Instance 1b963d97-fd10-4cfe-8186-0271eafed2a8 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-93ebfaf9-614d-44c2-b335-39bea77840d5 tempest-ServerDiskConfigTestJSON-1154196136 tempest-ServerDiskConfigTestJSON-1154196136-project] 10.222.0.17 "GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8" status: 404 len: 111 microversion: 2.1 time: 0.032286 Jul 30 21:49:28.601972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3114/6276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:28 2022] GET /compute/v2.1/servers/1b963d97-fd10-4cfe-8186-0271eafed2a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:49:37.044597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-aa306412-c466-45c5-b8e3-b2f3fd414fd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: .version_select at 0x7fbb5cd06ca0>, body: {"keypair": {"name": "tempest-keypair-1369312178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0AQekatp1kH9IAb2bvu12jWaPL5J5mVm+Dz2iktBXTVv6TPmrsTbS7FydjQOq4X4421CD12XzZixWDE+bpwiSMyN++DZv3GMk2tstiJw5z0VUwPVzyYEtJPoX5fZjUEQ=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:37.050144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=32 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:37.062123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-aa306412-c466-45c5-b8e3-b2f3fd414fd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:49:37.068564 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-aa306412-c466-45c5-b8e3-b2f3fd414fd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:49:37.094902 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-aa306412-c466-45c5-b8e3-b2f3fd414fd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181831 Jul 30 21:49:37.095565 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3163/6277] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:49:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:38.380809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2041687746", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71431093-0922-4685-93f5-43036332ac76"}], "security_groups": [{"name": "tempest-securitygroup--197795691"}], "key_name": "tempest-keypair-1369312178", "user_data": "}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:38.391988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:38.504626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] validate_networks() for [('71431093-0922-4685-93f5-43036332ac76', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:49:38.586798 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:38.937311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:49:38.937886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:49:38.938490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:49:38.939033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:49:38.939589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:49:38.949284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:38.949726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:38.951218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:38.951716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:38.969162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:49:38.974664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:49:38.987761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:49:38.990155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:49:39.045660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b644ba3-7f45-4412-89b4-cb53d4bfd778 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.669169 Jul 30 21:49:39.046340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3115/6278] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:49:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:49:39.054948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:39.059768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-295a3192-a044-4f9c-8a72-c05d76de61c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:39.060536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-295a3192-a044-4f9c-8a72-c05d76de61c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:39.141388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-295a3192-a044-4f9c-8a72-c05d76de61c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:39.150001 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-295a3192-a044-4f9c-8a72-c05d76de61c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1239 microversion: 2.1 time: 0.096724 Jul 30 21:49:39.151733 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3164/6279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:39 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:40.170762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:40.172061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:40.180215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:40.180900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:40.181893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:40.182540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:40.256907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:40.268070 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9caefafe-e731-41e5-a75c-70825877dd2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1297 microversion: 2.1 time: 0.101847 Jul 30 21:49:40.268665 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3116/6280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:40 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:41.289380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:41.289934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:41.298941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:41.299454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:41.300617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:41.301457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:41.543321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:41.551474 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b19990a-5054-440b-8107-8f9e8dc2fb69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.266618 Jul 30 21:49:41.552064 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3165/6281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:41 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:41.873188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a68c7f0f-b254-4e48-ae6f-ff1fc79fb312 req-4b3ed06f-adae-4f5e-b5b5-829dfcebcdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:41.886211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a68c7f0f-b254-4e48-ae6f-ff1fc79fb312 req-4b3ed06f-adae-4f5e-b5b5-829dfcebcdd1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:41.886790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a68c7f0f-b254-4e48-ae6f-ff1fc79fb312 req-4b3ed06f-adae-4f5e-b5b5-829dfcebcdd1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:41.903953 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a68c7f0f-b254-4e48-ae6f-ff1fc79fb312 req-4b3ed06f-adae-4f5e-b5b5-829dfcebcdd1 service nova] Creating event network-changed:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch2-master-1 Jul 30 21:49:41.909161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a68c7f0f-b254-4e48-ae6f-ff1fc79fb312 req-4b3ed06f-adae-4f5e-b5b5-829dfcebcdd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040960 Jul 30 21:49:41.910086 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3117/6282] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:42.572709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:42.573341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:42.580888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:42.581356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:42.582134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:42.582587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:42.711243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:42.718898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a7574af-5db4-4830-8412-7a5f52936e24 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.150115 Jul 30 21:49:42.719513 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3166/6283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:42 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:43.740932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:43.741700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:43.748102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:43.748587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:43.749395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:43.749868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:43.890392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:43.898134 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-06f07784-942c-4618-a620-e1d7e40232da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.162484 Jul 30 21:49:43.898709 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3118/6284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:43 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:44.919910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:44.920539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:44.927864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:44.928339 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:44.929126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:44.929586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:45.071213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:45.079025 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-35a4d5c5-f3e2-4301-bb7b-ddc8935b3538 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.163691 Jul 30 21:49:45.079645 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3167/6285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:44 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:46.101375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:46.102027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:46.110756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:46.111268 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:46.112382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:46.113053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:46.246499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:46.254710 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94e5689a-f867-4651-be69-9ddd166feb76 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.157479 Jul 30 21:49:46.255279 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3119/6286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:46 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:47.274910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:47.275487 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:47.282495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:47.282952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:47.283754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:47.284201 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:47.412681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:47.420787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-965d6751-6eda-4dbc-aba6-54c6f49415f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.149867 Jul 30 21:49:47.421357 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3168/6287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:47 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:47.741064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-307a77e5-b709-4ea6-acb5-728193e6e1c2 req-f75fc53d-c589-4cd1-abbd-117c38bfe43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "name": "network-vif-plugged", "status": "completed", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:47.752044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-307a77e5-b709-4ea6-acb5-728193e6e1c2 req-f75fc53d-c589-4cd1-abbd-117c38bfe43b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:47.752521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-307a77e5-b709-4ea6-acb5-728193e6e1c2 req-f75fc53d-c589-4cd1-abbd-117c38bfe43b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:47.764961 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-307a77e5-b709-4ea6-acb5-728193e6e1c2 req-f75fc53d-c589-4cd1-abbd-117c38bfe43b service nova] Creating event network-vif-plugged:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch2-master-1 Jul 30 21:49:47.769925 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-307a77e5-b709-4ea6-acb5-728193e6e1c2 req-f75fc53d-c589-4cd1-abbd-117c38bfe43b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032707 Jul 30 21:49:47.770722 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3120/6288] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:48.441184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:48.441811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:48.448881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:48.449343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:48.450142 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:48.450589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:48.590924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:48.598534 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-629d15d9-9052-4202-ab50-ce18166f93b6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1364 microversion: 2.1 time: 0.161219 Jul 30 21:49:48.599122 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3169/6289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:48 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:49.620623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:49.621282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:49.624774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:49.625480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:49.632792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:49.633278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:49.634084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:49.634561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:49.770636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:49:49.778423 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2d9a3ed8-6974-4466-84a5-876a0ad674f2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1552 microversion: 2.1 time: 0.162117 Jul 30 21:49:49.779013 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3121/6290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:49:49 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:49:49.798788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:49:49.799387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:49:49.801239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:49.807389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:49.807854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:49.808633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:49.809705 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:49.887787 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c09891d2-dfb0-4aa8-acec-f5327ef9fc86 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092768 Jul 30 21:49:49.888402 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3170/6291] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:49:49 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:49:50.801731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-2fbae7e9-77b9-4066-8f84-1dc2b3ec9173 req-3dd9675f-70b0-48bb-84f4-4911e29892e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:49:50.812908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2fbae7e9-77b9-4066-8f84-1dc2b3ec9173 req-3dd9675f-70b0-48bb-84f4-4911e29892e5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:49:50.813392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-2fbae7e9-77b9-4066-8f84-1dc2b3ec9173 req-3dd9675f-70b0-48bb-84f4-4911e29892e5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:49:50.825320 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-2fbae7e9-77b9-4066-8f84-1dc2b3ec9173 req-3dd9675f-70b0-48bb-84f4-4911e29892e5 service nova] Creating event network-changed:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch2-master-1 Jul 30 21:49:50.830486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-2fbae7e9-77b9-4066-8f84-1dc2b3ec9173 req-3dd9675f-70b0-48bb-84f4-4911e29892e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032615 Jul 30 21:49:50.831648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3122/6292] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:50:27.112783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:27.113608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=34 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:27.117562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:27.118192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:27.125920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.126386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.127163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.127647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.259790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:27.268304 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d8a27d4c-07f6-4661-b1d5-919b52d3dcf9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.157343 Jul 30 21:50:27.268902 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3171/6293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:27 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:27.289315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:27.290060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:27.292595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:27.293280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:27.300030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.300515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.301325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.301803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.443473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:27.451925 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ed1a872-ed69-4d72-bc96-b0cf9d4ea052 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.166811 Jul 30 21:50:27.452512 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3123/6294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:27 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:27.472483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:27.473112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:27.479346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.479821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.480606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.481061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.611803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:27.619358 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-10432756-b079-4922-bc1a-1b6fef6e08de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.150758 Jul 30 21:50:27.619925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3172/6295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:27 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:27.640725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:27.643091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:27.649317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.649800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.650608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.651083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.681562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:27.687972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:50:27.694333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:50:27.694786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:50:27.695325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:50:27.695762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:50:27.696204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:50:27.760362 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ac2f353-859f-4a7f-8772-98397e786c38 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/action" status: 202 len: 0 microversion: 2.1 time: 0.124313 Jul 30 21:50:27.761199 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3124/6296] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:50:27 2022] POST /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:50:27.774645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:27.774938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:27.781259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.781733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.782529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:27.782987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:27.924322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:27.932251 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a8843d12-6302-436b-b3fd-877f21891985 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1680 microversion: 2.1 time: 0.161920 Jul 30 21:50:27.932904 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3173/6297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:27 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:28.953583 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:28.954245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:28.961429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:28.961906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:28.962696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:28.963159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:29.104174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:29.112494 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-463894a9-85a6-4706-8424-76850efdd4be tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1680 microversion: 2.1 time: 0.162896 Jul 30 21:50:29.113079 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3125/6298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:28 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:30.134247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:30.134883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:30.142356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:30.142829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:30.143656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:30.144127 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:30.277297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:30.287197 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9531e62-f7d2-4524-82a2-ffc3281ee14f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.156864 Jul 30 21:50:30.287805 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3174/6299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:30 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:31.309197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:31.310375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:31.317239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:31.317712 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:31.318507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:31.318969 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:31.446974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:31.454743 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b06def0f-9826-42de-9f4a-c9d04c958d2b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.149641 Jul 30 21:50:31.455340 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3126/6300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:31 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:32.476427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:32.477175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:32.484896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:32.485364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:32.486144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:32.486598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:32.620476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:32.628657 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-db80ecf2-8dc5-4e20-9a70-3a475b6832af tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.156256 Jul 30 21:50:32.629233 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3175/6301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:32 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:33.650097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:33.650748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:33.657901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:33.658391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:33.659193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:33.659694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:33.795532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:33.803371 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a85a5783-911d-4176-9f7a-92fd68b0ef54 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.157270 Jul 30 21:50:33.803950 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3127/6302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:33 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:34.825634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:34.826267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:34.833292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:34.833765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:34.834542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:34.834998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:34.972047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:34.979706 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6414e81f-44ed-4502-ba37-f558405408e6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.158405 Jul 30 21:50:34.980275 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3176/6303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:34 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:36.000858 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:36.001493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:36.008624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:36.009099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:36.009897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:36.010364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:36.140338 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:36.147954 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ae726695-e944-406b-b54b-033c69af8a5a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.151047 Jul 30 21:50:36.148538 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3128/6304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:35 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:37.169852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:37.170485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:37.177651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:37.178117 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:37.178898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:37.179400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:37.310892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:37.318485 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd2ba895-cad7-4ea1-b069-e673fa495024 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.153019 Jul 30 21:50:37.319056 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3177/6305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:37 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:38.339515 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:38.340163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:38.347453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:38.347940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:38.348737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:38.349244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:38.492479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:38.500847 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee0609df-443b-423b-99e6-05faa768fd2c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.165307 Jul 30 21:50:38.501430 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3129/6306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:38 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:39.522462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:39.523204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:39.530762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:39.531223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:39.532022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:39.532470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:39.664659 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:39.672289 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d099f1f-4531-4702-9141-ffde4126914d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.153702 Jul 30 21:50:39.672876 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3178/6307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:39 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:40.694358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:40.694936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:40.702164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:40.702648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:40.703492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:40.703955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:40.840933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:40.848715 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-258afa4e-236c-43ae-803b-fb5edf46aade tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1685 microversion: 2.1 time: 0.158484 Jul 30 21:50:40.849292 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3130/6308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:40 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:41.870141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:41.870695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:41.877923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:41.878394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:41.879207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:41.879850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:41.902640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "name": "network-vif-unplugged", "status": "completed", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:41.915696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:41.916183 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:41.930297 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] Creating event network-vif-unplugged:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch1-master-1 Jul 30 21:50:41.936697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] Instance be42b29f-52c5-4550-9dbd-554e42dc15ab is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:50:41.948157 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3da9676e-823c-486a-8110-6e4581e85f72 req-7e480c06-61b5-46ba-80ca-28fb29786197 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049450 Jul 30 21:50:41.948788 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3131/6309] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:50:42.024844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:42.033588 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b109bca1-da46-433f-96c2-320ba5c16236 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1684 microversion: 2.1 time: 0.167353 Jul 30 21:50:42.034174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3179/6310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:41 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:43.057815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:43.058553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:43.065092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:43.065575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:43.066374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:43.066843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:43.200551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:43.208170 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-919daccd-aafc-46b3-a099-2756846fd2b5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1682 microversion: 2.1 time: 0.155515 Jul 30 21:50:43.208748 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3132/6311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:43 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:43.987601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:43.998767 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:43.999235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:44.011058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] Creating event network-changed:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch1-master-1 Jul 30 21:50:44.016700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] Instance be42b29f-52c5-4550-9dbd-554e42dc15ab is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:50:44.027497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8beee284-38d1-4724-b364-a1e1312be983 req-ba9cae4a-9ebd-4e53-813e-4f1a204d514b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043616 Jul 30 21:50:44.028092 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3180/6312] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:50:44.230193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:44.231428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:44.239696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:44.241605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:44.242464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:44.243127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:44.498459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:44.507459 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-730a1fc1-5dcb-4c02-beae-8ae59fd6fc01 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1682 microversion: 2.1 time: 0.281180 Jul 30 21:50:44.508334 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3133/6313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:44 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:45.530856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:45.531706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:45.538113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.538577 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:45.539387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.539841 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:45.672979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:45.680672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79cf0677-0791-4b82-8e95-a8f6de734cdf tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1679 microversion: 2.1 time: 0.154991 Jul 30 21:50:45.681259 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3181/6314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:45 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:45.700829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:45.701406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:45.708464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.708960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:45.709760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.710233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:45.769403 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7f56b2ef-3a35-4f1e-a4ae-f0fcc1ccf814 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/action" status: 204 len: 0 microversion: 2.1 time: 0.072278 Jul 30 21:50:45.770208 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3134/6315] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:50:45 2022] POST /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:50:45.778813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:45.779509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:45.786367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.787179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:45.788279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:45.788996 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:46.038276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:46.047496 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d0ec11e-ab4a-4a13-8cce-376d7f7b215e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1679 microversion: 2.1 time: 0.272548 Jul 30 21:50:46.048326 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3182/6316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:45 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:47.072262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:47.073628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:47.080763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.081536 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.082352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.082828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.242516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:47.252668 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-92131ca3-4b1e-4a00-a853-d60d09dca880 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.186807 Jul 30 21:50:47.253198 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3135/6317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:47 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:47.274750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:47.275416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:47.283087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.283605 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.284394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.284848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.418936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:47.426705 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94b55b50-bbbd-401f-9778-f968b9a7693e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.155829 Jul 30 21:50:47.427276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3183/6318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:47 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:47.449370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:47.450597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:47.456889 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.457379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.458297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.458768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.591343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:47.598962 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-43c665b2-c6a8-4a98-835d-b89395ed4d61 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1671 microversion: 2.1 time: 0.153592 Jul 30 21:50:47.599575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3136/6319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:47 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:47.619120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:47.619668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:47.626312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.626775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.627614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.628065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.652216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:50:47.725626 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-baf1ecf9-3d00-4fbb-9f11-18d391f59cb8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 204 len: 0 microversion: 2.1 time: 0.109981 Jul 30 21:50:47.726400 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3184/6320] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:50:47 2022] DELETE /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:50:47.735215 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:47.735885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:47.742762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.743238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.744063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.744530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.760493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:47.888769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:47.891570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-642b0c23-a488-4b92-ab8a-cc731143dc7d req-976ce507-cc7b-402a-a4f0-d2636953011a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "name": "network-vif-plugged", "status": "completed", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:47.897750 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b13930ff-3fa5-404e-b0e3-008e50a563f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1677 microversion: 2.1 time: 0.166779 Jul 30 21:50:47.898646 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3137/6321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:47 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:47.911572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-642b0c23-a488-4b92-ab8a-cc731143dc7d req-976ce507-cc7b-402a-a4f0-d2636953011a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:47.911572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-642b0c23-a488-4b92-ab8a-cc731143dc7d req-976ce507-cc7b-402a-a4f0-d2636953011a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:47.917645 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-642b0c23-a488-4b92-ab8a-cc731143dc7d req-976ce507-cc7b-402a-a4f0-d2636953011a service nova] Creating event network-vif-plugged:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch1-master-1 Jul 30 21:50:47.923483 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-642b0c23-a488-4b92-ab8a-cc731143dc7d req-976ce507-cc7b-402a-a4f0-d2636953011a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Jul 30 21:50:47.924371 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3185/6322] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:50:48.921832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:48.922477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:48.929769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:48.930249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:48.931044 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:48.931563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:49.124811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:49.132681 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f970d14f-e307-4bc9-acd0-38d7186c0d7a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 200 len: 1677 microversion: 2.1 time: 0.214837 Jul 30 21:50:49.133269 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3138/6323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:48 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:49.892043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-f87e6c0e-29dd-4d61-840b-dd4d6c2f8b1e req-6ce77acb-e367-4aa4-85dc-d61a5439d6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be42b29f-52c5-4550-9dbd-554e42dc15ab", "name": "network-vif-deleted", "tag": "5cec3220-7c19-4a5b-aeb7-d56ae67c5d33"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:49.914147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f87e6c0e-29dd-4d61-840b-dd4d6c2f8b1e req-6ce77acb-e367-4aa4-85dc-d61a5439d6b4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:49.914696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-f87e6c0e-29dd-4d61-840b-dd4d6c2f8b1e req-6ce77acb-e367-4aa4-85dc-d61a5439d6b4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:49.926760 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-f87e6c0e-29dd-4d61-840b-dd4d6c2f8b1e req-6ce77acb-e367-4aa4-85dc-d61a5439d6b4 service nova] Creating event network-vif-deleted:5cec3220-7c19-4a5b-aeb7-d56ae67c5d33 for instance be42b29f-52c5-4550-9dbd-554e42dc15ab on nch1-master-1 Jul 30 21:50:49.931597 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-f87e6c0e-29dd-4d61-840b-dd4d6c2f8b1e req-6ce77acb-e367-4aa4-85dc-d61a5439d6b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044558 Jul 30 21:50:49.932209 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3186/6324] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:50:50.154895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:50.155484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:50.162480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.162954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.163794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.164261 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.179474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab HTTP/1.1 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'be42b29f-52c5-4550-9dbd-554e42dc15ab'} Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:50:50.181188 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:50:50.185871 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f1e98456-d40f-454e-8abd-03c5e93f7428 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 404 len: 111 microversion: 2.1 time: 0.032723 Jul 30 21:50:50.188168 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3139/6325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:50 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:50:50.198710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:50.199578 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:50.206206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.206742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.207650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.208170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.222058 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab HTTP/1.1 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'be42b29f-52c5-4550-9dbd-554e42dc15ab'} Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:50:50.223830 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:50:50.228276 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df197999-1d97-412b-8829-54b2837f3a83 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 404 len: 111 microversion: 2.1 time: 0.032555 Jul 30 21:50:50.228917 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3187/6326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:50 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:50:50.277928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1030264891", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "71431093-0922-4685-93f5-43036332ac76"}], "security_groups": [{"name": "tempest-securitygroup--197795691"}], "key_name": "tempest-keypair-1369312178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:50.388877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] validate_networks() for [('71431093-0922-4685-93f5-43036332ac76', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:50:50.772179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:50:50.772639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:50:50.773390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:50:50.773864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:50:50.774311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:50:50.784597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.785080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.785919 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:50.786413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:50.803961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:50:50.809970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:50:50.822741 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:50:50.825667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:50:50.872852 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e4b2b26-93ec-4595-a3bd-3c2b191aa6a8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.599352 Jul 30 21:50:50.874088 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3140/6327] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:50:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:50:50.885448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10ca0653-3698-40bf-833f-a493f9318a1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:50.886168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-10ca0653-3698-40bf-833f-a493f9318a1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:50.962352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-10ca0653-3698-40bf-833f-a493f9318a1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:50.970197 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-10ca0653-3698-40bf-833f-a493f9318a1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1239 microversion: 2.1 time: 0.089191 Jul 30 21:50:50.970904 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3188/6328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:50 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:50:51.991063 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:51.991770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:52.000087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:52.000860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:52.001675 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:52.002145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:52.079190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:52.087014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2fe3f026-04ab-4094-b972-07094b5cc1f9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1297 microversion: 2.1 time: 0.099936 Jul 30 21:50:52.087741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3141/6329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:51 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:53.110121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:53.110773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:53.118022 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:53.118480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:53.119481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:53.120425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:53.128817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-08716a03-65fc-4946-ad04-d1971e5e63dd req-4ec7179a-d5cb-44f5-be61-4bd8ace163da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:53.137344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:53.147725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-08716a03-65fc-4946-ad04-d1971e5e63dd req-4ec7179a-d5cb-44f5-be61-4bd8ace163da service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:53.148555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-08716a03-65fc-4946-ad04-d1971e5e63dd req-4ec7179a-d5cb-44f5-be61-4bd8ace163da service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:53.174486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-08716a03-65fc-4946-ad04-d1971e5e63dd req-4ec7179a-d5cb-44f5-be61-4bd8ace163da service nova] Creating event network-changed:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch1-master-1 Jul 30 21:50:53.181428 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-08716a03-65fc-4946-ad04-d1971e5e63dd req-4ec7179a-d5cb-44f5-be61-4bd8ace163da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058308 Jul 30 21:50:53.182295 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3142/6330] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:50:53.268969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:53.276744 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00313c03-083b-45ef-ba28-b55a0c2984ac tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1364 microversion: 2.1 time: 0.171607 Jul 30 21:50:53.277280 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3189/6331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:53 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:54.298938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:54.299612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:54.306019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:54.306501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:54.307316 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:54.307933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:54.525870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:54.534756 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e7d67c1e-98cd-4c9c-a5af-c732905a6698 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1364 microversion: 2.1 time: 0.241092 Jul 30 21:50:54.535607 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3143/6332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:54 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:55.556490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:55.557147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:55.564739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:55.565207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:55.565989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:55.566445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:55.694003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:55.702202 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b958eeb-c7a6-43ef-8004-2ebd747e3d5d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1364 microversion: 2.1 time: 0.149618 Jul 30 21:50:55.702773 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3190/6333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:55 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:56.723354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:56.724000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:56.731042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:56.731566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:56.732367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:56.732843 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:56.864336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:56.872527 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f3a6ed5-f9e7-45ba-8f84-9685ea4727f7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1364 microversion: 2.1 time: 0.153072 Jul 30 21:50:56.873104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3144/6334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:56 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:57.893765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:57.894391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:57.897464 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:57.903592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:57.904065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:57.904860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:57.905315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:57.931554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aad21e40-e9e4-4678-a5ed-e9cc03455f4c req-7f04db9a-3399-4c14-9088-d890a0a6d449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "name": "network-vif-plugged", "status": "completed", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:50:57.944694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:57.946620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aad21e40-e9e4-4678-a5ed-e9cc03455f4c req-7f04db9a-3399-4c14-9088-d890a0a6d449 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:57.947398 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aad21e40-e9e4-4678-a5ed-e9cc03455f4c req-7f04db9a-3399-4c14-9088-d890a0a6d449 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:57.963611 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aad21e40-e9e4-4678-a5ed-e9cc03455f4c req-7f04db9a-3399-4c14-9088-d890a0a6d449 service nova] Creating event network-vif-plugged:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch1-master-1 Jul 30 21:50:57.969394 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aad21e40-e9e4-4678-a5ed-e9cc03455f4c req-7f04db9a-3399-4c14-9088-d890a0a6d449 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043156 Jul 30 21:50:57.970189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3145/6335] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:50:58.061738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:58.069336 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c7130a80-f9b1-4232-9d5f-c625b2373e1a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1364 microversion: 2.1 time: 0.179791 Jul 30 21:50:58.069914 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3191/6336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:57 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:59.092259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:59.092986 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:59.100083 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:59.100710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:59.101546 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:59.102017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:59.236230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:50:59.243765 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34e686c6-19d4-4f0f-af75-36276d606611 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1552 microversion: 2.1 time: 0.156648 Jul 30 21:50:59.244336 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3146/6337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:50:59 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:50:59.266207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:50:59.266688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:50:59.273542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:59.274005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:59.274774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:50:59.275221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:50:59.352521 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2224f189-8285-42a5-b9a4-fa0c949fe4c8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091022 Jul 30 21:50:59.353135 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3192/6338] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:50:59 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:51:00.278212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b3e68a93-b4ba-4ea3-85a3-136b6bd7a5c2 req-a535ec46-f489-4798-aa1a-3db664c21fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:00.288752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3e68a93-b4ba-4ea3-85a3-136b6bd7a5c2 req-a535ec46-f489-4798-aa1a-3db664c21fb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:00.289236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3e68a93-b4ba-4ea3-85a3-136b6bd7a5c2 req-a535ec46-f489-4798-aa1a-3db664c21fb8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:00.300452 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b3e68a93-b4ba-4ea3-85a3-136b6bd7a5c2 req-a535ec46-f489-4798-aa1a-3db664c21fb8 service nova] Creating event network-changed:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch1-master-1 Jul 30 21:51:00.305535 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b3e68a93-b4ba-4ea3-85a3-136b6bd7a5c2 req-a535ec46-f489-4798-aa1a-3db664c21fb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031589 Jul 30 21:51:00.306083 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3147/6339] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:51:35.458570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.460094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.460990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=20 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.466034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-26cc306e-6a5b-4daa-9840-de17efa2f7a3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:35.473371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26cc306e-6a5b-4daa-9840-de17efa2f7a3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:35.473844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-26cc306e-6a5b-4daa-9840-de17efa2f7a3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:35.498004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-26cc306e-6a5b-4daa-9840-de17efa2f7a3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Going to try to stop instance {{(pid=130984) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 21:51:35.539490 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-26cc306e-6a5b-4daa-9840-de17efa2f7a3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action" status: 202 len: 0 microversion: 2.1 time: 0.082270 Jul 30 21:51:35.540101 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3193/6340] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:51:35 2022] POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:51:35.549347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:35.550090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:35.552442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.553146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.553936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=5 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.554642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=43 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:35.562595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:35.563365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:35.564724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:35.565592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:35.713091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:35.720735 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b563a34f-58d3-4352-9979-5d276d754c9a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.175665 Jul 30 21:51:35.721332 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3148/6341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:35 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:36.743556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:36.744196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:36.751146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:36.751653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:36.752444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:36.752901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:36.887004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:36.894853 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e39aff64-af27-4279-abfb-2c8ff89968d6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.156563 Jul 30 21:51:36.895453 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3194/6342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:36 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:37.915350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:37.916002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:37.923188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:37.923729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:37.924513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:37.924987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:38.125177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:38.132841 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d53ed5e7-f8c3-46ab-9b13-a24677fa3a4e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.221544 Jul 30 21:51:38.133416 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3149/6343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:37 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:39.156216 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:39.156874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:39.163953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:39.164432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:39.165213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:39.165669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:39.352349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:39.360152 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98bcb404-4eab-42f8-8e07-5051b3cf741e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.207851 Jul 30 21:51:39.360734 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3195/6344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:39 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:40.381532 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:40.382170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:40.388812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:40.389289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:40.390076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:40.390782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:40.531035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:40.538935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3f760b8f-bff5-4f07-8447-b57a5000a7a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.161362 Jul 30 21:51:40.539729 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3150/6345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:40 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:41.562321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:41.562941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:41.569550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:41.570008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:41.570776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:41.571219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:41.701630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:41.709941 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48bac5b7-8382-4a42-a35c-64ac5fa2f4d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.152417 Jul 30 21:51:41.710521 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3196/6346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:41 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:42.731353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:42.731926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:42.739052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:42.739582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:42.740386 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:42.740863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:42.875452 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:42.883020 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a15b3206-12e6-40fa-8912-42b1f8b772db tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.155844 Jul 30 21:51:42.883623 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3151/6347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:42 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:43.905460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:43.906084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:43.913102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:43.913566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:43.914376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:43.914828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:44.045459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:44.053162 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79a33bc6-8a7e-4bdd-a4f0-b49ae6e30b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.152273 Jul 30 21:51:44.053744 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3197/6348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:43 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:45.074570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:45.075221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:45.083180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:45.083726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:45.084539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:45.085014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:45.222827 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:45.230840 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f97d2443-5126-48f8-98b3-b14ddd919552 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.160245 Jul 30 21:51:45.231451 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3152/6349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:45 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:46.253187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:46.253802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:46.261370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:46.261835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:46.262613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:46.263060 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:46.396355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:46.403884 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-02ec10ff-3579-4137-8055-700598996f87 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.155870 Jul 30 21:51:46.404455 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3198/6350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:46 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:47.425567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:47.426274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:47.433996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:47.434482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:47.435307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:47.435777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:47.572716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:47.580488 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c13efe57-b3bb-4ec1-b544-a2025c7605a5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.158873 Jul 30 21:51:47.581202 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3153/6351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:47 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:48.607759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:48.608403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:48.614982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:48.615482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:48.616257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:48.616704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:48.747720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:48.755214 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-57435a30-bf3a-47fe-adaf-fb251aaa2ca5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.151508 Jul 30 21:51:48.755806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3199/6352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:48 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:49.778145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:49.778777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:49.785831 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:49.786304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:49.787089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:49.787581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:49.921570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:49.929353 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a6a89105-b2bd-450b-83a7-0f188b8cad6e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.155854 Jul 30 21:51:49.929934 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3154/6353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:49 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:50.950529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:50.951158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:50.958321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:50.958786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:50.959590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:50.960044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:51.091901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:51.099825 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cea2f2a-668a-410a-a41c-7d4c9a322e50 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1658 microversion: 2.1 time: 0.153062 Jul 30 21:51:51.100235 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3200/6354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:50 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:51.120839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:51.123216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:51.131035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:51.131622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:51.132431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:51.132903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:51.161764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:51.168247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:51:51.174523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:51:51.174976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:51:51.175513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:51:51.175954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:51:51.176393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:51:51.238843 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fddf2425-bf7b-4dd7-885f-e65e7353fab8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action" status: 202 len: 0 microversion: 2.1 time: 0.121628 Jul 30 21:51:51.239388 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3155/6355] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:51:51 2022] POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:51:51.247572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:51.248213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:51.254629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:51.255101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:51.255926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:51.256385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:51.394404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:51.402283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f385008c-8a22-41ac-9ae6-53f6fafddc67 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.158664 Jul 30 21:51:51.402848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3201/6356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:51 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:52.424037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:52.424690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:52.432578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:52.433067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:52.434081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:52.434725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:52.658013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:52.665755 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cb36778-a6fe-4aae-99a5-f164ffe5b69a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1681 microversion: 2.1 time: 0.245765 Jul 30 21:51:52.666359 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3156/6357] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:52 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:53.687915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:53.688547 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:53.695615 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:53.696084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:53.696871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:53.697326 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:53.828198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:53.835850 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52465f2d-96a3-45f3-b444-c700b0910304 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1686 microversion: 2.1 time: 0.152702 Jul 30 21:51:53.836426 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3202/6358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:53 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:54.858573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:54.859242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:54.866319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:54.866794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:54.867632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:54.868080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:55.034799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:55.042634 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-53962b96-830b-47b2-ae43-551bc4ab7c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1686 microversion: 2.1 time: 0.188574 Jul 30 21:51:55.043343 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3157/6359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:54 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:55.731470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "name": "network-vif-unplugged", "status": "completed", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:55.741348 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:55.741736 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:55.754160 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] Creating event network-vif-unplugged:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch2-master-1 Jul 30 21:51:55.760069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] Instance 1326921c-c00a-483d-bb39-7097f5865771 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:51:55.771342 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-635e419d-58a2-427f-85f1-95b4241d0857 req-f4dbf3df-1bf8-480d-a653-1f67b64a94fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110958 Jul 30 21:51:55.771958 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3203/6360] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:51:56.064292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:56.065115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:56.072090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:56.072901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:56.074012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:56.074591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:56.217327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:56.225136 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b1369f9e-bd9c-49bf-8db7-8668820ac323 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1685 microversion: 2.1 time: 0.164760 Jul 30 21:51:56.226281 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3158/6361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:56 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:57.250156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:57.250790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:57.257310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:57.257773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:57.258542 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:57.258989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:57.393139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:57.401092 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22a13482-72dd-469c-8f40-d24c3e51f1de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1683 microversion: 2.1 time: 0.156860 Jul 30 21:51:57.401710 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3204/6362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:57 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:57.563012 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:51:57.563239 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:51:57.582279 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:51:57.582449 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:51:57.797792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:57.808566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:57.809042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:57.820931 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] Creating event network-changed:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch2-master-1 Jul 30 21:51:57.826372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] Instance 1326921c-c00a-483d-bb39-7097f5865771 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:51:57.836966 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-dde0a87c-492f-44d4-8548-b9a20c1b9ca9 req-4561fb0e-08d3-4c0a-80cf-68ff8875b91f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043486 Jul 30 21:51:57.837613 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3159/6363] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:51:58.423262 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:58.423915 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:58.431667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.432126 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.432904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.433349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.562105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:58.570621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-27d2fe20-2f78-47cd-8fd5-230e3431440b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1679 microversion: 2.1 time: 0.151574 Jul 30 21:51:58.571199 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3205/6364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:58 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:58.592813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:51:58.593465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:58.599769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.600244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.601026 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.601488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.663842 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5ffffc1e-8976-4660-ac0f-bb49a0265755 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action" status: 204 len: 0 microversion: 2.1 time: 0.074958 Jul 30 21:51:58.664386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3160/6365] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:51:58 2022] POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:51:58.674164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:58.674816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:58.681258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.681823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.682774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:58.683265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:58.832349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:51:58.840132 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1143357-f532-4514-9028-f6278574c398 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1679 microversion: 2.1 time: 0.170904 Jul 30 21:51:58.840916 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3206/6366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:58 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:51:59.097688 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:51:59.098206 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 21:51:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 21:51:59.861807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:51:59.862544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:51:59.869834 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:59.870315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:51:59.871628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:51:59.872110 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.010431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:00.018643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fd2abeec-7a75-4508-b9b5-35822fa62601 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1658 microversion: 2.1 time: 0.161252 Jul 30 21:52:00.019229 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3161/6367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:51:59 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1658 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:00.039026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:00.039681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:00.047081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:00.047582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.048360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:00.048809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.177606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:00.186151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-df1618fa-7182-42a5-b03d-f8acb1edde59 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1658 microversion: 2.1 time: 0.150884 Jul 30 21:52:00.186727 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3207/6368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:00 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:00.206667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d01f11ce-2ed0-4ff5-b77c-e7d76bf52a37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:00.212826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d01f11ce-2ed0-4ff5-b77c-e7d76bf52a37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:00.213301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d01f11ce-2ed0-4ff5-b77c-e7d76bf52a37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.227441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:00.237176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d01f11ce-2ed0-4ff5-b77c-e7d76bf52a37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Going to try to start instance {{(pid=130983) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 21:52:00.282844 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d01f11ce-2ed0-4ff5-b77c-e7d76bf52a37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action" status: 202 len: 0 microversion: 2.1 time: 0.079805 Jul 30 21:52:00.283455 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3162/6369] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:52:00 2022] POST /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:52:00.293079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:00.294311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:00.301925 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:00.302389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.303204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:00.303685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:00.851452 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:00.854923 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:00.861599 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dc35091e-3c23-4222-ac23-2b65630e7128 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1667 microversion: 2.1 time: 0.573448 Jul 30 21:52:00.862395 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3208/6370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:00 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1667 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:01.884269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:01.885010 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:01.891784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:01.892275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:01.893081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:01.893554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.028813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:02.036557 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-28941314-b845-4366-be0f-d155d3c8236f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1671 microversion: 2.1 time: 0.157583 Jul 30 21:52:02.037133 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3163/6371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:01 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:02.057121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:02.057642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:02.066299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:02.066764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.067568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:02.068016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.093590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:52:02.167912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-28406138-8610-4507-a332-132d323f2ec9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 204 len: 0 microversion: 2.1 time: 0.114163 Jul 30 21:52:02.168617 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3209/6372] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:52:02 2022] DELETE /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:52:02.177524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:02.178204 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:02.185001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:02.185491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.186367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:02.186845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.325866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:02.333900 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b103205-c408-4516-aee0-363957b528a4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1677 microversion: 2.1 time: 0.160466 Jul 30 21:52:02.334648 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3164/6373] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:02 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:02.418827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-df34a48e-a7cd-43e0-a43d-74380099a9ef req-95063c67-e8a1-44e6-8a8e-66d00b546728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "name": "network-vif-plugged", "status": "completed", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:02.428531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df34a48e-a7cd-43e0-a43d-74380099a9ef req-95063c67-e8a1-44e6-8a8e-66d00b546728 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:02.428978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-df34a48e-a7cd-43e0-a43d-74380099a9ef req-95063c67-e8a1-44e6-8a8e-66d00b546728 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:02.440853 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-df34a48e-a7cd-43e0-a43d-74380099a9ef req-95063c67-e8a1-44e6-8a8e-66d00b546728 service nova] Creating event network-vif-plugged:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch2-master-1 Jul 30 21:52:02.445672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-df34a48e-a7cd-43e0-a43d-74380099a9ef req-95063c67-e8a1-44e6-8a8e-66d00b546728 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Jul 30 21:52:02.446256 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3210/6374] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:03.355773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:03.356410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:03.363401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:03.363877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:03.364692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:03.365154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:03.497148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:03.505117 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f1bb5d1d-8060-428a-8ebb-00ea87c519f5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 200 len: 1677 microversion: 2.1 time: 0.153234 Jul 30 21:52:03.505900 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3165/6375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:03 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:04.322381 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-091350f6-f7c9-4544-b7cd-ed1efdd2e1a4 req-9c9c5f86-e32c-4f96-9c8b-b6906ef0beda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1326921c-c00a-483d-bb39-7097f5865771", "name": "network-vif-deleted", "tag": "4966b0b1-e75b-43e4-8854-88d14d54c72c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:04.332775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-091350f6-f7c9-4544-b7cd-ed1efdd2e1a4 req-9c9c5f86-e32c-4f96-9c8b-b6906ef0beda service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:04.333317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-091350f6-f7c9-4544-b7cd-ed1efdd2e1a4 req-9c9c5f86-e32c-4f96-9c8b-b6906ef0beda service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:04.345680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-091350f6-f7c9-4544-b7cd-ed1efdd2e1a4 req-9c9c5f86-e32c-4f96-9c8b-b6906ef0beda service nova] Creating event network-vif-deleted:4966b0b1-e75b-43e4-8854-88d14d54c72c for instance 1326921c-c00a-483d-bb39-7097f5865771 on nch2-master-1 Jul 30 21:52:04.350820 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-091350f6-f7c9-4544-b7cd-ed1efdd2e1a4 req-9c9c5f86-e32c-4f96-9c8b-b6906ef0beda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Jul 30 21:52:04.351529 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3211/6376] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:04.526544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:04.527717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:04.534904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:04.535505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:04.536562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:04.537108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:04.553564 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 HTTP/1.1 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1326921c-c00a-483d-bb39-7097f5865771'} Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:52:04.555497 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ae86e7c-47e6-4869-ab34-eb16be1a9064 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 404 len: 111 microversion: 2.1 time: 0.034448 Jul 30 21:52:04.559636 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3166/6377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:04 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:52:04.573601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:04.574363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:04.580706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:04.581171 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:04.581946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:04.582387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:04.598487 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 HTTP/1.1 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1326921c-c00a-483d-bb39-7097f5865771'} Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:52:04.600197 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f664cd6-1611-489e-a7d1-a7390353714f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 404 len: 111 microversion: 2.1 time: 0.032642 Jul 30 21:52:04.604134 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3212/6378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:04 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:52:04.652942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1442666743", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "71431093-0922-4685-93f5-43036332ac76"}], "security_groups": [{"name": "tempest-securitygroup--197795691"}], "key_name": "tempest-keypair-1369312178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:04.762509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] validate_networks() for [('71431093-0922-4685-93f5-43036332ac76', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:52:05.201838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:52:05.202324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:52:05.202982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:52:05.203551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:52:05.204247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:52:05.217362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:05.217854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:05.218705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:05.219185 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:05.236521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:52:05.242315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:52:05.257414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:52:05.260867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:52:05.310980 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7b666e7a-081c-4613-95fa-ab22500835b2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.661526 Jul 30 21:52:05.311898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3167/6379] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:52:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:52:05.327341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0eb663cb-3ef3-4c35-af7b-abb90e982d9d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:05.328809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0eb663cb-3ef3-4c35-af7b-abb90e982d9d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:05.391553 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0eb663cb-3ef3-4c35-af7b-abb90e982d9d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:05.399317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0eb663cb-3ef3-4c35-af7b-abb90e982d9d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1239 microversion: 2.1 time: 0.079343 Jul 30 21:52:05.399878 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3213/6380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:05 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:06.422017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:06.422819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:06.425787 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:06.433459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:06.434506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:06.435342 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:06.435819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:06.499688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:06.507312 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82f9e995-48fd-4a87-ac91-520ac425ae5f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1297 microversion: 2.1 time: 0.090044 Jul 30 21:52:06.507910 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3168/6381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:06 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:07.531341 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:07.532181 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:07.535409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:07.542706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:07.543173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:07.544246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:07.544700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:07.633850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-0649195a-463f-4281-a946-1b7192131335 req-5fd06cfc-51f3-4b87-8bb0-f9ba694da2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:07.646229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0649195a-463f-4281-a946-1b7192131335 req-5fd06cfc-51f3-4b87-8bb0-f9ba694da2ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:07.646710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-0649195a-463f-4281-a946-1b7192131335 req-5fd06cfc-51f3-4b87-8bb0-f9ba694da2ef service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:07.658996 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-0649195a-463f-4281-a946-1b7192131335 req-5fd06cfc-51f3-4b87-8bb0-f9ba694da2ef service nova] Creating event network-changed:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:52:07.665156 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-0649195a-463f-4281-a946-1b7192131335 req-5fd06cfc-51f3-4b87-8bb0-f9ba694da2ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035610 Jul 30 21:52:07.665874 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3169/6382] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:07.845886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:07.853662 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3f7536f-6cba-424f-9855-0caa79a5265f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1364 microversion: 2.1 time: 0.328429 Jul 30 21:52:07.854236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3214/6383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:07 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1364 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:08.877399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:08.878130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:08.885433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:08.885914 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:08.887361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:08.887838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:09.026104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:09.033949 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c677ed8f-c581-4be4-bab6-f6e3d6e01b13 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1364 microversion: 2.1 time: 0.160928 Jul 30 21:52:09.034535 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3170/6384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:08 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:10.054013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:10.054647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:10.061858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:10.062331 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:10.063120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:10.063601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:10.191585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:10.199713 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3f150291-aebc-4da8-ad2e-e3b3402c8228 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1364 microversion: 2.1 time: 0.148986 Jul 30 21:52:10.200282 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3215/6385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:10 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:11.221232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:11.221877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:11.228385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:11.228871 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:11.229670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:11.230143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:11.361392 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:11.369040 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3005467f-0bd6-433a-844a-d6e939e86fb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1364 microversion: 2.1 time: 0.152053 Jul 30 21:52:11.369619 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3171/6386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:11 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:12.390273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:12.391153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:12.397928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:12.398301 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:12.399076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:12.399582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:12.436552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5689e51c-3a0e-42ab-98c6-3c307630689b req-b0a5454a-dd0f-4995-917b-582086d2fef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "name": "network-vif-plugged", "status": "completed", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:12.453735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5689e51c-3a0e-42ab-98c6-3c307630689b req-b0a5454a-dd0f-4995-917b-582086d2fef2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:12.454239 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5689e51c-3a0e-42ab-98c6-3c307630689b req-b0a5454a-dd0f-4995-917b-582086d2fef2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:12.467070 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5689e51c-3a0e-42ab-98c6-3c307630689b req-b0a5454a-dd0f-4995-917b-582086d2fef2 service nova] Creating event network-vif-plugged:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:52:12.472409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5689e51c-3a0e-42ab-98c6-3c307630689b req-b0a5454a-dd0f-4995-917b-582086d2fef2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044843 Jul 30 21:52:12.473561 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3172/6387] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:12.581391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:12.589026 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fd3a3621-c34d-4179-999b-5a2560f8bcb1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1364 microversion: 2.1 time: 0.202814 Jul 30 21:52:12.589665 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3216/6388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:12 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:13.613959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:13.614736 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:13.622098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:13.622584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:13.624518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:13.625419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:13.767819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:13.775412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78261caf-8e85-46b6-aade-a725b889baf3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1552 microversion: 2.1 time: 0.167837 Jul 30 21:52:13.775983 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3173/6389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:13 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:13.796409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:13.796952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:13.804885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:13.805470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:13.806344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:13.806879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:13.883390 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-44d80710-56ff-4dd7-926d-434fd651ae69 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090919 Jul 30 21:52:13.883999 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3217/6390] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:52:13 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:14.807450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-72b149f2-7222-4fbe-ab78-6863adb0ce40 req-822f43df-9612-4271-a6a1-992cb22abb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:14.819973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-72b149f2-7222-4fbe-ab78-6863adb0ce40 req-822f43df-9612-4271-a6a1-992cb22abb1a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:14.820561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-72b149f2-7222-4fbe-ab78-6863adb0ce40 req-822f43df-9612-4271-a6a1-992cb22abb1a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:14.834700 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-72b149f2-7222-4fbe-ab78-6863adb0ce40 req-822f43df-9612-4271-a6a1-992cb22abb1a service nova] Creating event network-changed:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:52:14.839910 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-72b149f2-7222-4fbe-ab78-6863adb0ce40 req-822f43df-9612-4271-a6a1-992cb22abb1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Jul 30 21:52:14.841081 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3174/6391] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:52:49.713678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.714566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=7 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.715214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.719789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:52:49.722017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:49.730612 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:49.731079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:49.731898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:49.732364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:49.760428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:49.766448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Old instance type m1.heat2, new instance type m1.heat {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:52:49.772811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:52:49.773258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:52:49.773752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:52:49.774187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:52:49.774619 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:52:49.846050 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8c1b0100-c2b6-4c78-8da0-4bfaf0c45fee tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/action" status: 202 len: 0 microversion: 2.1 time: 0.134014 Jul 30 21:52:49.846676 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3218/6392] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:52:49 2022] POST /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:52:49.852130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.852939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.854988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=13 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.855709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:49.861444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:49.862189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:49.870945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:49.871510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:49.872349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:49.872825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:50.041960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:50.049992 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-013eaf2f-3cd3-471a-b6dd-1741e8f67fde tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1680 microversion: 2.1 time: 0.198892 Jul 30 21:52:50.050595 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3175/6393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:49 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:51.072164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:51.072861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:51.079754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:51.080251 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:51.081046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:51.081498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:51.279763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:51.288438 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4261dda5-403e-4fbb-b726-65c684dcbc37 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1680 microversion: 2.1 time: 0.221281 Jul 30 21:52:51.289003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3219/6394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:51 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:52.310818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:52.311412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:52.319650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:52.320131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:52.320931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:52.321401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:52.459647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:52.467398 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d7584d04-3829-4633-b209-38de26ab88d4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.161066 Jul 30 21:52:52.468005 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3176/6395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:52 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:53.488598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:53.489229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:53.496385 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:53.496852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:53.497629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:53.498080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:53.627135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:53.634830 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f0021c32-ea72-4091-9113-5ed5bc69498c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.150105 Jul 30 21:52:53.635419 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3220/6396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:53 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:54.659655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:54.660323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:54.667482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:54.667906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:54.668699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:54.669164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:54.799713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:54.807352 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8227acd2-d6e4-4204-9c50-731036868eb2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.152250 Jul 30 21:52:54.807926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3177/6397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:54 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:55.829208 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:55.829880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:55.837426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:55.837899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:55.838692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:55.839576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:55.975759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:55.983693 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ace4ccfd-7a3e-4874-af3c-1a781aa06277 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.158378 Jul 30 21:52:55.984274 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3221/6398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:55 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:57.005042 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:57.005693 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:57.012859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:57.013343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:57.014154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:57.014663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:57.150404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:57.158042 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d67779d3-6a53-455f-9495-0dd6aa97a06a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.156979 Jul 30 21:52:57.158614 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3178/6399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:56 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:58.178231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:58.178857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:58.185827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:58.186287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:58.187570 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:58.188013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:58.317041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:58.324598 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6f547277-8be3-4ff2-bdd6-a0f6e38f7585 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.150212 Jul 30 21:52:58.325188 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3222/6400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:58 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:52:59.347746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:52:59.348436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:52:59.356005 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:59.356496 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:59.357309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:52:59.357779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:52:59.488403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:52:59.496079 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b47f8234-dc65-4c0c-8600-46d316a1cf32 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.153975 Jul 30 21:52:59.496662 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3179/6401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:52:59 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:00.517613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:00.518267 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:00.525442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:00.525900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:00.526666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:00.527394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:00.677377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:00.685285 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-972fd4fa-3f8d-4bf3-8442-2e2d6fdb2e97 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.172342 Jul 30 21:53:00.685870 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3223/6402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:00 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:01.706362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:01.707001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:01.714184 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:01.714685 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:01.715510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:01.715979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:01.855321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:01.863619 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac0bcd6e-426e-4a03-a281-c14d45646121 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.161290 Jul 30 21:53:01.864212 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3180/6403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:01 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:02.884804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:02.885413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:02.892752 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:02.893209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:02.894035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:02.894426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:03.030554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:03.038249 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ced838c0-0253-4cc1-acea-1999cd07ddb0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.157330 Jul 30 21:53:03.038834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3224/6404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:02 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:04.060668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:04.061253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:04.068839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:04.069322 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:04.070108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:04.070576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:04.200651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:04.209013 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2c78f2df-0041-4573-8dac-a24cd03fcd6f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.152851 Jul 30 21:53:04.209592 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3181/6405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:04 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:05.230151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:05.230771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:05.238013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:05.238481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:05.239260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:05.239741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:05.370856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:05.379150 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-60a9628d-8f6d-46e2-9def-b8671a39321e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.152858 Jul 30 21:53:05.379754 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3225/6406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:05 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:06.401274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:06.401907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:06.409480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:06.409960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:06.410744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:06.411205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:06.541591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:06.549310 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7f73379b-23da-4fd7-8bd5-b076ea5987c0 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.152067 Jul 30 21:53:06.549898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3182/6407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:06 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:07.570089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:07.570711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:07.577795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:07.578264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:07.579044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:07.579539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:07.715302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:07.723603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abf6d577-d725-401f-b224-5c4bfdab9f1f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1685 microversion: 2.1 time: 0.157372 Jul 30 21:53:07.724187 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3226/6408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:07 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:08.746472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:08.747170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:08.755220 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:08.755734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:08.756529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:08.757043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:09.006095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:09.014217 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f5c6532e-acb1-4533-9b96-90b3aaef68aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1684 microversion: 2.1 time: 0.272030 Jul 30 21:53:09.014901 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3183/6409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:08 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1684 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:09.168858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "name": "network-vif-unplugged", "status": "completed", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:09.180774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:09.181444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:09.193854 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] Creating event network-vif-unplugged:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch1-master-1 Jul 30 21:53:09.199346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:53:09.210315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a40ca88f-2a58-4cdc-bcc3-c406ef93b667 req-6c846e64-aab0-43f0-846c-39b0e6b4aecb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045269 Jul 30 21:53:09.211027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3227/6410] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:10.035442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:10.036039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:10.043829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:10.044318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:10.045137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:10.045611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:10.188726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:10.196532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82dbee2c-5780-46c2-9f17-0b21be961e1b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1684 microversion: 2.1 time: 0.165257 Jul 30 21:53:10.197116 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3184/6411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:10 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:11.220107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:11.220812 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:11.227098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:11.227589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:11.228359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:11.228799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:11.248046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:11.259456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:11.259942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:11.273116 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] Creating event network-changed:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch1-master-1 Jul 30 21:53:11.279142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:53:11.291648 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-4845c470-ac17-4064-be50-fdc805f04e93 req-c9cc65c6-51de-4a01-8964-6329ee179ce6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047233 Jul 30 21:53:11.292913 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3185/6412] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:53:11.443582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:11.451246 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1ba9b40d-eed9-45bd-887b-8f37b4f5057e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1682 microversion: 2.1 time: 0.237019 Jul 30 21:53:11.452405 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3228/6413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:11 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:12.473974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:12.474711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:12.482234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.482721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.483561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.484035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.617218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:12.625209 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1d1e34b-aabe-43eb-9d92-1019b4ef697f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1679 microversion: 2.1 time: 0.155635 Jul 30 21:53:12.625809 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3186/6414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:12 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:12.647795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:12.648421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:12.656058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.656598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.657488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.657994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.694591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.694967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.695852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.696278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.722062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:53:12.727645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:53:12.828039 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-426d4c40-d640-47da-846b-5004981b4b05 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/action" status: 202 len: 0 microversion: 2.1 time: 0.184032 Jul 30 21:53:12.828645 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3229/6415] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:53:12 2022] POST /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:53:12.837396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:12.838073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:12.845404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.846025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:12.847015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:12.847768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:13.055500 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:13.063640 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e5dbd83-fa55-4750-888d-f73f0b15a43f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1678 microversion: 2.1 time: 0.230269 Jul 30 21:53:13.064222 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3187/6416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:12 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:14.086824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:14.087609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:14.095903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:14.096363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:14.097136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:14.097583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:14.117636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:14.239863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:14.247508 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-868eb7d1-5783-421f-8323-670bdae07120 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1678 microversion: 2.1 time: 0.165711 Jul 30 21:53:14.248019 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3230/6417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:14 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:14.582816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "name": "network-vif-plugged", "status": "completed", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:14.595745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:14.596352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:14.608650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] Creating event network-vif-plugged:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch1-master-1 Jul 30 21:53:14.613991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:53:14.625644 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-80af937f-0f55-4816-bf10-e06415473a0f req-d380e2e6-eeb3-455d-9057-73d33c2d240d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047127 Jul 30 21:53:14.626615 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3188/6418] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:15.269879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:15.270440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:15.277606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:15.278073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:15.278860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:15.279374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:15.417603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:15.427675 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98567046-25e5-4bdb-97d0-6152d6c460e1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1678 microversion: 2.1 time: 0.162307 Jul 30 21:53:15.428629 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3231/6419] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:15 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:16.110113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "name": "network-vif-unplugged", "status": "completed", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:16.124155 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:16.124939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:16.140766 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] Creating event network-vif-unplugged:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:53:16.147387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:53:16.162929 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ee441a61-883e-477c-9c6b-acaf446883ca req-b7f17af0-c394-4b34-81e9-fce5c75e0cad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057811 Jul 30 21:53:16.164056 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3189/6420] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:16.449675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:16.450311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:16.457427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:16.457898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:16.458678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:16.459129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:16.726921 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:16.735115 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-315728a0-ddb5-4b5c-8cb2-12265e1023d7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1678 microversion: 2.1 time: 0.289678 Jul 30 21:53:16.735726 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3232/6421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:16 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:17.756806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:17.757528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:17.764861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:17.765343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:17.766159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:17.766878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:17.898795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:17.906427 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c328b19-a12c-423b-aa10-027aac3b3df8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1678 microversion: 2.1 time: 0.153885 Jul 30 21:53:17.906998 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3190/6422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:17 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:18.198825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:18.209053 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:18.209535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:18.221603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] Creating event network-changed:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:53:18.226930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:53:18.238234 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-8f64c440-1cf6-4d90-b599-96ee19e5d8db req-be292243-7dd3-4c1e-89f1-7a70718af7ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043128 Jul 30 21:53:18.238817 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3233/6423] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:18.930077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:18.930719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:18.938289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:18.938769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:18.939593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:18.940064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.068369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:19.076027 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bce6692d-35f7-4431-bbdc-025df8953166 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1671 microversion: 2.1 time: 0.150978 Jul 30 21:53:19.077234 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3191/6424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:18 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:19.097517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:19.098221 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:19.104548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.105006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.105774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.106219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.236278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:19.243872 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5d0ce755-f05a-4f93-ab0d-650fbf69f26b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1671 microversion: 2.1 time: 0.150709 Jul 30 21:53:19.244439 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3234/6425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:19 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:19.264854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:19.265501 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:19.272031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.272471 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.273277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.273753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.291740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=100 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:19.408856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:19.416578 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6f4f4e8b-413b-40b0-89f3-8906fcc9ee20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1671 microversion: 2.1 time: 0.155710 Jul 30 21:53:19.417159 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3192/6426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:19 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:19.437973 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:19.438588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:19.444907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.445379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.446193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.446651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.471214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:53:19.544778 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0c8d307f-31b2-4d42-ae9a-7defcf284c9b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 204 len: 0 microversion: 2.1 time: 0.110911 Jul 30 21:53:19.546589 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3235/6427] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:53:19 2022] DELETE /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:53:19.556504 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:19.557162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:19.564130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.564618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.565426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:19.565902 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:19.694825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:19.702585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70e81f76-2d07-43ef-8c3c-cdb161a352aa tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1677 microversion: 2.1 time: 0.151314 Jul 30 21:53:19.703170 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3193/6428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:19 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:20.727541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:20.728493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:20.731422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:20.738432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:20.738892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:20.739713 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:20.740190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:20.976931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:20.985126 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2697e6ef-af16-4224-9fba-18debf62606a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1677 microversion: 2.1 time: 0.261948 Jul 30 21:53:20.985636 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3236/6429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:20 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:21.679861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a03318c1-7dc9-4fa9-8bf1-34a731666fc2 req-f628f8dc-c5d7-4849-a59b-011add0d90f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94300bbf-be04-47fe-a7e2-16944fd42d58", "name": "network-vif-deleted", "tag": "e2df1185-2c0a-447c-81ff-d6b43f319095"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:21.687279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=39 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:21.694679 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a03318c1-7dc9-4fa9-8bf1-34a731666fc2 req-f628f8dc-c5d7-4849-a59b-011add0d90f9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:21.695344 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a03318c1-7dc9-4fa9-8bf1-34a731666fc2 req-f628f8dc-c5d7-4849-a59b-011add0d90f9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:21.711594 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a03318c1-7dc9-4fa9-8bf1-34a731666fc2 req-f628f8dc-c5d7-4849-a59b-011add0d90f9 service nova] Creating event network-vif-deleted:e2df1185-2c0a-447c-81ff-d6b43f319095 for instance 94300bbf-be04-47fe-a7e2-16944fd42d58 on nch2-master-1 Jul 30 21:53:21.718828 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a03318c1-7dc9-4fa9-8bf1-34a731666fc2 req-f628f8dc-c5d7-4849-a59b-011add0d90f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042347 Jul 30 21:53:21.719469 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3194/6430] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:22.007773 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:22.008498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:22.016633 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:22.017062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:22.017864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:22.018320 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:22.053978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:22.054510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:22.055101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lazy-loading 'fault' on Instance uuid 94300bbf-be04-47fe-a7e2-16944fd42d58 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 21:53:22.101524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:22.111010 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ade2f7e2-df44-4f1e-85c1-42a5e4dd1e08 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 200 len: 1329 microversion: 2.1 time: 0.106986 Jul 30 21:53:22.111959 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3237/6431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:22 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:23.139708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:23.140438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:23.148247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.148708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.149510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.149975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.164293 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 HTTP/1.1 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '94300bbf-be04-47fe-a7e2-16944fd42d58'} Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:53:23.170490 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ab38da5b-3200-4a37-aad5-b7e018bbbb63 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 404 len: 111 microversion: 2.1 time: 0.038393 Jul 30 21:53:23.175166 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3195/6432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:23 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:53:23.187014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:23.187707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:23.190622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:23.195622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.196084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.196855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.197300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.211359 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 HTTP/1.1 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '94300bbf-be04-47fe-a7e2-16944fd42d58'} Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:53:23.213012 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed2fa321-5144-4384-a8fb-124632a9bb1c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 404 len: 111 microversion: 2.1 time: 0.031152 Jul 30 21:53:23.217795 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3238/6433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:23 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:53:23.319713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1013010753", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "71431093-0922-4685-93f5-43036332ac76"}], "security_groups": [{"name": "tempest-securitygroup--197795691"}], "key_name": "tempest-keypair-1369312178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:23.430748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] validate_networks() for [('71431093-0922-4685-93f5-43036332ac76', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:53:23.801709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:53:23.802159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:53:23.802655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:53:23.803089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:53:23.803650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:53:23.813267 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.813740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.814565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:23.815025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:23.831759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:53:23.837054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:53:23.849310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:53:23.851618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:53:23.897921 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-15e05dfd-3368-431b-af9f-a8749b7d6b18 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.582164 Jul 30 21:53:23.898693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3196/6434] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:53:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:53:23.909626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c07deb0a-bf26-4ad0-a591-2f0993c780eb tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:23.910263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c07deb0a-bf26-4ad0-a591-2f0993c780eb tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:23.965787 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c07deb0a-bf26-4ad0-a591-2f0993c780eb tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:23.972606 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c07deb0a-bf26-4ad0-a591-2f0993c780eb tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1239 microversion: 2.1 time: 0.066863 Jul 30 21:53:23.973189 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3239/6435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:23 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:53:24.995157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:24.995854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:25.003752 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:25.004436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:25.005258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:25.005731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:25.069278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:25.077906 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea378c81-eb7c-43c4-9804-6355ea137e20 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1297 microversion: 2.1 time: 0.087502 Jul 30 21:53:25.078604 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3197/6436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:24 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:26.102847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:26.104098 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:26.110269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-50077b08-6c0a-4843-bcf4-5802ab592c26 req-a71e1983-0405-45d6-a30c-ee2f0c754aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:26.112551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:26.113028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:26.114184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:26.114926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:26.127307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-50077b08-6c0a-4843-bcf4-5802ab592c26 req-a71e1983-0405-45d6-a30c-ee2f0c754aa6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:26.127790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-50077b08-6c0a-4843-bcf4-5802ab592c26 req-a71e1983-0405-45d6-a30c-ee2f0c754aa6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:26.144585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-50077b08-6c0a-4843-bcf4-5802ab592c26 req-a71e1983-0405-45d6-a30c-ee2f0c754aa6 service nova] Creating event network-changed:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:53:26.149930 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-50077b08-6c0a-4843-bcf4-5802ab592c26 req-a71e1983-0405-45d6-a30c-ee2f0c754aa6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049419 Jul 30 21:53:26.150898 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3198/6437] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:26.678031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:26.685569 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cca13f16-f075-4172-95f0-3fc9880daee1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1364 microversion: 2.1 time: 0.586633 Jul 30 21:53:26.686810 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3240/6438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:26 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1364 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:27.708059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:27.708845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:27.716776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:27.717258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:27.718059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:27.718525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:27.856592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:27.864975 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4d7fb1e4-0d3b-4182-8678-3034692ce72b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1364 microversion: 2.1 time: 0.161230 Jul 30 21:53:27.865562 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3199/6439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:27 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:53:28.886093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:28.887359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:28.894951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:28.895448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:28.896597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:28.896916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:29.034218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:29.041805 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d82e445f-a94d-445a-afb0-ab402edfbcd4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1364 microversion: 2.1 time: 0.159695 Jul 30 21:53:29.042370 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3241/6440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:28 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:30.064191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:30.064833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:30.071968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:30.072448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:30.073238 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:30.073706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:30.207314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:30.215061 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b63882cd-045b-4c12-9a56-6a45b1a9fda2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1364 microversion: 2.1 time: 0.154876 Jul 30 21:53:30.215667 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3200/6441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:30 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:30.853250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6bb4655a-3ab1-499b-ab99-f4340f0ad933 req-92d35939-5fc7-4375-90e1-cae99102bfbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "name": "network-vif-plugged", "status": "completed", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:30.865009 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6bb4655a-3ab1-499b-ab99-f4340f0ad933 req-92d35939-5fc7-4375-90e1-cae99102bfbd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:30.865467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6bb4655a-3ab1-499b-ab99-f4340f0ad933 req-92d35939-5fc7-4375-90e1-cae99102bfbd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:30.876729 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6bb4655a-3ab1-499b-ab99-f4340f0ad933 req-92d35939-5fc7-4375-90e1-cae99102bfbd service nova] Creating event network-vif-plugged:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:53:30.881652 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6bb4655a-3ab1-499b-ab99-f4340f0ad933 req-92d35939-5fc7-4375-90e1-cae99102bfbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032110 Jul 30 21:53:30.882239 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3242/6442] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:31.236742 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:31.237304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:31.244652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:31.244906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:31.245707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:31.246173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:31.381350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:31.389474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e94850e-f155-410b-9fae-d15cd4714478 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1364 microversion: 2.1 time: 0.156380 Jul 30 21:53:31.390043 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3201/6443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:31 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:53:32.412085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:32.412808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:32.419415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:32.420497 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:32.421290 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:32.421751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:32.552997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:53:32.560608 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6a1afdb1-5d8b-4c33-88c6-0c4b7e69cc68 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1551 microversion: 2.1 time: 0.153779 Jul 30 21:53:32.561183 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3243/6444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:53:32 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:53:32.581109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:53:32.581636 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:53:32.588688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:32.589170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:32.589962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:32.590433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:32.668713 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-050065d4-6704-4efa-824f-3457ca261ae7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091443 Jul 30 21:53:32.669321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3202/6445] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Jul 30 21:53:32 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:53:33.595561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3cb2911a-4b0d-4764-b0b7-ff223184d17f req-0ee873ba-28c7-41e1-b727-67c91089c66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:53:33.605854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3cb2911a-4b0d-4764-b0b7-ff223184d17f req-0ee873ba-28c7-41e1-b727-67c91089c66a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:53:33.606311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3cb2911a-4b0d-4764-b0b7-ff223184d17f req-0ee873ba-28c7-41e1-b727-67c91089c66a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:53:33.617697 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3cb2911a-4b0d-4764-b0b7-ff223184d17f req-0ee873ba-28c7-41e1-b727-67c91089c66a service nova] Creating event network-changed:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:53:33.622564 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3cb2911a-4b0d-4764-b0b7-ff223184d17f req-0ee873ba-28c7-41e1-b727-67c91089c66a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030888 Jul 30 21:53:33.624144 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3244/6446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:54:08.056967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.057748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.058488 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.059197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=44 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.063775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:08.064410 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:08.072718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:08.073192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:08.073979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:08.074439 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:08.206470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:08.214145 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-13665780-e857-4a61-bd3d-eac853c44f4b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1670 microversion: 2.1 time: 0.159236 Jul 30 21:54:08.214741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3203/6447] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:08 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:08.231280 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.234137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=21 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.234829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:08.239774 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46bb72b4-caf4-4b4f-909b-93b09cc1d58f"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:08.242186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:08.253552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:08.253951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:08.254729 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:08.255180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:08.492373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-15c5408b-3d58-483d-88e1-098c0ca54713 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261756 Jul 30 21:54:08.493027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3245/6448] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:54:08 2022] POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:54:10.739574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:10.741850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:10.748272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:10.748753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:10.750046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:10.750503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:10.779077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:10.784822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=130983) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 21:54:10.791622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:54:10.792067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:54:10.792561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:54:10.792994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:54:10.793429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:54:10.853580 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7d237604-86a3-4114-a9d9-a169158112a2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/action" status: 202 len: 0 microversion: 2.1 time: 0.117995 Jul 30 21:54:10.854189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3204/6449] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:54:10 2022] POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:54:10.863715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:10.864621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:10.871055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:10.871558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:10.872343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:10.872796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:11.021716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:11.030004 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e2a728a1-6a96-4dba-813b-d85a9c8d63a1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1725 microversion: 2.1 time: 0.171422 Jul 30 21:54:11.031193 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3246/6450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:10 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:12.052803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:12.053475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:12.059751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:12.060242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:12.061046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:12.062097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:12.200767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:12.209956 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-12f51d38-2433-4f01-b72b-1f36610f041e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1725 microversion: 2.1 time: 0.161906 Jul 30 21:54:12.210583 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3205/6451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:12 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:13.231273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:13.231916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:13.238931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:13.239428 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:13.240209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:13.240655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:13.370955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:13.379326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-19c86aa7-1fa5-48af-81bd-2bab697d486b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.151898 Jul 30 21:54:13.379936 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3247/6452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:13 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:14.401657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:14.402296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:14.409800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:14.410279 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:14.411065 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:14.411552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:14.544033 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:14.552667 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9bfb37c8-4627-4e83-810d-3626ac437558 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.154959 Jul 30 21:54:14.553243 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3206/6453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:14 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:15.573934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:15.574565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:15.581733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:15.582204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:15.583234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:15.583719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:15.720955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:15.729277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f42c2fac-8ba6-403e-9a19-ec96d00705b4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.159227 Jul 30 21:54:15.729849 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3248/6454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:15 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:16.751647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:16.752216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:16.759417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:16.759906 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:16.760709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:16.761182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:16.893977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:16.902149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f93d31cd-9a78-4aab-b2dd-d2883270dca4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.155095 Jul 30 21:54:16.902723 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3207/6455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:16 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:17.926248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:17.926888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:17.934109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:17.934579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:17.935408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:17.935867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:18.074422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:18.083163 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-abf98c9b-cb12-4f75-b911-0659b0d3d5c4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.163062 Jul 30 21:54:18.083776 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3249/6456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:17 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:19.105430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:19.106075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:19.113804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:19.114289 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:19.115085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:19.115585 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:19.251948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:19.260049 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0b46511d-d8b5-4070-8ff9-5bd7dc331474 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.158559 Jul 30 21:54:19.260631 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3208/6457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:19 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:20.282985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:20.283558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:20.290468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:20.290926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:20.291739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:20.292185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:20.426628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:20.434679 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e11f95bf-add3-49ed-a08f-203057a555d5 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.155667 Jul 30 21:54:20.435254 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3250/6458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:20 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:21.456206 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:21.456855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:21.463908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:21.464414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:21.465245 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:21.465722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:21.600197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:21.609068 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-caf20dea-0617-4f1c-89f8-f293e8dab648 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.157283 Jul 30 21:54:21.609793 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3209/6459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:21 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:22.630378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:22.631010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:22.638407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:22.638878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:22.639696 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:22.640153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:22.772209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:22.780223 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b6ea6ea-ddd1-44ef-ae62-8db19ee82597 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.153771 Jul 30 21:54:22.780775 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3251/6460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:22 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:23.803016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:23.803698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:23.810788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:23.811270 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:23.812095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:23.812566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:23.942203 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:23.951798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b8a9d5c7-2dfb-4187-86c4-3b1daa78c8a7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.152454 Jul 30 21:54:23.952416 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3210/6461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:23 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:24.974237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:24.974953 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:24.982312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:24.982770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:24.983770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:24.984711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:25.117042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:25.125819 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0ce46552-8043-4c24-a641-938109fe1438 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.155046 Jul 30 21:54:25.126393 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3252/6462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:24 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:26.147918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:26.148568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:26.155660 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:26.156148 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:26.156950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:26.157432 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:26.294188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:26.305132 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2a0fe829-6e72-47ec-8316-0efb38f80f30 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.161226 Jul 30 21:54:26.305716 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3211/6463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:26 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:27.326827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:27.327481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:27.334881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:27.335374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:27.336157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:27.336608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:27.474413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:27.483210 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48988c22-7feb-4782-a2b2-50c2f8b16f39 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.160274 Jul 30 21:54:27.483835 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3253/6464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:27 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:28.504469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:28.505106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:28.512165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:28.512642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:28.513456 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:28.513918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:28.643396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:28.651505 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c2f82c6e-7d33-4f37-bfef-7775721dada7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.150942 Jul 30 21:54:28.652083 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3212/6465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:28 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:29.673919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:29.674458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:29.681546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:29.682010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:29.682788 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:29.683244 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:29.813312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:29.821293 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9b13d3b6-69d5-4231-bf2b-3e47af1f61da tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.152098 Jul 30 21:54:29.821866 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3254/6466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:29 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:30.842441 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:30.843126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:30.850893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:30.851381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:30.852168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:30.852631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:30.986337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:30.995118 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47499669-543f-458f-97c9-62901d3a4c66 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.156636 Jul 30 21:54:30.995746 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3213/6467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:30 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:32.016270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:32.017184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:32.024628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:32.025092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:32.025867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:32.026314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:32.159321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:32.167303 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4830cfbd-24b5-459e-b991-76d8e01e1716 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.154919 Jul 30 21:54:32.167872 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3255/6468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:32 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:33.190323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:33.190956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:33.197956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:33.198428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:33.199212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:33.199698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:33.349403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:33.357555 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-84732635-907b-4999-a4d0-14287b719d8f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.171818 Jul 30 21:54:33.358141 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3214/6469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:33 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:34.379150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:34.379814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:34.386786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:34.387241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:34.388042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:34.388486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:34.520089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:34.528205 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45a4de58-18c5-4907-a3e4-0064a3d34b34 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.153455 Jul 30 21:54:34.528791 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3256/6470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:34 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:35.549676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:35.550306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:35.557368 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:35.557853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:35.558651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:35.559120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:35.689417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:35.697537 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-11e59a13-2f43-4bb6-ad8a-a67320a2b89a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.151899 Jul 30 21:54:35.698119 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3215/6471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:35 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:36.720048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:36.720678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:36.727784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:36.728261 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:36.729046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:36.729503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:36.859160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:36.867773 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cc359dfc-d8e1-4fc6-9769-eb243943ccb9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.152135 Jul 30 21:54:36.868354 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3257/6472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:36 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:37.943756 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:37.944404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:37.951495 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:37.951981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:37.953427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:37.953897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:38.089402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:38.091680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:38.099795 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-66cefa00-310e-408a-a9c7-0793e9a1249d tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.214492 Jul 30 21:54:38.100396 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3216/6473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:37 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:39.121063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:39.121684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:39.124576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=27 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:39.131962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:39.132429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:39.133220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:39.133669 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:39.136449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:39.267111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:39.275078 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d014190a-6c1c-48f4-8701-551182b9e897 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.157900 Jul 30 21:54:39.275680 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3258/6474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:39 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:40.297886 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:40.298571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:40.301003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=33 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:40.307799 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:40.308341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:40.309282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:40.309847 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:40.456332 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:40.464585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-08d75d20-e5fd-4c70-89bc-3d41261a1eb3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1730 microversion: 2.1 time: 0.171510 Jul 30 21:54:40.465162 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3217/6475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:40 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:41.169896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "name": "network-vif-unplugged", "status": "completed", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:41.179894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:41.180481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:41.192741 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] Creating event network-vif-unplugged:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch1-master-1 Jul 30 21:54:41.198169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:54:41.210204 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-a480a1c4-676f-437f-aff6-645352ef65ed req-9ce1101d-89cd-4f8d-a48f-2a8d90fab5e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110581 Jul 30 21:54:41.210830 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3259/6476] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:54:41.486601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:41.487236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:41.494845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:41.495349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:41.496162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:41.496627 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:41.732258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:41.741012 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a855153c-2b49-46f9-ae8a-ed10e2c224b9 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1729 microversion: 2.1 time: 0.258849 Jul 30 21:54:41.741596 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3218/6477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:41 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:42.763814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:42.766420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:42.774063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:42.774535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:42.775345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:42.775801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:42.914893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:42.923701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-345b1513-56f7-4d3e-9c11-972e44f565b7 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1727 microversion: 2.1 time: 0.165372 Jul 30 21:54:42.924261 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3260/6478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:42 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:43.228273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:43.239809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:43.240358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:43.252065 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] Creating event network-changed:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch1-master-1 Jul 30 21:54:43.257412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:54:43.270282 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-c9d409ee-54bc-47a1-aafe-c3fbe7bbf2de req-5ce33d3c-0e15-4ca0-a7c9-79225b3badab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045834 Jul 30 21:54:43.270884 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3219/6479] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:54:43.946095 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:43.946783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:43.954456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:43.954861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:43.955666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:43.956115 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:44.091393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:44.105301 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-862f8c97-3a42-4e8a-a326-aacfb4433800 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1727 microversion: 2.1 time: 0.163050 Jul 30 21:54:44.105893 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3261/6480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:43 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:45.126537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:45.127262 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:45.134534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:45.135013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:45.135846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:45.136306 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:45.270089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:45.278224 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6eae05e4-8454-4f19-91f8-dde690cb9135 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1727 microversion: 2.1 time: 0.155951 Jul 30 21:54:45.278800 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3220/6481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:45 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:46.301335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:46.301870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:46.309232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.309711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.310503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.310958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.448041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:46.456127 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cfeaa0a2-7460-485c-8dd8-021f2601f745 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1724 microversion: 2.1 time: 0.160043 Jul 30 21:54:46.456703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3262/6482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:46 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:46.477086 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:46.477663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:46.485411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.485896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.486703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.487178 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.527469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.527954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.528797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.529269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.550265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:54:46.555575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Getting quotas for user bbfd9b97c2004392b2f32631352d95fb and project 4d5d85194b3a4a05bd1e5e1af89e5acf. Resources: {'cores', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:54:46.657307 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-da1c16db-2bcb-4c62-af62-70507684ef84 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/action" status: 202 len: 0 microversion: 2.1 time: 0.183921 Jul 30 21:54:46.657925 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3221/6483] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:54:46 2022] POST /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:54:46.666677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:46.667500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:46.673830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.674345 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.675300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:46.675955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:46.823322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:46.832145 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e243e6b9-e00a-47d3-b977-ad1e0f53b63a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.170016 Jul 30 21:54:46.832741 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3263/6484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:46 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:47.855464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:47.856191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:47.863229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:47.863734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:47.864544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:47.865006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:48.000908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:48.009230 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b94a28e9-49a3-40d8-96c3-4565dabce7f3 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.158912 Jul 30 21:54:48.009823 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3222/6485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:47 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:49.031354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:49.032552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:49.039303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:49.039966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:49.040759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:49.041239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:49.187475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:49.197533 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b821c977-b522-431a-8516-0e5642a59f36 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.170031 Jul 30 21:54:49.199599 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3264/6486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:49 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:50.221274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:50.222269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:50.229735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:50.230326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:50.231918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:50.232861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:50.382249 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:50.390519 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0605e1f6-27fe-4b10-b5ff-a20be54a76f1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.173370 Jul 30 21:54:50.391229 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3223/6487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:50 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:50.528698 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:50.545031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:50.545490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:50.557812 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] Creating event network-changed:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:54:50.564401 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 21:54:50.575391 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-6f1441ab-c3ab-4b95-8017-a5f3b873d445 req-ad9c4ab6-1853-4d98-8e7d-ff034db7ea75 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050361 Jul 30 21:54:50.576011 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3265/6488] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:54:51.412474 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:51.413119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:51.420287 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:51.420788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:51.421601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:51.422070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:51.564668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:51.573686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a46c15a8-a990-41ce-96c5-3d98efa5009e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.165184 Jul 30 21:54:51.574279 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3224/6489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:51 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:52.597647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:52.598367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:52.604786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:52.605259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:52.606045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:52.606505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:52.739607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:52.747731 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d4e185fa-2cd1-4e78-beb4-0550a4c5a469 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.155761 Jul 30 21:54:52.748249 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3266/6490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:52 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:53.769327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:53.769996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:53.777074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:53.777555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:53.778350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:53.778818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:53.907006 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:53.915078 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d91fc277-66d8-4dc6-afb8-6dae59f0aaa2 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1723 microversion: 2.1 time: 0.150064 Jul 30 21:54:53.915683 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3225/6491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:53 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:54.937621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:54.938966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:54.946247 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:54.946717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:54.947559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:54.948016 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.082604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:55.092978 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47528e84-162b-42aa-ad83-6323f591b91c tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1716 microversion: 2.1 time: 0.159733 Jul 30 21:54:55.093850 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3267/6492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:54 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:54:55.114956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:55.116227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:55.122962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.123493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.124936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.125412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.258434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:55.267267 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02973b0c-d3c2-476d-ac4f-7a9d3eef0f52 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1716 microversion: 2.1 time: 0.156678 Jul 30 21:54:55.267967 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3226/6493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:55 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:55.288131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:55.288784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:55.294916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.295413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.296814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.297259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.442058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:55.451114 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7f7d5e0-427d-48a4-a4b7-f237e94aa29e tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1716 microversion: 2.1 time: 0.166753 Jul 30 21:54:55.451807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3268/6494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:55 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:55.472775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:55.473234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:55.479484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.479972 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.480775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.481250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.510000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:54:55.589971 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d579a07-6004-48cf-a694-9ece2e58bc9f tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 204 len: 0 microversion: 2.1 time: 0.120792 Jul 30 21:54:55.590792 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3227/6495] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:54:55 2022] DELETE /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:54:55.600545 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:55.601294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:55.607590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.608442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.608906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:55.609363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:55.747018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:55.758332 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1467ab6e-59fb-44be-a3df-6a7093f5aa3a tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1722 microversion: 2.1 time: 0.162117 Jul 30 21:54:55.758925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3269/6496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:55 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:56.781955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:56.782595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:56.785608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:56.791437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:56.791912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:56.792713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:56.793174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:56.938070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:56.946448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a52312c0-00c3-46b1-9d17-2f7a4139e8b8 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1722 microversion: 2.1 time: 0.169314 Jul 30 21:54:56.947232 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3228/6497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:56 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:57.413695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-69b46792-5f52-45e1-b7c6-a17c111fe07c req-3b77be8b-dbf1-4011-8dbe-7bfea3381443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "name": "network-vif-plugged", "status": "completed", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:57.429007 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-69b46792-5f52-45e1-b7c6-a17c111fe07c req-3b77be8b-dbf1-4011-8dbe-7bfea3381443 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:57.429479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-69b46792-5f52-45e1-b7c6-a17c111fe07c req-3b77be8b-dbf1-4011-8dbe-7bfea3381443 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:57.443212 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-69b46792-5f52-45e1-b7c6-a17c111fe07c req-3b77be8b-dbf1-4011-8dbe-7bfea3381443 service nova] Creating event network-vif-plugged:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:54:57.449814 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-69b46792-5f52-45e1-b7c6-a17c111fe07c req-3b77be8b-dbf1-4011-8dbe-7bfea3381443 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121013 Jul 30 21:54:57.450719 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3270/6498] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:54:57.968150 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:57.968822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:57.976654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:57.977137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:57.977949 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:57.978422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:57.982924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:58.117764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbfd9b97c2004392b2f32631352d95fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5d85194b3a4a05bd1e5e1af89e5acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:54:58.127957 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5fb7d836-f9dc-44f5-b39d-644c74894732 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 200 len: 1722 microversion: 2.1 time: 0.163703 Jul 30 21:54:58.129191 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3229/6499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:57 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:54:58.395043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-cd2c1bab-06f6-4dbc-a26d-c4e8e551ea60 req-3e4fc15a-2bf8-4406-bdd5-50249584694a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5eb6b3a-86c8-4a31-96a3-59949f3371b0", "name": "network-vif-deleted", "tag": "92ee3db6-920b-4e2b-8e4f-b8d4d64322f1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:54:58.405608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cd2c1bab-06f6-4dbc-a26d-c4e8e551ea60 req-3e4fc15a-2bf8-4406-bdd5-50249584694a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:58.406069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-cd2c1bab-06f6-4dbc-a26d-c4e8e551ea60 req-3e4fc15a-2bf8-4406-bdd5-50249584694a service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:58.419826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-cd2c1bab-06f6-4dbc-a26d-c4e8e551ea60 req-3e4fc15a-2bf8-4406-bdd5-50249584694a service nova] Creating event network-vif-deleted:92ee3db6-920b-4e2b-8e4f-b8d4d64322f1 for instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 on nch2-master-1 Jul 30 21:54:58.425664 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-cd2c1bab-06f6-4dbc-a26d-c4e8e551ea60 req-3e4fc15a-2bf8-4406-bdd5-50249584694a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Jul 30 21:54:58.426266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3271/6500] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:54:59.150303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:59.151591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:59.158739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:59.159213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:59.160038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:59.160502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:59.174371 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 HTTP/1.1 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c5eb6b3a-86c8-4a31-96a3-59949f3371b0'} Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:54:59.176199 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a2b8f8af-9e26-4d17-9225-9f212f81ea74 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 404 len: 111 microversion: 2.1 time: 0.031590 Jul 30 21:54:59.180658 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3230/6501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:54:59 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:54:59.246840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:54:59.249719 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:54:59.256461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:59.256924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:59.257728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:54:59.258170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:54:59.274427 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-volume_attachments HTTP/1.1 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'server_id': 'c5eb6b3a-86c8-4a31-96a3-59949f3371b0'} Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:54:59.276144 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-43b43cc4-e764-4525-8745-d7d3d36547f4 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035168 Jul 30 21:54:59.280091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3272/6502] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 21:54:59 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.515721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.516264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.523707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.524198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.525004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.525478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.539474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 HTTP/1.1 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'c5eb6b3a-86c8-4a31-96a3-59949f3371b0'} Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.541095 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b6c52e7-1b40-492e-ab4c-451fde5d997b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 404 len: 111 microversion: 2.1 time: 0.030780 Jul 30 21:55:00.546363 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3231/6503] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:00 2022] DELETE /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.551822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.552446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: c5eb6b3a-86c8-4a31-96a3-59949f3371b0] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.559366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.559826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.560603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.561052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.574423 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 HTTP/1.1 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'c5eb6b3a-86c8-4a31-96a3-59949f3371b0'} Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.575952 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance c5eb6b3a-86c8-4a31-96a3-59949f3371b0 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c5218eb2-a7fc-4390-a04b-3c742c49e700 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0" status: 404 len: 111 microversion: 2.1 time: 0.029473 Jul 30 21:55:00.581441 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3273/6504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:00 2022] GET /compute/v2.1/servers/c5eb6b3a-86c8-4a31-96a3-59949f3371b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.585978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.586550 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.593365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.593854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.594665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.595143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.609287 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 HTTP/1.1 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '94300bbf-be04-47fe-a7e2-16944fd42d58'} Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.610970 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39dd585f-93e0-43ae-9c87-e8f9491dd208 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 404 len: 111 microversion: 2.1 time: 0.030362 Jul 30 21:55:00.615659 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3232/6505] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:00 2022] DELETE /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:55:00.620491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.621135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 94300bbf-be04-47fe-a7e2-16944fd42d58] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.627394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.627870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.628658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.629113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.642627 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 HTTP/1.1 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '94300bbf-be04-47fe-a7e2-16944fd42d58'} Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.644183 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 94300bbf-be04-47fe-a7e2-16944fd42d58 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6e33dbcd-04e2-4e1c-99c6-e852989cc0de tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58" status: 404 len: 111 microversion: 2.1 time: 0.028871 Jul 30 21:55:00.648373 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3274/6506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:00 2022] GET /compute/v2.1/servers/94300bbf-be04-47fe-a7e2-16944fd42d58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.654076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.654641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.661299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.661774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.662591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.663052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.677258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 HTTP/1.1 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1326921c-c00a-483d-bb39-7097f5865771'} Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.678813 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4ed6f46c-dc0d-43f0-be1d-41a331f319a6 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 404 len: 111 microversion: 2.1 time: 0.030100 Jul 30 21:55:00.683321 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3233/6507] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:00 2022] DELETE /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.689035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.689656 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: 1326921c-c00a-483d-bb39-7097f5865771] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.695745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.696204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.696966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.697411 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.711244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 HTTP/1.1 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '1326921c-c00a-483d-bb39-7097f5865771'} Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.712849 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance 1326921c-c00a-483d-bb39-7097f5865771 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-48bdd884-5a1d-4931-a2c8-5167af88d946 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771" status: 404 len: 111 microversion: 2.1 time: 0.029437 Jul 30 21:55:00.717425 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3275/6508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:00 2022] GET /compute/v2.1/servers/1326921c-c00a-483d-bb39-7097f5865771 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.722539 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.723069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.730384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.730860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.731876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.732705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.746981 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab HTTP/1.1 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'be42b29f-52c5-4550-9dbd-554e42dc15ab'} Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.748529 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0553d94e-e800-4f5f-9208-95ecd08b1ca1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 404 len: 111 microversion: 2.1 time: 0.031772 Jul 30 21:55:00.753838 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3234/6509] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:00 2022] DELETE /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:55:00.759184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.759860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [instance: be42b29f-52c5-4550-9dbd-554e42dc15ab] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:00.766813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.767594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.768376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:00.768828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:00.782435 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] HTTP exception thrown: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Request method failure captured: Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab HTTP/1.1 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5adwCFOd65Q3uACq1lON8-qQeXJn25ySU-56Qgluh5D1NvCp8PvfRp2rWqlwa5D41t1ADpMeI_rBgOv4iF3I-maWmJFkfiSQgv6lEeK7kRG9UIr01jT4n_jnXWHmGfgmratILEx56mnIFr7ZWN_rbLdRK-bmB2ONY7KYMQgOtC7s-Ss Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d5d85194b3a4a05bd1e5e1af89e5acf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d5d85194b3a4a05bd1e5e1af89e5acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 4d5d85194b3a4a05bd1e5e1af89e5acf Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServerActionsTestJSON-1580867055 Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: bbfd9b97c2004392b2f32631352d95fb Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServerActionsTestJSON-1580867055-project Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'be42b29f-52c5-4550-9dbd-554e42dc15ab'} Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:00.784036 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Returning 404 to user: Instance be42b29f-52c5-4550-9dbd-554e42dc15ab could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a4e84b6d-763c-4cef-ba38-66f7a4c75a6b tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab" status: 404 len: 111 microversion: 2.1 time: 0.030145 Jul 30 21:55:00.788987 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3276/6510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:00 2022] GET /compute/v2.1/servers/be42b29f-52c5-4550-9dbd-554e42dc15ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:00.794058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-776b0ef7-5aed-4efa-bc44-72a917e7fcd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] Calling method '.version_select at 0x7fbb5cf2fee0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:00.799157 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-776b0ef7-5aed-4efa-bc44-72a917e7fcd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [0e9bd2dc-48a9-4a4d-9fa2-fda906f66a7d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 21:55:01.806555 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [None req-776b0ef7-5aed-4efa-bc44-72a917e7fcd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] [0e9bd2dc-48a9-4a4d-9fa2-fda906f66a7d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54128. Jul 30 21:55:01.828216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-776b0ef7-5aed-4efa-bc44-72a917e7fcd1 tempest-ServerActionsTestJSON-1580867055 tempest-ServerActionsTestJSON-1580867055-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369312178" status: 202 len: 0 microversion: 2.1 time: 1.037970 Jul 30 21:55:01.828803 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3235/6511] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 30 21:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369312178 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 21:55:10.792242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=37 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:10.793058 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=81 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:10.942932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606721367", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "5ce5037c-b968-4577-86e7-ff0c44b9c898"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:11.010048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] validate_networks() for [('5ce5037c-b968-4577-86e7-ff0c44b9c898', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:55:11.472940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:55:11.473502 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:55:11.473999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:55:11.474453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:55:11.474887 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:55:11.484634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:11.485100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:11.485920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:11.486372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:11.504008 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Getting quotas for project f7e4885eb9d54dccbc0a3589ba059b4f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:55:11.509631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Getting quotas for user c4b0c5ad524b4f0b83b0c4fa2d2b618a and project f7e4885eb9d54dccbc0a3589ba059b4f. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:55:11.524076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:55:11.526608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:55:11.569830 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [d6cabaa2-0cf1-4d5c-928f-1e0904775204] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 21:55:12.578699 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [d6cabaa2-0cf1-4d5c-928f-1e0904775204] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54210. Jul 30 21:55:12.584857 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d3837055-0881-4a17-9f2d-4a28d17e09fb tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799232 Jul 30 21:55:12.585842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3277/6512] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:55:12.595526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=15 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:12.596743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:12.600924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f01067cd-c280-4f15-9f00-a731c6534d66 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:12.601565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f01067cd-c280-4f15-9f00-a731c6534d66 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:12.676363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f01067cd-c280-4f15-9f00-a731c6534d66 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:12.683524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f01067cd-c280-4f15-9f00-a731c6534d66 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1216 microversion: 2.1 time: 0.090097 Jul 30 21:55:12.684312 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3236/6513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:12 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:55:13.708927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:13.709571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:13.721215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:13.721693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:13.722708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:13.723210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:13.831649 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:13.840915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3834c4ea-ab2f-4f43-982e-2058920bd791 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1276 microversion: 2.1 time: 0.139999 Jul 30 21:55:13.842622 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3278/6514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:13 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:14.865077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:14.865860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:14.872996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:14.873537 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:14.874425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:14.874957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:15.018333 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:15.025995 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1a408f13-89d4-40e4-957b-870c14809937 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1316 microversion: 2.1 time: 0.165376 Jul 30 21:55:15.026575 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3237/6515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:14 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:15.077838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-394a601c-9b2e-4563-96e0-73be8c8fb2a2 req-baa14b8e-8a1b-4a14-9223-396acb5c30be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b24ed-33d5-463c-a9dc-acaf75d2458e", "tag": "e4aaa790-63ea-4331-a11c-df3e15995c4f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:15.089347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-394a601c-9b2e-4563-96e0-73be8c8fb2a2 req-baa14b8e-8a1b-4a14-9223-396acb5c30be service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:15.090533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-394a601c-9b2e-4563-96e0-73be8c8fb2a2 req-baa14b8e-8a1b-4a14-9223-396acb5c30be service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:15.104800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-394a601c-9b2e-4563-96e0-73be8c8fb2a2 req-baa14b8e-8a1b-4a14-9223-396acb5c30be service nova] Creating event network-changed:e4aaa790-63ea-4331-a11c-df3e15995c4f for instance 477b24ed-33d5-463c-a9dc-acaf75d2458e on nch2-master-1 Jul 30 21:55:15.110497 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-394a601c-9b2e-4563-96e0-73be8c8fb2a2 req-baa14b8e-8a1b-4a14-9223-396acb5c30be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037305 Jul 30 21:55:15.111947 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3279/6516] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:55:16.048511 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:16.049201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:16.056265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:16.056751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:16.057551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:16.058022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:16.197599 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:16.205470 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4024e156-6b5d-49df-aa7a-953c4d1dda57 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1316 microversion: 2.1 time: 0.161949 Jul 30 21:55:16.206096 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3238/6517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:16 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:17.226510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:17.227230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:17.235180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:17.236021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:17.237396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:17.238207 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:17.590643 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 21:55:17.590867 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 21:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e (ip 10.222.0.17) !!! Jul 30 21:55:17.728468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:17.736838 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a2da70e7-5311-47f0-a918-ec78345e6658 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1316 microversion: 2.1 time: 0.514554 Jul 30 21:55:17.737438 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3280/6518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:17 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:18.757447 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:18.758690 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:18.767940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:18.768450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:18.769376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:18.769916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:18.901190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:18.909014 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce58a8f0-025f-41fd-8bc4-c2cd767813a5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1316 microversion: 2.1 time: 0.155579 Jul 30 21:55:18.909595 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3239/6519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:18 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:19.449163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-fdf95f7a-5961-46a1-919d-527dfdedb1c9 req-4e0911f6-5872-4e6e-848c-2930d034eb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b24ed-33d5-463c-a9dc-acaf75d2458e", "name": "network-vif-plugged", "status": "completed", "tag": "e4aaa790-63ea-4331-a11c-df3e15995c4f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:19.459279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fdf95f7a-5961-46a1-919d-527dfdedb1c9 req-4e0911f6-5872-4e6e-848c-2930d034eb61 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:19.459761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-fdf95f7a-5961-46a1-919d-527dfdedb1c9 req-4e0911f6-5872-4e6e-848c-2930d034eb61 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:19.471449 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-fdf95f7a-5961-46a1-919d-527dfdedb1c9 req-4e0911f6-5872-4e6e-848c-2930d034eb61 service nova] Creating event network-vif-plugged:e4aaa790-63ea-4331-a11c-df3e15995c4f for instance 477b24ed-33d5-463c-a9dc-acaf75d2458e on nch2-master-1 Jul 30 21:55:19.476429 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-fdf95f7a-5961-46a1-919d-527dfdedb1c9 req-4e0911f6-5872-4e6e-848c-2930d034eb61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Jul 30 21:55:19.477020 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3281/6520] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:55:19.930367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:19.931023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:19.938737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:19.939221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:19.940048 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:19.940519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:20.070310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:20.079250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4fe2806e-da71-4c08-bc73-f51a04ee6647 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1316 microversion: 2.1 time: 0.152895 Jul 30 21:55:20.079860 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3240/6521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:19 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:21.101511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:21.102253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:21.109322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:21.109794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:21.110583 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:21.111041 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:21.250350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:21.258100 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3d5e1309-d8b7-4db5-a8a6-d706d17430cf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.161742 Jul 30 21:55:21.258686 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3282/6522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:21 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:21.321020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-628988540", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "5ce5037c-b968-4577-86e7-ff0c44b9c898"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:21.374554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] validate_networks() for [('5ce5037c-b968-4577-86e7-ff0c44b9c898', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:55:21.740281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:55:21.740728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:55:21.741228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:55:21.741669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:55:21.742105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:55:21.751240 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:21.751687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:21.752521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:21.752988 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:21.770574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Getting quotas for project f7e4885eb9d54dccbc0a3589ba059b4f. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:55:21.775927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Getting quotas for user c4b0c5ad524b4f0b83b0c4fa2d2b618a and project f7e4885eb9d54dccbc0a3589ba059b4f. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:55:21.788710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:55:21.790965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:55:21.834759 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa07ba6e-a064-4fa4-b9c2-9ee8997c25e7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517658 Jul 30 21:55:21.835466 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3241/6523] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:55:21.846957 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-743eabb3-194c-40e1-b310-be8240db6842 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:21.847826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-743eabb3-194c-40e1-b310-be8240db6842 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:21.849924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:21.850745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:21.903387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-743eabb3-194c-40e1-b310-be8240db6842 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:21.911152 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-743eabb3-194c-40e1-b310-be8240db6842 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1216 microversion: 2.1 time: 0.068810 Jul 30 21:55:21.912413 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3283/6524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:21 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:22.933739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:22.934565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:22.943013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:22.943769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:22.947071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:22.947071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:23.061965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:23.069660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5b132baf-2474-46f8-bfb5-6347e0809989 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1274 microversion: 2.1 time: 0.141019 Jul 30 21:55:23.070476 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3242/6525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:22 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:24.090078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:24.090701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:24.098479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:24.098946 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:24.099795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:24.100243 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:24.241499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:24.250021 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03e67ca3-450e-4136-a89d-ff9c570fe59b tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.163800 Jul 30 21:55:24.250630 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3284/6526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:24 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:24.459883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aadd261f-f7c7-4330-aeff-93e1cb3edac6 req-3a459785-b863-4ad3-8c3f-1db08834b24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2", "tag": "e22ead95-2e78-40bd-88d2-f6a7cdfd27eb"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:24.474160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aadd261f-f7c7-4330-aeff-93e1cb3edac6 req-3a459785-b863-4ad3-8c3f-1db08834b24b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:24.474645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aadd261f-f7c7-4330-aeff-93e1cb3edac6 req-3a459785-b863-4ad3-8c3f-1db08834b24b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:24.491587 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aadd261f-f7c7-4330-aeff-93e1cb3edac6 req-3a459785-b863-4ad3-8c3f-1db08834b24b service nova] Creating event network-changed:e22ead95-2e78-40bd-88d2-f6a7cdfd27eb for instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 on nch1-master-1 Jul 30 21:55:24.496789 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aadd261f-f7c7-4330-aeff-93e1cb3edac6 req-3a459785-b863-4ad3-8c3f-1db08834b24b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043267 Jul 30 21:55:24.497410 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3243/6527] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:55:25.271531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:25.272120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:25.279222 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:25.279725 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:25.280515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:25.280971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:25.409684 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:25.417245 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-07bbd5ca-7991-4789-9c31-4fba0ebf207c tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.150071 Jul 30 21:55:25.417847 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3285/6528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:25 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:26.438717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:26.439484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:26.446757 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:26.447248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:26.448107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:26.448581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:26.580308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:26.587974 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ead77a9e-3aee-4deb-ac36-e2e28caadfee tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.153619 Jul 30 21:55:26.588556 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3244/6529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:26 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:27.609677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:27.610335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:27.617433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:27.617902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:27.618680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:27.619134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:27.746314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:27.753915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-080f3dd3-4dda-4b93-9a53-3f01702c2245 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.148707 Jul 30 21:55:27.754491 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3286/6530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:27 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:28.775229 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:28.776382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:28.783815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:28.784327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:28.785141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:28.785611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:28.921734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:28.929572 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddeb6313-d78b-4e3b-9e75-b9db74a92aae tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.158755 Jul 30 21:55:28.930158 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3245/6531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:28 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:29.950322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:29.951003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:29.958704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:29.959168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:29.960004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:29.960437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:30.091860 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:30.099555 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d49534e2-e796-43ef-b6df-dd057067c779 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.153149 Jul 30 21:55:30.100130 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3287/6532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:29 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:31.119542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:31.120189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:31.127734 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:31.128217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:31.129020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:31.129492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:31.264629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:31.274737 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac590912-63a5-49be-8eb1-1041e9fce106 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.159002 Jul 30 21:55:31.275608 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3246/6533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:31 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:31.300432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7560fc81-af77-44e2-ada2-80df4970558a req-39ad254f-8651-465b-9e27-54abb23d1021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2", "name": "network-vif-plugged", "status": "completed", "tag": "e22ead95-2e78-40bd-88d2-f6a7cdfd27eb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:31.313366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7560fc81-af77-44e2-ada2-80df4970558a req-39ad254f-8651-465b-9e27-54abb23d1021 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:31.313824 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7560fc81-af77-44e2-ada2-80df4970558a req-39ad254f-8651-465b-9e27-54abb23d1021 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:31.326151 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7560fc81-af77-44e2-ada2-80df4970558a req-39ad254f-8651-465b-9e27-54abb23d1021 service nova] Creating event network-vif-plugged:e22ead95-2e78-40bd-88d2-f6a7cdfd27eb for instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 on nch1-master-1 Jul 30 21:55:31.331913 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7560fc81-af77-44e2-ada2-80df4970558a req-39ad254f-8651-465b-9e27-54abb23d1021 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036211 Jul 30 21:55:31.332522 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3288/6534] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:55:32.296228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:32.296878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:32.300524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:32.301445 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:32.308548 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:32.309565 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:32.310553 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:32.311230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:32.445054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:32.453409 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d47c2d9-b904-417f-a393-88bb6bcd9dce tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1316 microversion: 2.1 time: 0.161084 Jul 30 21:55:32.454011 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3247/6535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:32 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:33.471080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:33.476287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:33.477040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:33.484387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.484859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.485644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.486131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.618149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:33.625692 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-909f55e7-e784-4294-bda2-9024b9e0b20e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1506 microversion: 2.1 time: 0.155735 Jul 30 21:55:33.626271 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3289/6536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:33 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:33.646043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:33.646577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:33.653916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.655052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.655958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.656444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.683056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:55:33.756957 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-303cb827-ebe5-4f94-be46-5486c78489c7 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 204 len: 0 microversion: 2.1 time: 0.115031 Jul 30 21:55:33.757641 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3248/6537] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:33 2022] DELETE /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 21:55:33.766664 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:33.767599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:33.773840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.774317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.775109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:33.775706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:33.908877 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:33.917518 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-45b493f3-3e71-4042-8152-d62417b5be56 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1512 microversion: 2.1 time: 0.155237 Jul 30 21:55:33.918111 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3290/6538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:33 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:34.939157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:34.939912 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:34.946861 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:34.947369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:34.948167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:34.948629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:35.179221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:35.187440 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-73acd1fe-d6c2-46b5-99ff-cec69787db76 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 200 len: 1512 microversion: 2.1 time: 0.253113 Jul 30 21:55:35.188027 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3249/6539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:34 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:35.522328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ccf5131c-1ae1-46ad-b4b8-13a2ef69815a req-ee1109e2-4779-4e3e-b511-0dcd565da971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2", "name": "network-vif-deleted", "tag": "e22ead95-2e78-40bd-88d2-f6a7cdfd27eb"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:35.535822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ccf5131c-1ae1-46ad-b4b8-13a2ef69815a req-ee1109e2-4779-4e3e-b511-0dcd565da971 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:35.536685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ccf5131c-1ae1-46ad-b4b8-13a2ef69815a req-ee1109e2-4779-4e3e-b511-0dcd565da971 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:35.550398 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ccf5131c-1ae1-46ad-b4b8-13a2ef69815a req-ee1109e2-4779-4e3e-b511-0dcd565da971 service nova] Creating event network-vif-deleted:e22ead95-2e78-40bd-88d2-f6a7cdfd27eb for instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 on nch1-master-1 Jul 30 21:55:35.556203 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ccf5131c-1ae1-46ad-b4b8-13a2ef69815a req-ee1109e2-4779-4e3e-b511-0dcd565da971 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038082 Jul 30 21:55:35.557027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3291/6540] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:55:36.208409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.208979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.216045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.216520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.217881 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.218343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.231708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 HTTP/1.1 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2'} Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.233360 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 404 to user: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0a1c2d10-f86a-4c87-b9b0-b5d8ac677351 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 404 len: 111 microversion: 2.1 time: 0.030521 Jul 30 21:55:36.238315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3250/6541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:36.244471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.245190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.251859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.252333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.253114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.253569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.382987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:36.391315 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06f6c825-fd33-44d1-97f3-e101eb7faf09 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.151141 Jul 30 21:55:36.391890 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3292/6542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:36.411629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:36.414045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.419589 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856/action HTTP/1.1 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 32 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: {"resize": {"flavorRef": "452"}} Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856', 'body': {'resize': {'flavorRef': '452'}}} Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:36.421187 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 404 to user: Instance 1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-77648477-90a4-45a0-9377-10def34c1adf tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "POST /compute/v2.1/servers/1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856/action" status: 404 len: 111 microversion: 2.1 time: 0.015064 Jul 30 21:55:36.426021 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3251/6543] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:55:36 2022] POST /compute/v2.1/servers/1d9ae4f7-85ec-4fe9-948c-87b9ee5cd856/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:36.430831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.431498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.438015 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.438477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.439242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.439716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.566640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:36.574347 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e7c33db6-8d17-4fc4-afb6-50cd15f48327 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.147198 Jul 30 21:55:36.574915 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3293/6544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 21:55:36.595160 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.595823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.602883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.603397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.604197 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.604664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.732561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:36.740102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aef0a5e7-7b32-4a74-bfbc-0cb2014a52ec tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.148803 Jul 30 21:55:36.740673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3252/6545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:36.760591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bb1fda27-fd5e-42f6-829c-b644b9f2bd29"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:36.762901 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.769990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.770396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.771166 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.771639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.799230 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:36.804235 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: request: POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action HTTP/1.1 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 65 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: {"resize": {"flavorRef": "bb1fda27-fd5e-42f6-829c-b644b9f2bd29"}} Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: exception: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '477b24ed-33d5-463c-a9dc-acaf75d2458e', 'body': {'resize': {'flavorRef': 'bb1fda27-fd5e-42f6-829c-b644b9f2bd29'}}} Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 21:55:36.806112 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 400 to user: Flavor bb1fda27-fd5e-42f6-829c-b644b9f2bd29 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bddbf62c-b730-4167-92b0-fbb6d1bc2cb8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action" status: 400 len: 107 microversion: 2.1 time: 0.050940 Jul 30 21:55:36.810512 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3294/6546] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:55:36 2022] POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:55:36.816717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.817357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.823529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.824008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.824795 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.825255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.958483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:36.966164 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0df5c1c9-5e14-4312-ae04-e4506f85bcf5 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.153737 Jul 30 21:55:36.966770 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3253/6547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:36.987366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:36.987997 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:36.994106 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.994562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:36.995537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:36.995984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.129075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:37.136603 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-85fd474b-2d16-4d32-bbfb-514b22cd697d tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.153093 Jul 30 21:55:37.137166 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3295/6548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:36 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:37.157060 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-615806cb-9654-4542-ab8b-ea195824b346 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-615806cb-9654-4542-ab8b-ea195824b346 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: request: POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action HTTP/1.1 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 29 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: {"resize": {"flavorRef": ""}} Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '477b24ed-33d5-463c-a9dc-acaf75d2458e', 'body': {'resize': {'flavorRef': ''}}} Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise error Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi '' Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.160707 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-615806cb-9654-4542-ab8b-ea195824b346 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-615806cb-9654-4542-ab8b-ea195824b346 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action" status: 400 len: 113 microversion: 2.1 time: 0.009591 Jul 30 21:55:37.165733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3254/6549] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:55:37 2022] POST /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 21:55:37.171109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:37.171766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:37.177902 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.178370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.179152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.179632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.309948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:37.317573 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2776c3d1-a404-4bbb-9474-aaaf61382264 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1506 microversion: 2.1 time: 0.151106 Jul 30 21:55:37.318148 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3296/6550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:37 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:37.342194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:37.342696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:37.350024 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.350498 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.351300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.351768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.365900 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 HTTP/1.1 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2'} Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:37.367512 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 404 to user: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22a6074b-e2b0-4fa9-8085-84f4bd387723 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 404 len: 111 microversion: 2.1 time: 0.032165 Jul 30 21:55:37.372337 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3255/6551] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:37 2022] DELETE /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:55:37.378493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:37.379638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:37.385958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.386421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.387187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.387666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.401277 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 HTTP/1.1 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2'} Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:37.402817 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 404 to user: Instance f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7963537c-bedc-4d9d-a155-c95ed7aea0f6 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2" status: 404 len: 111 microversion: 2.1 time: 0.030611 Jul 30 21:55:37.408715 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3297/6552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:37 2022] GET /compute/v2.1/servers/f2dab1a5-bc97-4e7c-a235-dc9e8aaea3e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 21:55:37.413479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:37.414039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:37.420823 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.421308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.422118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.422593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.440591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:37.448941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 21:55:37.525435 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d9227bfb-a9f1-4021-bfd7-aeae6f47328a tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "DELETE /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 204 len: 0 microversion: 2.1 time: 0.115600 Jul 30 21:55:37.526089 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3256/6553] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 21:55:37 2022] DELETE /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 21:55:37.535193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:37.535852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:37.542740 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.543203 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.544019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:37.544472 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:37.677985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:37.681571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=100 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:37.686921 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb1de0f4-b5a4-4a91-bb5d-21e458d319c8 tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1512 microversion: 2.1 time: 0.156041 Jul 30 21:55:37.687526 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3298/6554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:37 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:38.708437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:38.709173 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:38.716308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:38.717284 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:38.718084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:38.718555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:38.853189 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b0c5ad524b4f0b83b0c4fa2d2b618a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e4885eb9d54dccbc0a3589ba059b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:55:38.861765 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a0873a0e-28bc-4c07-99f0-4004467dd1ff tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 200 len: 1512 microversion: 2.1 time: 0.157644 Jul 30 21:55:38.862390 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3257/6555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:38 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:55:39.369070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-122cbee2-8b20-463d-82e3-904b90c91878 req-167d1e26-e780-44ad-b479-3c01a72d0fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b24ed-33d5-463c-a9dc-acaf75d2458e", "name": "network-vif-deleted", "tag": "e4aaa790-63ea-4331-a11c-df3e15995c4f"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:55:39.390416 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-122cbee2-8b20-463d-82e3-904b90c91878 req-167d1e26-e780-44ad-b479-3c01a72d0fc7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:39.390898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-122cbee2-8b20-463d-82e3-904b90c91878 req-167d1e26-e780-44ad-b479-3c01a72d0fc7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:39.403782 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-122cbee2-8b20-463d-82e3-904b90c91878 req-167d1e26-e780-44ad-b479-3c01a72d0fc7 service nova] Creating event network-vif-deleted:e4aaa790-63ea-4331-a11c-df3e15995c4f for instance 477b24ed-33d5-463c-a9dc-acaf75d2458e on nch2-master-1 Jul 30 21:55:39.408759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-122cbee2-8b20-463d-82e3-904b90c91878 req-167d1e26-e780-44ad-b479-3c01a72d0fc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043587 Jul 30 21:55:39.409502 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3299/6556] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:55:39.882081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:55:39.882809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] [instance: 477b24ed-33d5-463c-a9dc-acaf75d2458e] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:55:39.889202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:39.889766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:39.890473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:55:39.890935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:55:39.904734 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] HTTP exception thrown: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Request method failure captured: Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e HTTP/1.1 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5ai--eeHK2CZU9sscFYKQgUj742ynCajHxNXIo_F4X999l8TMlJD_OVvMtatBIXq_UQO-YOTHFfVZeRgCHH-6jwz6jLj23mABhHmL2vC2QAuGSYmZXWfwiGg0c5HXe5in5_zwytJ6jJlYiccDe8K_cD_zTavZciRq8REj5019oiZSIA Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7e4885eb9d54dccbc0a3589ba059b4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7e4885eb9d54dccbc0a3589ba059b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: f7e4885eb9d54dccbc0a3589ba059b4f Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1033868227 Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: c4b0c5ad524b4f0b83b0c4fa2d2b618a Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-ServersNegativeTestJSON-1033868227-project Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '477b24ed-33d5-463c-a9dc-acaf75d2458e'} Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 21:55:39.906431 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] Returning 404 to user: Instance 477b24ed-33d5-463c-a9dc-acaf75d2458e could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-54b82012-814d-4781-ac5e-41c550ff832e tempest-ServersNegativeTestJSON-1033868227 tempest-ServersNegativeTestJSON-1033868227-project] 10.222.0.17 "GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e" status: 404 len: 111 microversion: 2.1 time: 0.029954 Jul 30 21:55:39.910848 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3258/6557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:55:39 2022] GET /compute/v2.1/servers/477b24ed-33d5-463c-a9dc-acaf75d2458e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 21:56:23.043884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:23.044816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:23.050148 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a942ea8a-329c-46cc-9369-18ffc728459e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: .version_select at 0x7fbb4f991160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-307136481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOseKIA4DhglIayJF34dsYwZ200u/P7JZQcJVU37VwSyFL3mV0ewwebOMvM5x8e2nmEFwqDobKLoauRCiSBFEGmOyG5SqiDis662jnanEdsqOUhI44PEb9/bE4p05OfGZA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:23.071979 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a942ea8a-329c-46cc-9369-18ffc728459e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:56:23.077102 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a942ea8a-329c-46cc-9369-18ffc728459e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for user cdd6e3798b5c4086ba6c1ccf22cbbb17 and project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:56:23.103620 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a942ea8a-329c-46cc-9369-18ffc728459e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062100 Jul 30 21:56:23.104238 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3300/6558] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 21:56:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:56:23.157750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1005331837", "imageRef": "b816c2dd-7522-49f2-8dd0-efe191b666b5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-307136481", "networks": [{"uuid": "1b703ec5-23d1-43e0-a2ca-57c5ea6cca04"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:23.166688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:23.167465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:23.216748 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] validate_networks() for [('1b703ec5-23d1-43e0-a2ca-57c5ea6cca04', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 21:56:23.587182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 21:56:23.587662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 21:56:23.588161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 21:56:23.588593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 21:56:23.589030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 21:56:23.598940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:23.599449 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:23.600281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:23.600743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:23.618605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 21:56:23.624411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for user cdd6e3798b5c4086ba6c1ccf22cbbb17 and project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 21:56:23.636779 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 21:56:23.639644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b816c2dd-7522-49f2-8dd0-efe191b666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 21:56:23.684877 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9ddb891d-5958-407c-b0d9-0da3a17881ff tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532434 Jul 30 21:56:23.685726 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3259/6559] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 21:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 21:56:23.696178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-84ce8b29-7a8c-4280-84f4-d5ca4fbd9407 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:23.696926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-84ce8b29-7a8c-4280-84f4-d5ca4fbd9407 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:23.754132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-84ce8b29-7a8c-4280-84f4-d5ca4fbd9407 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:23.761386 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-84ce8b29-7a8c-4280-84f4-d5ca4fbd9407 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1258 microversion: 2.1 time: 0.069110 Jul 30 21:56:23.764082 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3301/6560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:23 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:24.784041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:24.784687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:24.791429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:24.791927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:24.792739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:24.793250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:24.857820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:24.866392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-30204976-b653-4eb3-99ac-a091c2b78bb8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1318 microversion: 2.1 time: 0.087554 Jul 30 21:56:24.867593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3260/6561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:24 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:25.887646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:25.888323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:25.896783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:25.897226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:25.898017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:25.898466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:26.055103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:26.063482 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a1eea834-31a2-4497-8c28-98d3584dcb54 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.179815 Jul 30 21:56:26.064325 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3302/6562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:25 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:27.085053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:27.085711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:27.093328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:27.094093 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:27.095061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:27.095570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:27.241132 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:27.249856 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4f2364a2-b59e-46fa-8501-04667d80b285 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.168752 Jul 30 21:56:27.250378 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3261/6563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:27 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:28.271483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:28.272352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:28.279816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:28.280287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:28.281083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:28.281538 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:28.431653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:28.440621 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90509894-0c7f-4c78-ac1a-ebc3cea4f13d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.174294 Jul 30 21:56:28.441346 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3303/6564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:28 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:29.462331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:29.463014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:29.471351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:29.471890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:29.472659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:29.473134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:29.648413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:29.656262 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7dfaa07c-fd8d-4453-9699-134a7d7dffe1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.197984 Jul 30 21:56:29.657046 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3262/6565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:29 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:30.676817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:30.677434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:30.684759 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:30.685236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:30.686002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:30.686449 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:30.826846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:30.835818 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5535a3cf-4656-4575-9c9d-6dab61ae185a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.162754 Jul 30 21:56:30.836995 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3304/6566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:30 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:31.857907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:31.858651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:31.865559 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:31.866035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:31.866820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:31.867277 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:32.025088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:32.041962 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-abf481bd-4437-4e5c-8a7f-49e020e7b027 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.182588 Jul 30 21:56:32.042930 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3263/6567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:31 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:33.064415 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:33.065077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:33.072893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:33.073357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:33.074167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:33.074630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:33.210778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:33.218474 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-af0626da-14b0-431e-be7b-cacdd101224a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.158261 Jul 30 21:56:33.219051 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3305/6568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:33 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:34.118591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b3d08800-7b17-43e4-9978-e51e71e9ad9c req-84ed4488-3f20-4c84-9257-9d0c7e7276de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:34.126589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:34.127448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:34.138566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3d08800-7b17-43e4-9978-e51e71e9ad9c req-84ed4488-3f20-4c84-9257-9d0c7e7276de service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:34.139056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b3d08800-7b17-43e4-9978-e51e71e9ad9c req-84ed4488-3f20-4c84-9257-9d0c7e7276de service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:34.153248 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b3d08800-7b17-43e4-9978-e51e71e9ad9c req-84ed4488-3f20-4c84-9257-9d0c7e7276de service nova] Creating event network-changed:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 21:56:34.158643 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b3d08800-7b17-43e4-9978-e51e71e9ad9c req-84ed4488-3f20-4c84-9257-9d0c7e7276de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045088 Jul 30 21:56:34.159993 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3264/6569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 21:56:34.239916 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:34.240586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:34.242514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:34.249094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:34.249565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:34.250365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:34.250819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:34.478260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:34.486464 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0b23ce59-fb67-470b-ba0f-69b194630077 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.250478 Jul 30 21:56:34.487130 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3306/6570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:34 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:35.506696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:35.507468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:35.514666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:35.515143 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:35.516007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:35.516473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:35.660851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:35.669338 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4413ead2-8472-4cdd-9403-664d1a19e851 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.166974 Jul 30 21:56:35.669924 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3265/6571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:35 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:36.689984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:36.690616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:36.697686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:36.698152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:36.698958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:36.699988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:36.837237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:36.844931 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a69589ff-31fb-4a43-b01b-22a128d93912 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.158813 Jul 30 21:56:36.845499 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3307/6572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:36 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:37.865602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:37.866295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:37.874400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:37.874929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:37.875773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:37.876248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:38.204814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:38.212390 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d9a5ca28-b828-45ad-88fb-d994b89549d1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.350906 Jul 30 21:56:38.212968 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3266/6573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:37 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:39.233962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:39.234738 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:39.241848 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:39.242312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:39.243093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:39.243571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:39.375858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:39.383380 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f94544a6-0670-42a0-b363-250b37f62ce1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.153951 Jul 30 21:56:39.383968 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3308/6574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:39 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:39.790303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-90a0313b-6e8c-4470-815b-cfdcd943e42f req-7d04af8c-6303-4edd-928d-73bc2d30991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "name": "network-vif-plugged", "status": "completed", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:39.800606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90a0313b-6e8c-4470-815b-cfdcd943e42f req-7d04af8c-6303-4edd-928d-73bc2d30991d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:39.801079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-90a0313b-6e8c-4470-815b-cfdcd943e42f req-7d04af8c-6303-4edd-928d-73bc2d30991d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:39.813792 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-90a0313b-6e8c-4470-815b-cfdcd943e42f req-7d04af8c-6303-4edd-928d-73bc2d30991d service nova] Creating event network-vif-plugged:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 21:56:39.818742 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-90a0313b-6e8c-4470-815b-cfdcd943e42f req-7d04af8c-6303-4edd-928d-73bc2d30991d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032572 Jul 30 21:56:39.819700 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3267/6575] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:56:40.405039 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:40.405671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:40.412688 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:40.413160 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:40.413944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:40.414404 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:40.622466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:40.629945 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0e6918bf-4ad2-4931-b410-c3cf70ec262a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1358 microversion: 2.1 time: 0.229365 Jul 30 21:56:40.630521 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3309/6576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:40 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:41.652052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:41.653226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:41.659683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.660171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:41.660974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.661448 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:41.789558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:41.797913 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-847dcb0c-e749-4436-a10b-7b6916c09514 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1548 microversion: 2.1 time: 0.151269 Jul 30 21:56:41.798489 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3268/6577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:41 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:41.817733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:41.818358 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:41.825161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.825625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:41.826399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.826847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:41.956927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:41.964511 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6fb2a210-7b47-4f8f-ab7f-55a20a1a2ead tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1548 microversion: 2.1 time: 0.150573 Jul 30 21:56:41.965089 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3310/6578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:41 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:41.986015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:41.990655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:41.991477 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Searching by: {'deleted': False, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd'} {{(pid=130983) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 21:56:41.997074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.997769 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:41.998361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:41.998820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:42.023085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.multi_cell_list [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 21:56:42.049597 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-67ac4ae5-c92d-4eb3-ada9-1bdac86253c7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067498 Jul 30 21:56:42.050170 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3269/6579] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 21:56:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:56:42.061354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:42.061989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:42.068119 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:42.068589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:42.069374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:42.069829 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:42.202048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:42.209563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8b362d42-fbc9-4ab9-b3d9-b368c03c5c46 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1548 microversion: 2.1 time: 0.152187 Jul 30 21:56:42.210133 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3311/6580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:42 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:43.745156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a544a4d-80a9-4e05-9364-dd5949ad2b66"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:43.747663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:43.754622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:43.755098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:43.755923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:43.756395 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:43.998501 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257248 Jul 30 21:56:43.999429 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3270/6581] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 21:56:43 2022] POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:56:48.588982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:48.589809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:48.597292 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:48.597762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:48.598549 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:48.599005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:48.730356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:48.739348 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8ad60790-5a40-457e-9ce9-ea6489fa112b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1594 microversion: 2.1 time: 0.154246 Jul 30 21:56:48.739923 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3312/6582] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:48 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:50.731525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3d2ba141-1431-40fd-9a1b-40d0dee91be5 req-6b8bc64e-c07c-4c21-9713-d798c89a66d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:50.741671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3d2ba141-1431-40fd-9a1b-40d0dee91be5 req-6b8bc64e-c07c-4c21-9713-d798c89a66d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:50.741887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3d2ba141-1431-40fd-9a1b-40d0dee91be5 req-6b8bc64e-c07c-4c21-9713-d798c89a66d6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:50.757619 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3d2ba141-1431-40fd-9a1b-40d0dee91be5 req-6b8bc64e-c07c-4c21-9713-d798c89a66d6 service nova] Creating event network-changed:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 21:56:50.763660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3d2ba141-1431-40fd-9a1b-40d0dee91be5 req-6b8bc64e-c07c-4c21-9713-d798c89a66d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Jul 30 21:56:50.764673 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3271/6583] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:56:51.875927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-517388996"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:51.877075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:51.885691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:51.887505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:51.889363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:51.890067 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:52.120081 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.network.security_group_api [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Adding security group 59d0bf72-a020-4fd9-bd69-c8e67907d6cd to port 1152d7f8-fe31-481a-91b1-cc51540d3eb6 Jul 30 21:56:52.486431 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7a2cb12a-8ccd-424d-af62-2928263789d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action" status: 202 len: 0 microversion: 2.1 time: 0.614784 Jul 30 21:56:52.490076 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3313/6584] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:56:51 2022] POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:56:52.495985 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:56:52.496725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:56:52.503041 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:52.509846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:52.510334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:52.511374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:52.511854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:52.675046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:56:52.683524 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3c8a62d-a509-4b09-9df0-7ccd3f1ddbad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1759 microversion: 2.1 time: 0.191746 Jul 30 21:56:52.684037 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3272/6585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:56:52 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:56:52.778202 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e9d74c01-aaac-4281-b2ae-a6823bd3f826 req-54647d41-5846-400e-bece-19dcbf00d117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:56:52.788190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e9d74c01-aaac-4281-b2ae-a6823bd3f826 req-54647d41-5846-400e-bece-19dcbf00d117 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:56:52.788687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e9d74c01-aaac-4281-b2ae-a6823bd3f826 req-54647d41-5846-400e-bece-19dcbf00d117 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:56:52.802695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e9d74c01-aaac-4281-b2ae-a6823bd3f826 req-54647d41-5846-400e-bece-19dcbf00d117 service nova] Creating event network-changed:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 21:56:52.807855 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e9d74c01-aaac-4281-b2ae-a6823bd3f826 req-54647d41-5846-400e-bece-19dcbf00d117 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033437 Jul 30 21:56:52.808467 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3314/6586] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 21:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 21:59:08.426379 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 21:59:08.427134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:08.428014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:08.432744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 21:59:08.435198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:59:08.444726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:08.445216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:08.446054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:08.446525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:08.521686 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a8abec56-1913-47fb-8053-6f701077be0e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action" status: 202 len: 0 microversion: 2.1 time: 0.097108 Jul 30 21:59:08.522362 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3273/6587] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 21:59:08 2022] POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 21:59:08.529230 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 30 21:59:08.530616 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 30 21:59:08.530988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:08.531814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=72 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:08.536546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:59:08.537287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:59:08.545129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:08.545627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:08.546414 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:08.546865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:08.942958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:59:08.950950 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa105951-17bb-4226-a0e7-d9d7ed087892 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1761 microversion: 2.1 time: 0.423968 Jul 30 21:59:08.951638 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3315/6588] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:59:08 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1761 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 21:59:09.973278 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 21:59:09.974017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 21:59:09.984088 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 55020. Jul 30 21:59:09.988397 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:09.988878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:09.989684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 21:59:09.990152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 21:59:10.256684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 21:59:10.264802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe33b691-34f1-4bc6-bc58-767ae66800df tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1759 microversion: 2.1 time: 0.296107 Jul 30 21:59:10.265376 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3274/6589] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 21:59:09 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1759 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:17.576789 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:00:17.577457 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:00:19.111248 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:00:19.111819 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:00:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:00:23.683707 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:23.684476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:23.689170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-517388996"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:23.689734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:23.700822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:23.701293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:23.702084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:23.703155 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:23.707107 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 55102. Jul 30 22:00:23.707868 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 55100. Jul 30 22:00:23.837047 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.network.security_group_api [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Removing security group 59d0bf72-a020-4fd9-bd69-c8e67907d6cd from port 1152d7f8-fe31-481a-91b1-cc51540d3eb6 Jul 30 22:00:24.470608 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7ed9a9f7-630a-40e1-ad05-f103aa31538c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action" status: 202 len: 0 microversion: 2.1 time: 0.789350 Jul 30 22:00:24.476227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3316/6590] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:00:23 2022] POST /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:00:24.544411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:24.545205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:24.615979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-908fd8fd-1d65-4003-bc57-31812fcc748b req-8f658705-cf74-429f-9e34-55ebb4cf8854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:24.630466 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-908fd8fd-1d65-4003-bc57-31812fcc748b req-8f658705-cf74-429f-9e34-55ebb4cf8854 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:24.631273 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-908fd8fd-1d65-4003-bc57-31812fcc748b req-8f658705-cf74-429f-9e34-55ebb4cf8854 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:24.647891 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-908fd8fd-1d65-4003-bc57-31812fcc748b req-8f658705-cf74-429f-9e34-55ebb4cf8854 service nova] Creating event network-changed:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 22:00:24.653642 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-908fd8fd-1d65-4003-bc57-31812fcc748b req-8f658705-cf74-429f-9e34-55ebb4cf8854 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115689 Jul 30 22:00:24.654449 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3275/6591] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:00:25.633335 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:25.633867 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:25.644265 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:25.644744 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:25.645552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:25.646110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:25.688773 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-095bc591-7936-4abc-ba6f-03db928de411 req-8ecaadda-9c64-4404-864a-d0f5672866e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:25.703107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-095bc591-7936-4abc-ba6f-03db928de411 req-8ecaadda-9c64-4404-864a-d0f5672866e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:25.703621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-095bc591-7936-4abc-ba6f-03db928de411 req-8ecaadda-9c64-4404-864a-d0f5672866e8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:25.715507 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-095bc591-7936-4abc-ba6f-03db928de411 req-8ecaadda-9c64-4404-864a-d0f5672866e8 service nova] Creating event network-changed:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 22:00:25.720787 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-095bc591-7936-4abc-ba6f-03db928de411 req-8ecaadda-9c64-4404-864a-d0f5672866e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090781 Jul 30 22:00:25.723635 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3276/6592] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:00:25.731742 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lazy-loading 'services' on Instance uuid 64d0953f-372c-4550-a280-44afcc6e0b89 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:00:25.808637 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-964595ae-9c07-4178-bb6a-79737afab63e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments/8a544a4d-80a9-4e05-9364-dd5949ad2b66" status: 202 len: 0 microversion: 2.1 time: 0.180069 Jul 30 22:00:25.809154 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3317/6593] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 22:00:25 2022] DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments/8a544a4d-80a9-4e05-9364-dd5949ad2b66 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:00:25.820928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:25.823234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:25.831232 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:25.832669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:25.833664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:25.834434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:25.877692 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9148e723-be21-447c-b205-7683b3480a48 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061067 Jul 30 22:00:25.878819 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3277/6594] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 22:00:25 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:00:26.892212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:26.894820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:26.902425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:26.902886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:26.903690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:26.904139 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:26.933186 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-94112b05-a60e-4ec5-92e6-878c6dafef35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045937 Jul 30 22:00:26.933747 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3318/6595] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 22:00:26 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 22:00:26.944274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:26.944807 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:26.951788 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:26.952276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:26.953589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:26.954061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:27.031975 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] HTTP exception thrown: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 is not attached to volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Request method failure captured: Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments/8a544a4d-80a9-4e05-9364-dd5949ad2b66 HTTP/1.1 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aj3SVwdgLlkY17O0xK4EUS1oUFXIrSD3UZ6hM5W5XoiEiqKFTU12uuW_qTkFC8X_gF7Hq3EHSzkmmCkEu6l25na6Vc_AbfaLk4x9-7cTuBUvq2-E1tDDGqnm8rmgiLiEAyK-ZHEJCuMfqVyx-uSqsCkh2ye8eBgY0alScqsgtP93TA Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a9d01d869a84e2486ef3918ff0dc1cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cdd6e3798b5c4086ba6c1ccf22cbbb17 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 is not attached to volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': '64d0953f-372c-4550-a280-44afcc6e0b89', 'id': '8a544a4d-80a9-4e05-9364-dd5949ad2b66'} Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8a544a4d-80a9-4e05-9364-dd5949ad2b66. Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 is not attached to volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66 Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:00:27.049253 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 is not attached to volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66 Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Returning 404 to user: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 is not attached to volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66 {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0fd5a50-f379-473a-88ab-82516a12d0d8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments/8a544a4d-80a9-4e05-9364-dd5949ad2b66" status: 404 len: 154 microversion: 2.1 time: 0.110562 Jul 30 22:00:27.054404 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3278/6596] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 22:00:26 2022] DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89/os-volume_attachments/8a544a4d-80a9-4e05-9364-dd5949ad2b66 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 22:00:28.199579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:28.200101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:28.207113 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:28.207614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:28.208402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:28.208858 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:28.233498 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:00:28.312623 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-877a25f4-8243-4d51-9a34-1eddc8460a2a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 204 len: 0 microversion: 2.1 time: 0.116454 Jul 30 22:00:28.313719 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3319/6597] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:00:28 2022] DELETE /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:00:28.321794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:28.322541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:28.329948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:28.330421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:28.331214 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:28.331696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:28.474438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:28.482182 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2bd6d785-f7a0-49c1-bb8d-f34bb9fe475c tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1554 microversion: 2.1 time: 0.164274 Jul 30 22:00:28.482756 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3279/6598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:28 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:29.503544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:29.504269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:29.511281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:29.511806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:29.512594 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:29.513051 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:29.648130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:29.656288 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d2f904c-64f1-45cd-8839-7f1940ba3661 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1554 microversion: 2.1 time: 0.156553 Jul 30 22:00:29.656863 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3320/6599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:29 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:30.468956 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-edca5889-ab41-44e0-b8e9-641446098fbb req-c9d5af11-5517-43b7-8339-1f827a6742cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d0953f-372c-4550-a280-44afcc6e0b89", "name": "network-vif-deleted", "tag": "1152d7f8-fe31-481a-91b1-cc51540d3eb6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:30.481335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-edca5889-ab41-44e0-b8e9-641446098fbb req-c9d5af11-5517-43b7-8339-1f827a6742cc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:30.482199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-edca5889-ab41-44e0-b8e9-641446098fbb req-c9d5af11-5517-43b7-8339-1f827a6742cc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:30.496499 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-edca5889-ab41-44e0-b8e9-641446098fbb req-c9d5af11-5517-43b7-8339-1f827a6742cc service nova] Creating event network-vif-deleted:1152d7f8-fe31-481a-91b1-cc51540d3eb6 for instance 64d0953f-372c-4550-a280-44afcc6e0b89 on nch2-master-1 Jul 30 22:00:30.506754 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-edca5889-ab41-44e0-b8e9-641446098fbb req-c9d5af11-5517-43b7-8339-1f827a6742cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041368 Jul 30 22:00:30.507628 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3280/6600] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:00:30.678109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:30.678741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:30.685732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:30.686199 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:30.687638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:30.688092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:30.718031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:30.718821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:30.719687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lazy-loading 'fault' on Instance uuid 64d0953f-372c-4550-a280-44afcc6e0b89 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:00:30.768136 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:30.776313 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d64827e1-e312-49ca-a7dd-bb6c0f69a5c4 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 200 len: 1348 microversion: 2.1 time: 0.102064 Jul 30 22:00:30.776896 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3321/6601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:30 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:31.799025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:31.799774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 64d0953f-372c-4550-a280-44afcc6e0b89] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:31.806235 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:31.806716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:31.807551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:31.808019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:31.821779 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] HTTP exception thrown: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Request method failure captured: Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 HTTP/1.1 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aj3SVwdgLlkY17O0xK4EUS1oUFXIrSD3UZ6hM5W5XoiEiqKFTU12uuW_qTkFC8X_gF7Hq3EHSzkmmCkEu6l25na6Vc_AbfaLk4x9-7cTuBUvq2-E1tDDGqnm8rmgiLiEAyK-ZHEJCuMfqVyx-uSqsCkh2ye8eBgY0alScqsgtP93TA Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a9d01d869a84e2486ef3918ff0dc1cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cdd6e3798b5c4086ba6c1ccf22cbbb17 Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '64d0953f-372c-4550-a280-44afcc6e0b89'} Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:00:31.823480 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Returning 404 to user: Instance 64d0953f-372c-4550-a280-44afcc6e0b89 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5048cbb7-1474-4662-b2c1-c7a8939c19a6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89" status: 404 len: 111 microversion: 2.1 time: 0.031072 Jul 30 22:00:31.828513 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3281/6602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:31 2022] GET /compute/v2.1/servers/64d0953f-372c-4550-a280-44afcc6e0b89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:00:31.834231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1ead8fb5-9685-4e6d-a416-7ba6024cb324 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '.version_select at 0x7fbb5c66b0d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:31.854131 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1ead8fb5-9685-4e6d-a416-7ba6024cb324 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-307136481" status: 202 len: 0 microversion: 2.1 time: 0.023639 Jul 30 22:00:31.854698 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3322/6603] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Jul 30 22:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-307136481 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:00:40.811829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1339f696-d537-4a29-922f-ea392dee561f tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: .version_select at 0x7fbb6289c9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2114924297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWfX5MoDUZSvdqQvBZU9TUzFgMdSEVWnUFgeTNtjmI94VrCdYfEUz2Jv4kI6kbRLRcGH6UHamjpXRsulj0v14IWF4AvfRvD5s+93S6qdGY5C9on6Ohvc+4jNABw+zG6Rg=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:40.833425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1339f696-d537-4a29-922f-ea392dee561f tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:00:40.838835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1339f696-d537-4a29-922f-ea392dee561f tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for user cdd6e3798b5c4086ba6c1ccf22cbbb17 and project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:00:40.865832 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1339f696-d537-4a29-922f-ea392dee561f tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059317 Jul 30 22:00:40.866462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3282/6604] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:00:40 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:00:40.917561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:40.921704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1809077522", "imageRef": "5e2ade99-b5fb-4654-bf6b-131343f83eed", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2114924297", "networks": [{"uuid": "1b703ec5-23d1-43e0-a2ca-57c5ea6cca04"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:40.973651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] validate_networks() for [('1b703ec5-23d1-43e0-a2ca-57c5ea6cca04', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:00:41.420565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:00:41.421004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:00:41.421490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:00:41.421908 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:00:41.422330 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:00:41.433588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:41.434048 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:41.434876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:41.435361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:41.456120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:00:41.461215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Getting quotas for user cdd6e3798b5c4086ba6c1ccf22cbbb17 and project 9a9d01d869a84e2486ef3918ff0dc1cd. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:00:41.473703 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:00:41.475930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2ade99-b5fb-4654-bf6b-131343f83eed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:00:41.522553 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cf483858-3f58-4451-bd5f-e3a964a8b364 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606873 Jul 30 22:00:41.523443 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3323/6605] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:00:41.533978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d9303635-5362-46f8-8d0c-09aa6b04ff73 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:41.534625 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d9303635-5362-46f8-8d0c-09aa6b04ff73 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:41.589101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d9303635-5362-46f8-8d0c-09aa6b04ff73 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:41.597168 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d9303635-5362-46f8-8d0c-09aa6b04ff73 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1259 microversion: 2.1 time: 0.067085 Jul 30 22:00:41.597745 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3283/6606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:41 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:42.617653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:42.619108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:42.627057 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:42.627571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:42.628366 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:42.629525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:42.708964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:42.717255 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-262ce4f4-73b6-40be-b6bd-ffa1813879f8 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1317 microversion: 2.1 time: 0.103791 Jul 30 22:00:42.718746 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3324/6607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:42 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1317 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:43.738665 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:43.739478 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:43.741576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=26 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:43.749383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:43.749964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:43.750981 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:43.751710 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:43.892896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:43.901534 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c423786c-fd90-48c3-a794-ba59ef7e9705 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.166978 Jul 30 22:00:43.902129 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3284/6608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:43 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:44.922894 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:44.923588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:44.931581 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:44.932418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:44.933576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:44.934308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:45.089733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:45.098364 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c07b2d3b-54d2-4e88-a2dc-21fc4500383e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.179802 Jul 30 22:00:45.098952 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3325/6609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:44 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:46.132632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:46.139819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:46.141814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:46.142304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:46.143113 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:46.143878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:46.295507 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:46.304302 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-befbfc06-6027-464e-b32e-7a36099bbd77 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.176081 Jul 30 22:00:46.305308 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3285/6610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:46 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:47.334765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:47.335607 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:47.344362 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:47.344827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:47.345623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:47.346085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:47.501620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:47.509643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0a293a28-660b-4542-9da3-5c88690bac87 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.179858 Jul 30 22:00:47.510172 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3326/6611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:47 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:48.533127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:48.533813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:48.540984 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:48.541476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:48.542300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:48.542775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:48.708579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:48.717756 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf1c855f-c197-4589-8a9c-567e7f94fa88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.189491 Jul 30 22:00:48.719160 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3286/6612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:48 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:49.739799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:49.740531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:49.748037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:49.748590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:49.749408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:49.749888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:50.232968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:50.240626 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ba2923bf-feb8-420c-a5d0-a609fd5bfd88 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.504952 Jul 30 22:00:50.241197 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3327/6613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:49 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:51.176286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aabf3bdc-c33b-4c14-b4e4-320de00c61d3 req-175df823-9ca3-453a-8d3a-cc9b905f4080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:51.189254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aabf3bdc-c33b-4c14-b4e4-320de00c61d3 req-175df823-9ca3-453a-8d3a-cc9b905f4080 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:51.189931 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aabf3bdc-c33b-4c14-b4e4-320de00c61d3 req-175df823-9ca3-453a-8d3a-cc9b905f4080 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:51.204432 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aabf3bdc-c33b-4c14-b4e4-320de00c61d3 req-175df823-9ca3-453a-8d3a-cc9b905f4080 service nova] Creating event network-changed:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:00:51.209352 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aabf3bdc-c33b-4c14-b4e4-320de00c61d3 req-175df823-9ca3-453a-8d3a-cc9b905f4080 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052324 Jul 30 22:00:51.210215 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3287/6614] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:00:51.261670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:51.262300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:51.269798 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:51.270272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:51.271069 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:51.271556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:51.399510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:51.407477 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-72746a8d-b75a-44a0-8054-cfeefbeadc94 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.149845 Jul 30 22:00:51.408042 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3328/6615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:51 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:52.425766 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:52.431089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:52.431862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:52.439181 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:52.439696 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:52.440509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:52.441003 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:52.573070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:52.580683 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f048b9db-f06f-4919-b385-dbf4de8dcf27 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.155880 Jul 30 22:00:52.581274 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3288/6616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:52 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:53.601019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:53.601721 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:53.603726 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:53.604406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:53.611918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:53.612393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:53.613187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:53.613645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:53.742152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:53.750368 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4593e74c-1e3e-4ee1-a8bb-b62cae1cede2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.152690 Jul 30 22:00:53.750956 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3329/6617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:53 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:54.772646 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:54.773292 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:54.776104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:54.781705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:54.782818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:54.783657 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:54.784133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:54.916589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:54.924258 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b22a1cda-f337-448d-9d8b-7bf6ed057142 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.155836 Jul 30 22:00:54.924842 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3289/6618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:54 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:55.945079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:55.945724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:55.948486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:55.954780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:55.955256 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:55.956080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:55.956544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:56.104097 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:56.111852 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5458e3da-89c2-4d28-b2a0-687ab61dc087 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.170679 Jul 30 22:00:56.112822 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3330/6619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:55 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:57.132434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:57.133072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:57.140088 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:57.140566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:57.141359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:57.141820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:57.275035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:57.284083 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-be57c1e9-1fe2-41f3-a8c5-b4509cba8a35 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.155535 Jul 30 22:00:57.285078 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3290/6620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:57 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:57.343820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0aafcff1-5206-4073-8ff9-8ad733228389 req-3124d069-143e-47bb-87f8-079e8d721040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "name": "network-vif-plugged", "status": "completed", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:00:57.353947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0aafcff1-5206-4073-8ff9-8ad733228389 req-3124d069-143e-47bb-87f8-079e8d721040 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:57.354412 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0aafcff1-5206-4073-8ff9-8ad733228389 req-3124d069-143e-47bb-87f8-079e8d721040 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:57.365904 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0aafcff1-5206-4073-8ff9-8ad733228389 req-3124d069-143e-47bb-87f8-079e8d721040 service nova] Creating event network-vif-plugged:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:00:57.370867 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0aafcff1-5206-4073-8ff9-8ad733228389 req-3124d069-143e-47bb-87f8-079e8d721040 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089939 Jul 30 22:00:57.371606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3331/6621] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:00:58.305334 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:58.306001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:58.313982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:58.314552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:58.315503 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:58.316043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:58.455564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:58.481675 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9814d04c-cb8a-432e-aa12-d0887a092079 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1359 microversion: 2.1 time: 0.163805 Jul 30 22:00:58.481675 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3291/6622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:58 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:59.490790 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:59.491548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:59.497876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.498377 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.499156 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.499643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.631580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:59.639499 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-481ac426-eab3-4ee4-b1d8-0afc243647e5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1548 microversion: 2.1 time: 0.153729 Jul 30 22:00:59.640093 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3332/6623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:59 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:59.660719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:59.661365 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:59.668381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.668867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.669672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.670146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.806855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:59.815143 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2dcd931e-e5a5-403a-81dc-33c3208834d9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1548 microversion: 2.1 time: 0.158307 Jul 30 22:00:59.815754 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3292/6624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:59 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:00:59.834598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:59.839279 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:00:59.840111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Searching by: {'deleted': False, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd'} {{(pid=130984) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 22:00:59.845582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.846056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.846885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.847376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.873511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.multi_cell_list [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 22:00:59.900664 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-715dfd1d-0402-46d7-9675-610df6b97970 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069865 Jul 30 22:00:59.901239 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3333/6625] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Jul 30 22:00:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:00:59.912349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:00:59.912997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:00:59.919142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.919668 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:00:59.920473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:00:59.920950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:00.061075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:00.068737 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3cfa9cae-b44e-40a6-b48d-c56a494e47d7 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1548 microversion: 2.1 time: 0.160250 Jul 30 22:01:00.069316 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3293/6626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:00:59 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:01:01.568886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12ae76c0-983e-45df-a358-65d6bb45a5ce"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:01:01.571219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:01.578162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:01.578624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:01.580059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:01.580505 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:01.816786 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a181cd8-1fd1-4e50-8406-a6b719085b11 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251650 Jul 30 22:01:01.817442 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3334/6627] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Jul 30 22:01:01 2022] POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:01:05.170572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:05.171219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:05.178811 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:05.179310 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:05.180126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:05.180596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:05.309904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:05.318058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6e5c4d7e-7a09-490c-b396-b8931647884e tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1594 microversion: 2.1 time: 0.151384 Jul 30 22:01:05.318639 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3294/6628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:05 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:07.249845 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-29d677ca-b327-4922-9a02-eaa29cda12ac req-c948a463-a79a-4636-a7c4-54a923e177a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:01:07.261164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-29d677ca-b327-4922-9a02-eaa29cda12ac req-c948a463-a79a-4636-a7c4-54a923e177a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:07.261164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-29d677ca-b327-4922-9a02-eaa29cda12ac req-c948a463-a79a-4636-a7c4-54a923e177a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:07.274408 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-29d677ca-b327-4922-9a02-eaa29cda12ac req-c948a463-a79a-4636-a7c4-54a923e177a7 service nova] Creating event network-changed:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:01:07.279898 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-29d677ca-b327-4922-9a02-eaa29cda12ac req-c948a463-a79a-4636-a7c4-54a923e177a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035042 Jul 30 22:01:07.280715 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3335/6629] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:01:08.355832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1770248227"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:01:08.357001 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:08.365164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:08.365635 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:08.366459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:08.366938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:08.510250 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.network.security_group_api [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Adding security group 1132087d-51dd-4d7b-86f6-519f25919523 to port b8e78d58-9888-4b5e-9102-61fc402cd771 Jul 30 22:01:08.844119 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-32bb2371-24d3-4c3d-a048-8e9be3eb6900 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action" status: 202 len: 0 microversion: 2.1 time: 0.492789 Jul 30 22:01:08.845979 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3295/6630] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:01:08 2022] POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:01:08.855220 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:08.855976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:08.862527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:08.863004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:08.863828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:08.864277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:09.019896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:09.028085 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f85b2950-e42b-4477-82ee-7818a7f98ce9 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1759 microversion: 2.1 time: 0.177936 Jul 30 22:01:09.028667 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3336/6631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:08 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:09.294997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1d66dc03-0811-42b7-8f97-775c4a4cf245 req-d9710ab9-d5a7-415a-9577-04ef0515358e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:01:09.305195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1d66dc03-0811-42b7-8f97-775c4a4cf245 req-d9710ab9-d5a7-415a-9577-04ef0515358e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:09.305672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1d66dc03-0811-42b7-8f97-775c4a4cf245 req-d9710ab9-d5a7-415a-9577-04ef0515358e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:09.317448 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1d66dc03-0811-42b7-8f97-775c4a4cf245 req-d9710ab9-d5a7-415a-9577-04ef0515358e service nova] Creating event network-changed:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:01:09.322585 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1d66dc03-0811-42b7-8f97-775c4a4cf245 req-d9710ab9-d5a7-415a-9577-04ef0515358e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Jul 30 22:01:09.323215 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3296/6632] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:01:34.426052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.427005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=13 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.427610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.477312 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:01:34.479734 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:34.488477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:34.488952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:34.489746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:34.490205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:34.562669 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-74870a05-8cbe-46a6-a3ba-48b6f72e4778 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action" status: 202 len: 0 microversion: 2.1 time: 0.141062 Jul 30 22:01:34.563320 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3337/6633] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:01:34 2022] POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:01:34.570258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=15 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.571036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=68 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:34.576177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:34.576927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:34.585932 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:34.586419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:34.587228 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:34.587729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:34.735645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:34.743826 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fedbfdb-458f-4182-8a06-c37e31e663cc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1751 microversion: 2.1 time: 0.175862 Jul 30 22:01:34.744412 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3297/6634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:34 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:35.766963 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:35.767714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:35.774333 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:35.774802 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:35.775621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:35.776084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:35.927782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:35.936192 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-dbd37b81-8f16-4042-a657-71d8cf8bdfa3 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.175083 Jul 30 22:01:35.936768 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3338/6635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:35 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:36.957642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:36.958198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:36.965237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:36.965726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:36.966529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:36.967022 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:37.109700 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:37.117898 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b45083c5-20df-44d1-90a5-f74f2acfc28b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.164353 Jul 30 22:01:37.118547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3298/6636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:36 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:38.142369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:38.142998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:38.150281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:38.150749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:38.151552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:38.152010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:38.294618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:38.304325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0aa4b38d-bb5c-431e-8e09-f1768dcc958a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.165872 Jul 30 22:01:38.304921 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3339/6637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:38 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:39.324570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:39.325275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:39.333091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:39.333580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:39.334383 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:39.334859 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:39.478924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:39.487650 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f16aa20e-ea05-41a2-a9a7-8e097d3afdad tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.167029 Jul 30 22:01:39.488232 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3299/6638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:39 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:40.508317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:40.508961 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:40.516500 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:40.516978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:40.517771 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:40.518238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:40.666081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:40.674701 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cba54937-a8c9-4fa4-a1fc-d0a86ad62a07 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.170182 Jul 30 22:01:40.675384 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3340/6639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:40 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:41.696415 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:41.697061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:41.704080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:41.704566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:41.705371 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:41.705845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:41.851650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:41.859880 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56068e07-513b-4da4-9537-9e32d7533148 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.167481 Jul 30 22:01:41.860462 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3300/6640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:41 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:42.880277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:42.880912 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:42.887897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:42.888372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:42.889152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:42.889606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:43.032731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:43.041009 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f543fb7-3d98-490d-a195-690072cf0db1 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.164692 Jul 30 22:01:43.041598 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3341/6641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:42 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:44.063115 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:44.063800 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:44.071030 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:44.071552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:44.072362 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:44.072835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:44.221656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:44.229803 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1ef58988-d91f-4988-b6f6-56cc2874d9d0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.171260 Jul 30 22:01:44.230396 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3301/6642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:44 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:45.251733 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:45.252297 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:45.259481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:45.259975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:45.260762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:45.261219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:45.410745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:45.419061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5f3032cf-245d-496d-962d-409fb6e907e6 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.172150 Jul 30 22:01:45.419681 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3342/6643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:45 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:46.443891 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:46.444558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:46.451943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:46.452911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:46.453707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:46.454166 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:46.598054 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:46.606164 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5e14146b-29b1-4363-83eb-14cdae0ef947 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.168872 Jul 30 22:01:46.606733 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3302/6644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:46 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:47.627026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:47.627677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:47.634667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:47.635137 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:47.635950 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:47.636407 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:47.779652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:47.788434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d088f6c5-4031-44a5-aee4-2813291f9a4d tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.165345 Jul 30 22:01:47.789022 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3343/6645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:47 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:48.809697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:48.810343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:48.817520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:48.818004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:48.818813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:48.819301 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:48.965608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:48.974400 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-de8ff6a1-43ac-4118-b0eb-a494a471c9d5 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.168681 Jul 30 22:01:48.974986 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3303/6646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:48 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:49.996527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:49.997239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:50.004881 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:50.005357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:50.006170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:50.006610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:50.157628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:50.165684 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8fb64f77-9988-49a9-a2b8-22d9f3418bab tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1756 microversion: 2.1 time: 0.173156 Jul 30 22:01:50.166276 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3344/6647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:49 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:51.187943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:01:51.188589 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:01:51.195724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:51.196210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:51.197037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:01:51.197506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:01:51.350131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:01:51.358378 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ef7b69dc-196c-43fe-8b2d-44ccb63cfdbf tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1759 microversion: 2.1 time: 0.174975 Jul 30 22:01:51.358956 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3304/6648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:01:51 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:01:58.681941 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:01:58.682642 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:02:23.676948 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1770248227"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:23.677586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:23.679673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:23.680573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:23.686120 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:23.686580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:23.687378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:23.688325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:23.816104 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.network.security_group_api [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Removing security group 1132087d-51dd-4d7b-86f6-519f25919523 from port b8e78d58-9888-4b5e-9102-61fc402cd771 Jul 30 22:02:24.123502 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-03c10e34-1df5-4014-b783-112d7e33176a tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action" status: 202 len: 0 microversion: 2.1 time: 0.450779 Jul 30 22:02:24.124236 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3345/6649] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:02:23 2022] POST /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 22:02:24.132169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f8e37842-21b6-45da-a028-d67cf1e288dc req-4c5cbacc-1a4e-41d7-ada2-6d2e359a42bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:24.141721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=16 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:24.143114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=48 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:24.145684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f8e37842-21b6-45da-a028-d67cf1e288dc req-4c5cbacc-1a4e-41d7-ada2-6d2e359a42bc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:24.146412 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f8e37842-21b6-45da-a028-d67cf1e288dc req-4c5cbacc-1a4e-41d7-ada2-6d2e359a42bc service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:24.160903 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f8e37842-21b6-45da-a028-d67cf1e288dc req-4c5cbacc-1a4e-41d7-ada2-6d2e359a42bc service nova] Creating event network-changed:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:02:24.166564 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f8e37842-21b6-45da-a028-d67cf1e288dc req-4c5cbacc-1a4e-41d7-ada2-6d2e359a42bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038096 Jul 30 22:02:24.167594 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3305/6650] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:25.196984 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:25.197623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:25.199282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1d279ac9-4652-417b-ab4f-17731a4a5ba5 req-63d1278d-7e37-4eb9-8d7c-cabc865d28e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:25.205052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:25.205646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:25.206534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:25.207210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:25.210107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1d279ac9-4652-417b-ab4f-17731a4a5ba5 req-63d1278d-7e37-4eb9-8d7c-cabc865d28e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:25.210581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1d279ac9-4652-417b-ab4f-17731a4a5ba5 req-63d1278d-7e37-4eb9-8d7c-cabc865d28e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:25.222831 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1d279ac9-4652-417b-ab4f-17731a4a5ba5 req-63d1278d-7e37-4eb9-8d7c-cabc865d28e1 service nova] Creating event network-changed:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:02:25.228149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1d279ac9-4652-417b-ab4f-17731a4a5ba5 req-63d1278d-7e37-4eb9-8d7c-cabc865d28e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Jul 30 22:02:25.228960 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3306/6651] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:25.300844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lazy-loading 'services' on Instance uuid 33819981-2549-4390-b63b-bbe88c301c1d {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:02:25.395406 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-17e41e20-3d10-4277-9ed9-add5d806a7bb tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments/12ae76c0-983e-45df-a358-65d6bb45a5ce" status: 202 len: 0 microversion: 2.1 time: 0.203490 Jul 30 22:02:25.399227 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3346/6652] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 22:02:25 2022] DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments/12ae76c0-983e-45df-a358-65d6bb45a5ce => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:02:25.409704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:25.412943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:25.420512 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:25.420996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:25.422039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:25.422669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:25.462091 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6acd0cea-4895-4cf4-9ee5-80b6f3efa371 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059984 Jul 30 22:02:25.462803 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3307/6653] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 22:02:25 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:26.477485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:26.479943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:26.486313 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:26.486786 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:26.487620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:26.488077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:26.517069 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7899bc47-603c-4551-8f42-63947a9bc731 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044756 Jul 30 22:02:26.517640 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3347/6654] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 30 22:02:26 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 22:02:26.528389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:26.528922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:26.536754 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:26.537242 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:26.538049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:26.538528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:26.612328 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] HTTP exception thrown: Instance 33819981-2549-4390-b63b-bbe88c301c1d is not attached to volume 12ae76c0-983e-45df-a358-65d6bb45a5ce Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Request method failure captured: Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: request: DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments/12ae76c0-983e-45df-a358-65d6bb45a5ce HTTP/1.1 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aj3SVwdgLlkY17O0xK4EUS1oUFXIrSD3UZ6hM5W5XoiEiqKFTU12uuW_qTkFC8X_gF7Hq3EHSzkmmCkEu6l25na6Vc_AbfaLk4x9-7cTuBUvq2-E1tDDGqnm8rmgiLiEAyK-ZHEJCuMfqVyx-uSqsCkh2ye8eBgY0alScqsgtP93TA Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a9d01d869a84e2486ef3918ff0dc1cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cdd6e3798b5c4086ba6c1ccf22cbbb17 Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 33819981-2549-4390-b63b-bbe88c301c1d is not attached to volume 12ae76c0-983e-45df-a358-65d6bb45a5ce Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'server_id': '33819981-2549-4390-b63b-bbe88c301c1d', 'id': '12ae76c0-983e-45df-a358-65d6bb45a5ce'} Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12ae76c0-983e-45df-a358-65d6bb45a5ce. Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33819981-2549-4390-b63b-bbe88c301c1d is not attached to volume 12ae76c0-983e-45df-a358-65d6bb45a5ce Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:02:26.613974 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33819981-2549-4390-b63b-bbe88c301c1d is not attached to volume 12ae76c0-983e-45df-a358-65d6bb45a5ce Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Returning 404 to user: Instance 33819981-2549-4390-b63b-bbe88c301c1d is not attached to volume 12ae76c0-983e-45df-a358-65d6bb45a5ce {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7460dc64-84ff-4b87-afab-9e1e3e5e97f2 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments/12ae76c0-983e-45df-a358-65d6bb45a5ce" status: 404 len: 154 microversion: 2.1 time: 0.091191 Jul 30 22:02:26.618417 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3308/6655] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Jul 30 22:02:26 2022] DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d/os-volume_attachments/12ae76c0-983e-45df-a358-65d6bb45a5ce => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:02:27.756431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:27.756949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:27.763958 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:27.764458 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:27.765241 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:27.766214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:27.791685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:02:27.865703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-00b3e3aa-82a4-49b2-9b67-52726e481070 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 204 len: 0 microversion: 2.1 time: 0.112865 Jul 30 22:02:27.866306 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3348/6656] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:02:27 2022] DELETE /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:02:27.876209 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:27.877000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:27.888009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:27.888499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:27.889308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:27.889785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:28.038145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:28.045932 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b10084b5-e788-4619-b4c3-ed957900a73b tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1554 microversion: 2.1 time: 0.175012 Jul 30 22:02:28.046511 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3309/6657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:27 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:29.066702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:29.067456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:29.075078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:29.075574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:29.076395 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:29.076850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:29.210468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:29.218097 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c9087ba-de8b-4501-b5b2-b6283b8e6510 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1554 microversion: 2.1 time: 0.155832 Jul 30 22:02:29.218671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3349/6658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:29 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:29.989154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-3541a7bc-89c8-44e0-a1d2-5b8bf1ec1d6f req-11d8ed43-1a96-435c-ae99-2902d30f86c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33819981-2549-4390-b63b-bbe88c301c1d", "name": "network-vif-deleted", "tag": "b8e78d58-9888-4b5e-9102-61fc402cd771"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:30.002822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3541a7bc-89c8-44e0-a1d2-5b8bf1ec1d6f req-11d8ed43-1a96-435c-ae99-2902d30f86c2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:30.003250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-3541a7bc-89c8-44e0-a1d2-5b8bf1ec1d6f req-11d8ed43-1a96-435c-ae99-2902d30f86c2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:30.016586 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-3541a7bc-89c8-44e0-a1d2-5b8bf1ec1d6f req-11d8ed43-1a96-435c-ae99-2902d30f86c2 service nova] Creating event network-vif-deleted:b8e78d58-9888-4b5e-9102-61fc402cd771 for instance 33819981-2549-4390-b63b-bbe88c301c1d on nch2-master-1 Jul 30 22:02:30.021813 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-3541a7bc-89c8-44e0-a1d2-5b8bf1ec1d6f req-11d8ed43-1a96-435c-ae99-2902d30f86c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Jul 30 22:02:30.022952 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3310/6659] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:30.239764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:30.240307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:30.247302 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:30.247791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:30.248584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:30.249044 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:30.289572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:30.290038 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:30.290510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lazy-loading 'fault' on Instance uuid 33819981-2549-4390-b63b-bbe88c301c1d {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:02:30.346250 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd6e3798b5c4086ba6c1ccf22cbbb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9d01d869a84e2486ef3918ff0dc1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:30.354563 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5481ae06-ec91-46ae-bebc-509f2c7682b0 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 200 len: 1349 microversion: 2.1 time: 0.118878 Jul 30 22:02:30.355321 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3350/6660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:30 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 1349 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:31.378732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:31.379487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] [instance: 33819981-2549-4390-b63b-bbe88c301c1d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:31.386874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:31.387459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:31.388266 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:31.388737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:31.402910 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] HTTP exception thrown: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Request method failure captured: Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d HTTP/1.1 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aj3SVwdgLlkY17O0xK4EUS1oUFXIrSD3UZ6hM5W5XoiEiqKFTU12uuW_qTkFC8X_gF7Hq3EHSzkmmCkEu6l25na6Vc_AbfaLk4x9-7cTuBUvq2-E1tDDGqnm8rmgiLiEAyK-ZHEJCuMfqVyx-uSqsCkh2ye8eBgY0alScqsgtP93TA Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a9d01d869a84e2486ef3918ff0dc1cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a9d01d869a84e2486ef3918ff0dc1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 9a9d01d869a84e2486ef3918ff0dc1cd Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2039972807 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: cdd6e3798b5c4086ba6c1ccf22cbbb17 Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestMinimumBasicScenario-2039972807-project Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '33819981-2549-4390-b63b-bbe88c301c1d'} Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:02:31.404740 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Returning 404 to user: Instance 33819981-2549-4390-b63b-bbe88c301c1d could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dd53de12-563b-47d7-8b9c-02090c097d16 tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d" status: 404 len: 111 microversion: 2.1 time: 0.032333 Jul 30 22:02:31.409265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3311/6661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:31 2022] GET /compute/v2.1/servers/33819981-2549-4390-b63b-bbe88c301c1d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:02:31.415004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e82422da-f91d-42d7-9265-8d27e98d0cfc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] Calling method '.version_select at 0x7fbb4f942b80>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:31.435137 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e82422da-f91d-42d7-9265-8d27e98d0cfc tempest-TestMinimumBasicScenario-2039972807 tempest-TestMinimumBasicScenario-2039972807-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114924297" status: 202 len: 0 microversion: 2.1 time: 0.023979 Jul 30 22:02:31.435806 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3351/6662] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Jul 30 22:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114924297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:02:40.794995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0d7b99cc-496d-4459-9c53-f3b70c95f753 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: .version_select at 0x7fbb5cec9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1729158602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHv8vr+IuBLw+lbEuhRrBPV6Mqf+Cie+q/+Z8rDi3CBfdUx+2fWBhHwUv3JAUTekXfaFTS3ZgIxHQoTzRaGOi/q/2tgNB1WxYdwUYG5iW5rUhqEBg4k8wKPwwRc5oazVg=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:40.811053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0d7b99cc-496d-4459-9c53-f3b70c95f753 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:02:40.816713 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-0d7b99cc-496d-4459-9c53-f3b70c95f753 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:02:40.840020 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0d7b99cc-496d-4459-9c53-f3b70c95f753 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.224486 Jul 30 22:02:40.840622 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3312/6663] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:02:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:46.693384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:46.694678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:46.701791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1874826689", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "4281ab3c-d99a-4ec6-bfb6-9a09b104d3c8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1729158602", "security_groups": [{"name": "tempest-secgroup-smoke-1884251681"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:46.898603 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] validate_networks() for [('4281ab3c-d99a-4ec6-bfb6-9a09b104d3c8', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:02:47.364035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:02:47.364571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:02:47.365144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:02:47.365716 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:02:47.366229 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:02:47.381473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:47.381993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:47.382975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:47.383709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:47.403942 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:02:47.411668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:02:47.428163 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:02:47.431484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:02:47.515974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5c756c6-0068-470e-b46f-bd7e14d02b57 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817189 Jul 30 22:02:47.516721 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3352/6664] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:02:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:02:47.525947 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=26 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:47.532967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-47e59acb-a193-4066-952f-87009166a347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:47.533770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-47e59acb-a193-4066-952f-87009166a347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:47.605281 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-47e59acb-a193-4066-952f-87009166a347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:47.615046 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-47e59acb-a193-4066-952f-87009166a347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1267 microversion: 2.1 time: 0.089846 Jul 30 22:02:47.616034 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3313/6665] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:47 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:48.638490 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:48.639135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:48.670288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:48.670765 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:48.671645 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:48.672109 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:48.744091 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:48.753839 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-31b04c99-0a69-4d3e-8476-a5e523d891e5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1319 microversion: 2.1 time: 0.119977 Jul 30 22:02:48.754567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3353/6666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:48 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:49.783542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:49.785180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:49.802171 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:49.802579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:49.803738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:49.804385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:50.040499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:50.048114 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0912cc74-7ddf-4cf6-84e7-8a0b995e3d52 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.271791 Jul 30 22:02:50.048692 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3314/6667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:49 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:50.804144 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7e53c538-fdeb-4d45-bf4e-0c8806526eff req-e44605b2-419e-40c2-8ed8-363cdd83e03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0294c3-f586-4891-af60-c5bfd4528da5", "tag": "d4a75cc1-9c8f-417f-b046-55de91c3b68b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:50.815561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7e53c538-fdeb-4d45-bf4e-0c8806526eff req-e44605b2-419e-40c2-8ed8-363cdd83e03c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:50.816028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7e53c538-fdeb-4d45-bf4e-0c8806526eff req-e44605b2-419e-40c2-8ed8-363cdd83e03c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:50.856469 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7e53c538-fdeb-4d45-bf4e-0c8806526eff req-e44605b2-419e-40c2-8ed8-363cdd83e03c service nova] Creating event network-changed:d4a75cc1-9c8f-417f-b046-55de91c3b68b for instance 0f0294c3-f586-4891-af60-c5bfd4528da5 on nch1-master-1 Jul 30 22:02:50.867094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7e53c538-fdeb-4d45-bf4e-0c8806526eff req-e44605b2-419e-40c2-8ed8-363cdd83e03c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067375 Jul 30 22:02:50.868262 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3354/6668] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:51.069090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:51.069735 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:51.076957 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:51.078096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:51.078760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:51.079236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:51.294191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:51.302135 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-05476fe9-930c-4e72-984a-5ff72ff8f42e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.237043 Jul 30 22:02:51.302987 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3315/6669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:51 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:52.324434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:52.325165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:52.332602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:52.333079 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:52.333885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:52.334344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:52.467559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:52.475740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b3d4f1e5-ce3c-416f-be1e-72e32b2bd1cb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.155477 Jul 30 22:02:52.481266 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3355/6670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:52 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:53.499227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:53.500450 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:53.507692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:53.508182 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:53.508999 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:53.509473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:53.647192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:53.655167 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09033c2d-27d7-4f8f-9171-5451a3c0f54e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.159986 Jul 30 22:02:53.656297 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3316/6671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:53 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:54.676253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:54.676893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:54.683435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:54.683913 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:54.684704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:54.685167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:54.822349 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:54.829930 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4b97fb14-aa4f-42b5-878b-c38f7da7c85b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.157715 Jul 30 22:02:54.830500 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3356/6672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:54 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:55.416053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-b341c2f8-ef34-4cdd-8ebd-9154896de48a req-b0b80563-00c2-469c-a57b-63f811e1bc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0294c3-f586-4891-af60-c5bfd4528da5", "name": "network-vif-plugged", "status": "completed", "tag": "d4a75cc1-9c8f-417f-b046-55de91c3b68b"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:55.422933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:55.429312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b341c2f8-ef34-4cdd-8ebd-9154896de48a req-b0b80563-00c2-469c-a57b-63f811e1bc17 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:55.429979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-b341c2f8-ef34-4cdd-8ebd-9154896de48a req-b0b80563-00c2-469c-a57b-63f811e1bc17 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:55.441943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-b341c2f8-ef34-4cdd-8ebd-9154896de48a req-b0b80563-00c2-469c-a57b-63f811e1bc17 service nova] Creating event network-vif-plugged:d4a75cc1-9c8f-417f-b046-55de91c3b68b for instance 0f0294c3-f586-4891-af60-c5bfd4528da5 on nch1-master-1 Jul 30 22:02:55.447162 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-b341c2f8-ef34-4cdd-8ebd-9154896de48a req-b0b80563-00c2-469c-a57b-63f811e1bc17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Jul 30 22:02:55.447810 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3317/6673] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:55.850388 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:55.851017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:55.857983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:55.858448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:55.859226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:55.859704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:55.989318 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:55.997122 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fdef12bb-3c12-4bfb-b804-6433b2bdfa4e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1393 microversion: 2.1 time: 0.150604 Jul 30 22:02:55.998130 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3357/6674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:55 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:57.019621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:57.020396 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:57.026764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:57.027251 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:57.028077 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:57.028555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:57.171664 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:57.179334 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3154e843-3b7d-4376-bfac-ebbd07cd5fc6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1565 microversion: 2.1 time: 0.165650 Jul 30 22:02:57.179926 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3318/6675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:57 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:57.199728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:57.200370 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:57.207931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:57.208413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:57.209210 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:57.209673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:57.342081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:57.350800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8a112aa8-abd5-4035-a892-829ac3d095a9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1565 microversion: 2.1 time: 0.155030 Jul 30 22:02:57.351536 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3358/6676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:57 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:02:58.988497 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:02:58.989321 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:02:59.008305 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-09092143-5bd6-4193-9a5c-3d04b46bb94d req-6c534d1d-617b-4cd1-9c84-8884c9bceceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0294c3-f586-4891-af60-c5bfd4528da5", "tag": "d4a75cc1-9c8f-417f-b046-55de91c3b68b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:02:59.025162 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:59.029608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:59.029796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:59.030942 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:59.032135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:59.033437 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:59.034992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:59.043375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09092143-5bd6-4193-9a5c-3d04b46bb94d req-6c534d1d-617b-4cd1-9c84-8884c9bceceb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:02:59.044025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09092143-5bd6-4193-9a5c-3d04b46bb94d req-6c534d1d-617b-4cd1-9c84-8884c9bceceb service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:02:59.076863 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-09092143-5bd6-4193-9a5c-3d04b46bb94d req-6c534d1d-617b-4cd1-9c84-8884c9bceceb service nova] Creating event network-changed:d4a75cc1-9c8f-417f-b046-55de91c3b68b for instance 0f0294c3-f586-4891-af60-c5bfd4528da5 on nch1-master-1 Jul 30 22:02:59.084915 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-09092143-5bd6-4193-9a5c-3d04b46bb94d req-6c534d1d-617b-4cd1-9c84-8884c9bceceb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101458 Jul 30 22:02:59.086415 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3359/6677] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:02:59.256007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:02:59.265069 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7414688a-8ba5-4083-9519-baf52ac2246f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1565 microversion: 2.1 time: 0.288983 Jul 30 22:02:59.265664 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3319/6678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:02:58 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1565 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:03:20.508010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:20.508839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=36 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:20.514033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:20.516382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:20.524609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:20.525264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:20.526059 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:20.526527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:20.577680 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51500140-b46f-403a-ae11-10f85af3fa5c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action" status: 200 len: 24572 microversion: 2.1 time: 0.071265 Jul 30 22:03:20.578326 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3360/6679] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:03:20 2022] POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:03:31.604369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:31.604982 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:31.607328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=5 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:31.608146 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:31.614709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:31.615196 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:31.616031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:31.616506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:31.684101 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ee2639f8-1e94-4abc-b02e-baeb0e604a45 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action" status: 202 len: 0 microversion: 2.1 time: 0.083593 Jul 30 22:03:31.684921 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3320/6680] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:03:31 2022] POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:03:31.694610 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:31.695376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:31.698240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:31.698992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:31.709249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:31.710438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:31.711637 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:31.712105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:31.852450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:31.860367 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-39db6e8a-2dc9-402b-8951-e18e67dbdcc4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1689 microversion: 2.1 time: 0.170351 Jul 30 22:03:31.860886 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3361/6681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:31 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:32.885016 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:32.885753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:32.892247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:32.892762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:32.893855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:32.894330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:33.028575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:33.037108 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2996967e-ed68-4075-9643-cb52b0a1a042 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1669 microversion: 2.1 time: 0.157227 Jul 30 22:03:33.037683 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3321/6682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:32 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:34.131621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:34.133803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:34.140886 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.141364 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.142158 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.142623 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.192755 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f2dde42e-ac04-407e-ad32-8aec47ecd48d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action" status: 200 len: 32641 microversion: 2.1 time: 0.065060 Jul 30 22:03:34.193671 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3362/6683] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:03:34 2022] POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action => generated 32641 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:03:34.206023 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:34.206663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:34.216801 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.217867 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.218730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.219218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.285665 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4501f5c-bf96-4e8b-8e2c-4012d239d227 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action" status: 202 len: 0 microversion: 2.1 time: 0.083720 Jul 30 22:03:34.286335 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3322/6684] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:03:34 2022] POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:03:34.295839 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:34.296562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:34.305010 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.306606 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.308460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:34.309274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:34.449114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:34.457032 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e5d00d3-f773-4eeb-aa8e-340da7278788 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1676 microversion: 2.1 time: 0.166053 Jul 30 22:03:34.457626 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3363/6685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:34 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:35.479541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:35.480276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:35.486836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:35.487350 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:35.488156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:35.488652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:35.623980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:35.631674 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c164d98e-f5d3-47ee-8883-1f1a10426388 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1684 microversion: 2.1 time: 0.157317 Jul 30 22:03:35.632255 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3323/6686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:35 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:35.726560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:35.728843 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:35.736700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:35.737174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:35.737962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:35.738420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:35.786895 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-18f1bbd6-ac7b-4e8d-9052-5711dabeee17 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action" status: 200 len: 38423 microversion: 2.1 time: 0.064194 Jul 30 22:03:35.787811 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3364/6687] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:03:35 2022] POST /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5/action => generated 38423 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:03:36.762556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:36.763071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:36.766559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-82523bf4-4cd7-437d-a607-3c33c990155c req-59be1b21-90f8-4707-9205-533f69ef59bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0294c3-f586-4891-af60-c5bfd4528da5", "tag": "d4a75cc1-9c8f-417f-b046-55de91c3b68b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:36.771572 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:36.772056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:36.772860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:36.773418 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:36.781094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-82523bf4-4cd7-437d-a607-3c33c990155c req-59be1b21-90f8-4707-9205-533f69ef59bd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:36.781651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-82523bf4-4cd7-437d-a607-3c33c990155c req-59be1b21-90f8-4707-9205-533f69ef59bd service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:36.794409 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-82523bf4-4cd7-437d-a607-3c33c990155c req-59be1b21-90f8-4707-9205-533f69ef59bd service nova] Creating event network-changed:d4a75cc1-9c8f-417f-b046-55de91c3b68b for instance 0f0294c3-f586-4891-af60-c5bfd4528da5 on nch1-master-1 Jul 30 22:03:36.800078 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-82523bf4-4cd7-437d-a607-3c33c990155c req-59be1b21-90f8-4707-9205-533f69ef59bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038468 Jul 30 22:03:36.801330 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3365/6688] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:03:36.803020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:03:36.903424 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bebe5869-65ae-4eec-9c46-7cd5005806f8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 204 len: 0 microversion: 2.1 time: 0.144538 Jul 30 22:03:36.904895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3324/6689] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:03:36 2022] DELETE /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 22:03:36.915128 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:36.915906 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:36.923237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:36.923760 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:36.924536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:36.924990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:37.065175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:37.073106 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d16c9039-335e-43dd-b03b-ac6a93822880 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1690 microversion: 2.1 time: 0.163312 Jul 30 22:03:37.073690 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3366/6690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:36 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:38.096387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:38.097125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:38.104303 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:38.104836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:38.105617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:38.106081 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:38.285786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:38.293493 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d6016e46-752e-4867-a084-95fccec29b11 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 200 len: 1690 microversion: 2.1 time: 0.202083 Jul 30 22:03:38.300537 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3325/6691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:38 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:38.855539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7357f376-8416-4fe4-90bb-97912d4dcec1 req-b06c0703-2aa9-4be8-afcf-28e04368e4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0294c3-f586-4891-af60-c5bfd4528da5", "name": "network-vif-deleted", "tag": "d4a75cc1-9c8f-417f-b046-55de91c3b68b"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:38.867493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7357f376-8416-4fe4-90bb-97912d4dcec1 req-b06c0703-2aa9-4be8-afcf-28e04368e4c7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:38.867965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7357f376-8416-4fe4-90bb-97912d4dcec1 req-b06c0703-2aa9-4be8-afcf-28e04368e4c7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:38.881171 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7357f376-8416-4fe4-90bb-97912d4dcec1 req-b06c0703-2aa9-4be8-afcf-28e04368e4c7 service nova] Creating event network-vif-deleted:d4a75cc1-9c8f-417f-b046-55de91c3b68b for instance 0f0294c3-f586-4891-af60-c5bfd4528da5 on nch1-master-1 Jul 30 22:03:38.886281 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7357f376-8416-4fe4-90bb-97912d4dcec1 req-b06c0703-2aa9-4be8-afcf-28e04368e4c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Jul 30 22:03:38.886885 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3367/6692] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:03:39.316725 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:39.317377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 0f0294c3-f586-4891-af60-c5bfd4528da5] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:39.324849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:39.325335 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:39.326523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:39.326994 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:39.340857 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] HTTP exception thrown: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Request method failure captured: Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 HTTP/1.1 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aqAjxpRDMzILrwQxccs6C-ZzDazvIwiUGz1A41XloMiJAws9JiQDj6CCsnA7oi6NGSI4c25ONck_H85rNQvWJvK1mto-SqpRdtvEaIB8QI38CbNQVQ7cs2CPhjf-fgMgskxRktfEIw_CuixiYjzhTDmGM78aSBSC1lQFXQ2WRfjUDY Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd23983804f14a2c83c88db64491820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd23983804f14a2c83c88db64491820c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ec9fa31beca14813baa00869e5e7952a Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '0f0294c3-f586-4891-af60-c5bfd4528da5'} Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:03:39.343061 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Returning 404 to user: Instance 0f0294c3-f586-4891-af60-c5bfd4528da5 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f25bf049-e3bf-4830-8e55-6c0852d79844 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5" status: 404 len: 111 microversion: 2.1 time: 0.032018 Jul 30 22:03:39.347760 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3326/6693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:39 2022] GET /compute/v2.1/servers/0f0294c3-f586-4891-af60-c5bfd4528da5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:03:42.649141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1cbc14e7-ca88-4089-9bec-df741dcb2681 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '.version_select at 0x7fbb4fdb5700>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:42.673223 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1cbc14e7-ca88-4089-9bec-df741dcb2681 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1729158602" status: 202 len: 0 microversion: 2.1 time: 0.030590 Jul 30 22:03:42.673919 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3368/6694] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 22:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1729158602 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:03:42.699252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9cba5999-5c76-4df3-a345-f7e2dd65dde3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: .version_select at 0x7fbb4fd3f4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2048063316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP65e478B+YybEFMr7es6q2Kvr0VEIbyPDOr7o2Cm4YzIHB5p4KGfZNMmpTdueDeZhmfVjrF+WxzhtSK6Y4kY/UJtjXuskTZrHYvpXOqLOa6umhj0mLIS9/6ayljE2aPUQ=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:42.717312 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-9cba5999-5c76-4df3-a345-f7e2dd65dde3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:03:42.723078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-9cba5999-5c76-4df3-a345-f7e2dd65dde3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:03:42.747479 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9cba5999-5c76-4df3-a345-f7e2dd65dde3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052149 Jul 30 22:03:42.753564 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3327/6695] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:03:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:03:48.258739 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2067993787", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "2912b345-331b-4f63-b4e3-8837c6a4298f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2048063316", "security_groups": [{"name": "tempest-secgroup-smoke-1533016423"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:48.385518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] validate_networks() for [('2912b345-331b-4f63-b4e3-8837c6a4298f', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:03:48.824457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:03:48.825084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:03:48.825745 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:03:48.826300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:03:48.827692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:03:48.848152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:48.848445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:48.849480 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:48.850188 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:48.880278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:03:48.886274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:03:48.905174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:03:48.912372 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:03:48.964424 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a9a6c824-b441-4456-9ddd-1100478c705c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710542 Jul 30 22:03:48.965388 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3369/6696] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:03:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:03:48.978037 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22fa01a8-178d-471e-a211-50f874ac5b97 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:48.978792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-22fa01a8-178d-471e-a211-50f874ac5b97 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:49.093099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-22fa01a8-178d-471e-a211-50f874ac5b97 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:49.102474 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22fa01a8-178d-471e-a211-50f874ac5b97 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1267 microversion: 2.1 time: 0.129245 Jul 30 22:03:49.103558 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3328/6697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:48 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:50.126931 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:50.129310 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:50.140670 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:50.141596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:50.144418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:50.144613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:50.223989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:50.232275 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c4138f2-d8bd-499b-be48-b1b94619dfac tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1337 microversion: 2.1 time: 0.109504 Jul 30 22:03:50.236169 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3370/6698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:50 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:51.254105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:51.254644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:51.256694 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:51.265552 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:51.266514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:51.267561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:51.268188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:51.460105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:51.469330 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a94d5190-97e5-47a3-aef5-e1b66671edc8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1393 microversion: 2.1 time: 0.219094 Jul 30 22:03:51.470197 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3329/6699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:51 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:52.061627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2b24f597-16f2-4d26-a8b3-9c06ae43a237 req-3b3ee9d3-0179-47a6-9d76-e7cba2d3fc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99950647-d24a-4e15-8133-527517e5a93d", "tag": "0f951ee7-1cbc-40c2-b66d-033848b26c0c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:52.073108 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2b24f597-16f2-4d26-a8b3-9c06ae43a237 req-3b3ee9d3-0179-47a6-9d76-e7cba2d3fc18 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:52.073574 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2b24f597-16f2-4d26-a8b3-9c06ae43a237 req-3b3ee9d3-0179-47a6-9d76-e7cba2d3fc18 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:52.085783 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2b24f597-16f2-4d26-a8b3-9c06ae43a237 req-3b3ee9d3-0179-47a6-9d76-e7cba2d3fc18 service nova] Creating event network-changed:0f951ee7-1cbc-40c2-b66d-033848b26c0c for instance 99950647-d24a-4e15-8133-527517e5a93d on nch2-master-1 Jul 30 22:03:52.090866 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2b24f597-16f2-4d26-a8b3-9c06ae43a237 req-3b3ee9d3-0179-47a6-9d76-e7cba2d3fc18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Jul 30 22:03:52.091690 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3371/6700] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:03:52.491462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:52.492104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:52.499618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:52.500101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:52.500905 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:52.501377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:52.646442 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:52.654204 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-21516873-05df-401d-976c-161666bf2a48 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1393 microversion: 2.1 time: 0.166718 Jul 30 22:03:52.654958 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3330/6701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:52 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:53.676592 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:53.677403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:53.684029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:53.684493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:53.685278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:53.686436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:53.919977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:53.927942 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-144a47cd-a481-4dfd-bdb1-407baf8b036f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1393 microversion: 2.1 time: 0.256720 Jul 30 22:03:53.928842 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3372/6702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:53 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1393 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:03:54.949137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:54.949805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:54.956908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:54.957382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:54.958169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:54.958629 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:55.104200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:55.112382 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-244f6b61-5873-4fdd-be43-f0f465c4b907 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1393 microversion: 2.1 time: 0.167182 Jul 30 22:03:55.112960 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3331/6703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:54 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:56.016722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2c93c57e-dee6-43e5-9512-984fe9367b21 req-d6622f69-a252-42a8-9f8a-b58101592df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99950647-d24a-4e15-8133-527517e5a93d", "name": "network-vif-plugged", "status": "completed", "tag": "0f951ee7-1cbc-40c2-b66d-033848b26c0c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:56.028114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2c93c57e-dee6-43e5-9512-984fe9367b21 req-d6622f69-a252-42a8-9f8a-b58101592df7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:56.028575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2c93c57e-dee6-43e5-9512-984fe9367b21 req-d6622f69-a252-42a8-9f8a-b58101592df7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:56.042537 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2c93c57e-dee6-43e5-9512-984fe9367b21 req-d6622f69-a252-42a8-9f8a-b58101592df7 service nova] Creating event network-vif-plugged:0f951ee7-1cbc-40c2-b66d-033848b26c0c for instance 99950647-d24a-4e15-8133-527517e5a93d on nch2-master-1 Jul 30 22:03:56.059574 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2c93c57e-dee6-43e5-9512-984fe9367b21 req-d6622f69-a252-42a8-9f8a-b58101592df7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052206 Jul 30 22:03:56.060188 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3373/6704] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:03:56.132974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:56.133631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:56.141486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:56.141976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:56.142810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:56.143272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:56.277655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:56.288434 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9e6055f8-22f0-4a89-a777-b6546b59d91f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1393 microversion: 2.1 time: 0.157642 Jul 30 22:03:56.289042 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3332/6705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:56 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:57.315397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:57.316037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:57.323023 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:57.323536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:57.324527 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:57.324994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:57.459869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:57.468468 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9c463a94-e09d-4168-b6e2-f133518eb422 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1566 microversion: 2.1 time: 0.159657 Jul 30 22:03:57.468894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3374/6706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:57 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:57.487997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:57.488642 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:57.495711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:57.496195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:57.496998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:57.497469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:57.632874 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:57.641114 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-97b971a0-cc84-45b7-a40b-07274a480b4d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1566 microversion: 2.1 time: 0.156972 Jul 30 22:03:57.641695 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3333/6707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:57 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:03:59.230046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-ebd5f40e-6e4c-46be-8075-01e8d073f219 req-874d6d66-564d-4d96-83bc-5f41aa86ffd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99950647-d24a-4e15-8133-527517e5a93d", "tag": "0f951ee7-1cbc-40c2-b66d-033848b26c0c"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:03:59.231622 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:03:59.232770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:03:59.242354 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:59.243056 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:59.245178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:59.245892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:59.247176 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:59.248754 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:59.255740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:59.258327 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ebd5f40e-6e4c-46be-8075-01e8d073f219 req-874d6d66-564d-4d96-83bc-5f41aa86ffd6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:03:59.258816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-ebd5f40e-6e4c-46be-8075-01e8d073f219 req-874d6d66-564d-4d96-83bc-5f41aa86ffd6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:03:59.277470 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-ebd5f40e-6e4c-46be-8075-01e8d073f219 req-874d6d66-564d-4d96-83bc-5f41aa86ffd6 service nova] Creating event network-changed:0f951ee7-1cbc-40c2-b66d-033848b26c0c for instance 99950647-d24a-4e15-8133-527517e5a93d on nch2-master-1 Jul 30 22:03:59.288509 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-ebd5f40e-6e4c-46be-8075-01e8d073f219 req-874d6d66-564d-4d96-83bc-5f41aa86ffd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061962 Jul 30 22:03:59.289741 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3334/6708] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:03:59.491519 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:03:59.507851 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-90d6c621-a4a9-4f81-8b06-1eda9840d56f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1566 microversion: 2.1 time: 0.283846 Jul 30 22:03:59.508468 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3375/6709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:03:59 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:22.829300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:04:22.831683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:22.833907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:22.834600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:22.841767 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:22.842248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:22.843050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:22.844188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:22.896075 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-48cbb0ff-3af7-450d-91da-66077d99b6d6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action" status: 200 len: 24560 microversion: 2.1 time: 0.071819 Jul 30 22:04:22.896954 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3335/6710] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:04:22 2022] POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action => generated 24560 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:04:33.980586 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:04:33.982896 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:33.985072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:33.985856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=60 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:33.992758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:33.993236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:33.994046 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:33.994548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:34.068669 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-79b0bf70-a5b4-4eff-9603-603475c0a9b7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action" status: 202 len: 0 microversion: 2.1 time: 0.092081 Jul 30 22:04:34.069717 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3376/6711] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:04:33 2022] POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:04:34.078970 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:34.079770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:34.083426 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:34.084330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:34.091908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:34.092400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:34.093218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:34.093692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:34.389797 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:34.398457 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-75103f73-71b6-4333-a5d8-f977aaff6379 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1677 microversion: 2.1 time: 0.324064 Jul 30 22:04:34.399046 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3336/6712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:34 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1677 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:04:35.420435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:35.421164 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:35.428518 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:35.428993 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:35.429791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:35.430259 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:35.611019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:35.618731 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-738a9226-5e97-43fd-8dea-96830c01d6bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.202648 Jul 30 22:04:35.619333 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3377/6713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:35 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:36.641429 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:36.642085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:36.651243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:36.651753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:36.652567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:36.653045 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:36.782647 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:36.791133 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ee77b34-69d5-4046-a055-9c0160034a51 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.153825 Jul 30 22:04:36.791745 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3337/6714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:36 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:37.812225 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:37.812863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:37.820081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:37.820560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:37.821357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:37.821820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:37.952342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:37.960159 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6417e114-c6be-434b-a2cd-98644bc9ab2a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.151910 Jul 30 22:04:37.960741 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3378/6715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:37 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:38.982031 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:38.982676 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:38.989860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:38.990351 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:38.991169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:38.991666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:39.136519 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:39.145039 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0950f13c-a8bc-444b-a849-d84fc19b7d33 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.166411 Jul 30 22:04:39.145628 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3338/6716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:38 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:40.166219 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:40.166885 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:40.173917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:40.174386 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:40.175173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:40.175660 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:40.309551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:40.318695 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e79c93a7-068b-4ff0-8b7a-b35d54656cee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.156463 Jul 30 22:04:40.319309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3379/6717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:40 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:41.340409 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:41.341543 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:41.348658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:41.349161 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:41.349960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:41.350419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:41.487017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:41.495486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4cc3128e-afd8-41e7-ae0a-4b54b042d3c1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.159994 Jul 30 22:04:41.496071 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3339/6718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:41 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:42.516596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:42.517239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:42.524537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:42.525017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:42.525819 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:42.526286 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:42.658273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:42.666472 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef141512-fa00-464c-a209-650380487fd0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.153966 Jul 30 22:04:42.667042 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3380/6719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:42 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:43.687494 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:43.688165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:43.695857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:43.696343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:43.697142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:43.697612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:43.831778 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:43.839664 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31423b5c-3a56-4977-ad8e-1a03ac2a8bb6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.156120 Jul 30 22:04:43.840245 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3340/6720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:43 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:44.860782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:44.861432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:44.868972 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:44.869437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:44.870214 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:44.870671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:45.009389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:45.017025 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-56434dd8-2cd0-4502-9f11-10e4a8fba35d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.160204 Jul 30 22:04:45.017596 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3381/6721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:44 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:46.038304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:46.038943 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:46.046099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:46.046578 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:46.047388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:46.047855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:46.178571 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:46.186433 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f61d8c67-ea56-4837-9c7a-30b4767ef93f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.151872 Jul 30 22:04:46.187054 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3341/6722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:46 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:47.208930 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:47.209665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:47.216692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:47.217170 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:47.217976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:47.218434 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:47.351992 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:47.359702 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cd06653b-ea39-4457-9456-0ce1ae6b662e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.155290 Jul 30 22:04:47.360301 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3382/6723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:47 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:48.381149 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:48.381824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:48.388870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:48.389363 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:48.390165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:48.390640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:48.524369 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:48.532015 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2b173ea7-7a50-48f0-be92-d5ba2ad24f58 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.154827 Jul 30 22:04:48.532593 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3342/6724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:48 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:49.554272 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:49.554951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:49.562336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:49.562821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:49.563671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:49.564141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:49.698484 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:49.706158 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22087239-0438-4ffc-8c5f-2ac4208f9592 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1682 microversion: 2.1 time: 0.156254 Jul 30 22:04:49.706792 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3383/6725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:49 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:04:50.729127 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:04:50.731180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:04:50.741059 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:50.741540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:50.742347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:04:50.743014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:04:50.875936 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:04:50.884019 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-89ab4a19-ab7b-48e5-bd41-aa36a3a60b38 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1685 microversion: 2.1 time: 0.158979 Jul 30 22:04:50.884587 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3343/6726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:04:50 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:17.074442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:17.076789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:17.079017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:17.079875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:17.085943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:17.086425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:17.087917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:17.088399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:17.145558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-64f227a5-c650-480f-8fd5-58f3d610fd5e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action" status: 200 len: 69095 microversion: 2.1 time: 0.075742 Jul 30 22:05:17.146261 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3384/6727] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:05:17 2022] POST /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d/action => generated 69095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:05:18.690818 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:05:18.691432 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:05:24.708626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:24.709250 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:24.711514 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=16 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:24.713018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=48 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:24.720724 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:24.721213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:24.722015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:24.722476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:24.751656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:05:24.780029 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-219b63fc-5f4f-43e3-8418-edd5b7b5d84a req-dc6582d9-032b-4c3e-8f46-14b0e4a27ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99950647-d24a-4e15-8133-527517e5a93d", "tag": "0f951ee7-1cbc-40c2-b66d-033848b26c0c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:24.792096 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-219b63fc-5f4f-43e3-8418-edd5b7b5d84a req-dc6582d9-032b-4c3e-8f46-14b0e4a27ce2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:24.792672 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-219b63fc-5f4f-43e3-8418-edd5b7b5d84a req-dc6582d9-032b-4c3e-8f46-14b0e4a27ce2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:24.804494 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-219b63fc-5f4f-43e3-8418-edd5b7b5d84a req-dc6582d9-032b-4c3e-8f46-14b0e4a27ce2 service nova] Creating event network-changed:0f951ee7-1cbc-40c2-b66d-033848b26c0c for instance 99950647-d24a-4e15-8133-527517e5a93d on nch2-master-1 Jul 30 22:05:24.810750 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-219b63fc-5f4f-43e3-8418-edd5b7b5d84a req-dc6582d9-032b-4c3e-8f46-14b0e4a27ce2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103619 Jul 30 22:05:24.811783 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3385/6728] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:05:24.841707 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ea84308d-76d3-4ef3-ac47-4c91986e88ec tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 204 len: 0 microversion: 2.1 time: 0.137032 Jul 30 22:05:24.845601 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3344/6729] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:05:24 2022] DELETE /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:05:24.853588 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:24.854311 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:24.861808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:24.862287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:24.863103 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:24.863614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:25.003466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:25.011936 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-22bb40db-3981-42fe-b1ea-d39c5be8a410 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1691 microversion: 2.1 time: 0.163141 Jul 30 22:05:25.012528 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3386/6730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:24 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:26.034043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:26.034772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:26.042632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:26.043125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:26.044062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:26.044538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:26.232998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:26.240743 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cad183a-59cb-487b-b140-b16579480d98 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1691 microversion: 2.1 time: 0.211043 Jul 30 22:05:26.241295 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3345/6731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:26 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:26.922410 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-383a9175-4320-4c33-8648-1499b320d4dc req-634da72f-202d-4e62-ace3-9ab1810777d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99950647-d24a-4e15-8133-527517e5a93d", "name": "network-vif-deleted", "tag": "0f951ee7-1cbc-40c2-b66d-033848b26c0c"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:26.933524 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-383a9175-4320-4c33-8648-1499b320d4dc req-634da72f-202d-4e62-ace3-9ab1810777d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:26.934025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-383a9175-4320-4c33-8648-1499b320d4dc req-634da72f-202d-4e62-ace3-9ab1810777d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:26.946305 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-383a9175-4320-4c33-8648-1499b320d4dc req-634da72f-202d-4e62-ace3-9ab1810777d1 service nova] Creating event network-vif-deleted:0f951ee7-1cbc-40c2-b66d-033848b26c0c for instance 99950647-d24a-4e15-8133-527517e5a93d on nch2-master-1 Jul 30 22:05:26.951225 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-383a9175-4320-4c33-8648-1499b320d4dc req-634da72f-202d-4e62-ace3-9ab1810777d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092720 Jul 30 22:05:26.951890 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3387/6732] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:05:27.262218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:27.263014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:27.270810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:27.271411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:27.272523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:27.273329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:27.309887 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:27.310479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:27.311043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lazy-loading 'fault' on Instance uuid 99950647-d24a-4e15-8133-527517e5a93d {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:05:27.360765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:27.367908 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-56865551-13de-4272-affd-35bb7a101ed5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 200 len: 1357 microversion: 2.1 time: 0.109882 Jul 30 22:05:27.370742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3346/6733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:27 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:28.392209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:28.392938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 99950647-d24a-4e15-8133-527517e5a93d] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:28.399585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:28.401666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:28.402926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:28.403704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:28.422333 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] HTTP exception thrown: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Request method failure captured: Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d HTTP/1.1 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aqAjxpRDMzILrwQxccs6C-ZzDazvIwiUGz1A41XloMiJAws9JiQDj6CCsnA7oi6NGSI4c25ONck_H85rNQvWJvK1mto-SqpRdtvEaIB8QI38CbNQVQ7cs2CPhjf-fgMgskxRktfEIw_CuixiYjzhTDmGM78aSBSC1lQFXQ2WRfjUDY Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd23983804f14a2c83c88db64491820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd23983804f14a2c83c88db64491820c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: ec9fa31beca14813baa00869e5e7952a Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '99950647-d24a-4e15-8133-527517e5a93d'} Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:05:28.424072 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Returning 404 to user: Instance 99950647-d24a-4e15-8133-527517e5a93d could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fab736ed-7f3e-45ee-bf33-2f42236f7757 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d" status: 404 len: 111 microversion: 2.1 time: 0.038636 Jul 30 22:05:28.429061 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3388/6734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:28 2022] GET /compute/v2.1/servers/99950647-d24a-4e15-8133-527517e5a93d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 22:05:31.429991 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-22d5812b-9a1e-4fef-b03b-35e3ecefde85 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '.version_select at 0x7fbb4fd149d0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:31.450941 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-22d5812b-9a1e-4fef-b03b-35e3ecefde85 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2048063316" status: 202 len: 0 microversion: 2.1 time: 0.024889 Jul 30 22:05:31.451731 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3347/6735] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 22:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2048063316 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:05:31.474204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9a9fd0d3-3dad-4cc4-aee4-d0b6a5633347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: .version_select at 0x7fbb4fda7af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1028533157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBakCwMuKa+aq3D9k0E18hqHHmFlB+9dWWa4a+P/HF7brCVFkIrCi1s86WSvqUIu1I1PhzeGybnHN47qP7QAD7I2x+beOL4J+27gm1tdSEQ2YjYIjXspXpdeihwCPAMw=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:31.497001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9a9fd0d3-3dad-4cc4-aee4-d0b6a5633347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:05:31.502274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9a9fd0d3-3dad-4cc4-aee4-d0b6a5633347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:05:31.526356 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9a9fd0d3-3dad-4cc4-aee4-d0b6a5633347 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056244 Jul 30 22:05:31.526924 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3389/6736] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:05:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:05:37.449562 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:37.454256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1611217021", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "908e38d8-5bf1-4bc9-ba80-89810ea92047"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1028533157", "security_groups": [{"name": "tempest-secgroup-smoke-2066818881"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:37.584169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] validate_networks() for [('908e38d8-5bf1-4bc9-ba80-89810ea92047', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:05:38.091595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:05:38.092043 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:05:38.092577 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:05:38.093013 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:05:38.093469 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:05:38.104521 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:38.105357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:38.106470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:38.107554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:38.137177 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:05:38.145210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:05:38.160866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:05:38.163328 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:05:38.229568 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74bde1a6-294a-45ce-ad79-539eb200ae7b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781693 Jul 30 22:05:38.230934 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3348/6737] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:05:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:05:38.242675 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7868773-d5fd-4a13-87ac-a60d115a69aa tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:38.243929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7868773-d5fd-4a13-87ac-a60d115a69aa tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:38.335384 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7868773-d5fd-4a13-87ac-a60d115a69aa tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:38.348107 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7868773-d5fd-4a13-87ac-a60d115a69aa tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1267 microversion: 2.1 time: 0.110302 Jul 30 22:05:38.348925 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3390/6738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:38 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:39.370816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:39.371721 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:39.378304 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:39.379002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:39.379836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:39.380472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:39.450425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:39.459045 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc5957d8-0753-4bcf-8e2f-32182110bf05 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1325 microversion: 2.1 time: 0.093600 Jul 30 22:05:39.460069 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3349/6739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:39 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1325 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:40.481855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:40.482343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:40.484647 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=16 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:40.495047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:40.495587 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:40.496409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:40.496883 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:40.708801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:40.718700 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a8680f6d-aabb-4041-ab3e-ffdbd33a4597 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.241647 Jul 30 22:05:40.719398 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3391/6740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:40 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:40.781084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-63cb947d-7b27-4f26-9c8c-176acf7487e1 req-40c8845f-de2a-468f-9d38-20605213a86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:40.794846 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-63cb947d-7b27-4f26-9c8c-176acf7487e1 req-40c8845f-de2a-468f-9d38-20605213a86c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:40.795346 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-63cb947d-7b27-4f26-9c8c-176acf7487e1 req-40c8845f-de2a-468f-9d38-20605213a86c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:40.806808 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-63cb947d-7b27-4f26-9c8c-176acf7487e1 req-40c8845f-de2a-468f-9d38-20605213a86c service nova] Creating event network-changed:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch1-master-1 Jul 30 22:05:40.811786 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-63cb947d-7b27-4f26-9c8c-176acf7487e1 req-40c8845f-de2a-468f-9d38-20605213a86c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034483 Jul 30 22:05:40.812395 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3350/6741] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:05:41.740130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:41.740763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:41.747994 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:41.748468 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:41.749257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:41.749711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:41.886864 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:41.894767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ac770f15-2b27-4732-ac54-6e45bce331d0 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.158594 Jul 30 22:05:41.895369 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3392/6742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:41 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:05:42.918364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:42.919174 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:42.925927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:42.926416 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:42.927236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:42.927733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:43.070422 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:43.078187 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-04765271-5054-4a01-a0a6-1f52696cb721 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.165738 Jul 30 22:05:43.078769 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3351/6743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:42 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:44.098445 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:44.099150 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:44.106180 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:44.106654 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:44.107486 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:44.107947 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:44.247617 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:44.255800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89e4be24-2ef1-4c94-9df7-1e5722752cbb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.161274 Jul 30 22:05:44.270443 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3393/6744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:44 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:45.278822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:45.279407 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:45.286357 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:45.286839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:45.287655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:45.288121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:45.422374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:45.430043 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3fd5e236-a3ac-4ecb-8f2b-63ff157275fd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.155639 Jul 30 22:05:45.430789 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3352/6745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:45 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:46.232559 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-09478630-10ec-41c0-a07d-cd441e92eb0f req-1db94fc8-61de-41e0-9ec5-59afa3a8c12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "name": "network-vif-plugged", "status": "completed", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:46.245974 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09478630-10ec-41c0-a07d-cd441e92eb0f req-1db94fc8-61de-41e0-9ec5-59afa3a8c12e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:46.246632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-09478630-10ec-41c0-a07d-cd441e92eb0f req-1db94fc8-61de-41e0-9ec5-59afa3a8c12e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:46.258521 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-09478630-10ec-41c0-a07d-cd441e92eb0f req-1db94fc8-61de-41e0-9ec5-59afa3a8c12e service nova] Creating event network-vif-plugged:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch1-master-1 Jul 30 22:05:46.263692 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-09478630-10ec-41c0-a07d-cd441e92eb0f req-1db94fc8-61de-41e0-9ec5-59afa3a8c12e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Jul 30 22:05:46.264309 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3394/6746] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:05:46.451090 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:46.451764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:46.458727 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:46.459205 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:46.460036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:46.460502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:46.598775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:46.606624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0bc7d099-b44e-4c27-ac73-c636559ecddf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1393 microversion: 2.1 time: 0.159406 Jul 30 22:05:46.607202 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3353/6747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:46 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:05:47.628794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:47.629546 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:47.631548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:47.637422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:47.637893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:47.638681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:47.639140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:47.775186 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:47.782896 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-586f1d4a-4e77-442e-b69e-0b60eb4cd425 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1565 microversion: 2.1 time: 0.159357 Jul 30 22:05:47.783506 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3395/6748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:47 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:47.803939 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:47.804620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:47.811960 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:47.812444 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:47.813247 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:47.813720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:47.954995 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:47.963221 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7502770e-159e-4151-8427-942851fde584 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1565 microversion: 2.1 time: 0.163768 Jul 30 22:05:47.964049 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3354/6749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:47 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:05:49.551985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:05:49.552631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:05:49.560319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9ff2922e-0386-4847-8f52-d2fff182db79 req-55c1fb24-9a91-4d33-a458-17753e12fbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:05:49.565403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:49.566241 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:49.566988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:49.572217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:49.572699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:49.573571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:49.574034 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:49.586308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9ff2922e-0386-4847-8f52-d2fff182db79 req-55c1fb24-9a91-4d33-a458-17753e12fbc2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:05:49.587308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9ff2922e-0386-4847-8f52-d2fff182db79 req-55c1fb24-9a91-4d33-a458-17753e12fbc2 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:05:49.598906 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9ff2922e-0386-4847-8f52-d2fff182db79 req-55c1fb24-9a91-4d33-a458-17753e12fbc2 service nova] Creating event network-changed:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch1-master-1 Jul 30 22:05:49.605637 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9ff2922e-0386-4847-8f52-d2fff182db79 req-55c1fb24-9a91-4d33-a458-17753e12fbc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048772 Jul 30 22:05:49.606944 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3355/6750] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:05:49.802329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:05:49.811357 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0658dba2-7808-4c10-812f-62d621b81912 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1565 microversion: 2.1 time: 0.263257 Jul 30 22:05:49.812198 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3396/6751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:05:49 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:11.066217 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:11.067050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=36 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:11.071443 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:11.074326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:11.082364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:11.082848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:11.083671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:11.084141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:11.138738 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9c29a848-b481-4167-8965-6820c87a3416 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action" status: 200 len: 24568 microversion: 2.1 time: 0.074216 Jul 30 22:06:11.139318 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3356/6752] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:06:11 2022] POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:06:22.158402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:22.160769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:22.163131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:22.163998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=32 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:22.170757 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:22.171236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:22.172066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:22.172530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:22.289334 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:22.296025 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Old instance type m1.heat2, new instance type m1.heat {{(pid=130984) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 30 22:06:22.302556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:06:22.303002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:06:22.303529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:06:22.303964 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:06:22.304398 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:06:22.367760 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [d6cabaa2-0cf1-4d5c-928f-1e0904775204] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:06:23.375144 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [d6cabaa2-0cf1-4d5c-928f-1e0904775204] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 56386. Jul 30 22:06:23.378329 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4f27f1f1-8bc7-4240-8c76-cee7f087ff29 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action" status: 202 len: 0 microversion: 2.1 time: 1.224055 Jul 30 22:06:23.378959 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3397/6753] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:06:22 2022] POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:06:23.387649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:23.388460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:23.391621 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=4 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:23.392440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:23.399544 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:23.400618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:23.401485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:23.401950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:23.576978 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:23.585443 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ac6c221a-65cc-4f99-8389-d2379e052412 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1692 microversion: 2.1 time: 0.202024 Jul 30 22:06:23.586035 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3357/6754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:23 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:06:24.611990 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:24.612628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:24.620599 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:24.621078 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:24.621872 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:24.622336 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:24.760278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:24.769142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89bd5dac-4df2-4e4e-aec9-e2365c606d20 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1692 microversion: 2.1 time: 0.161865 Jul 30 22:06:24.769736 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3398/6755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:24 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:25.790131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:25.790770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:25.801894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:25.802375 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:25.803167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:25.803654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:25.932826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:25.940461 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f3e049d0-57aa-4342-825e-b2cf3582d91e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.154365 Jul 30 22:06:25.941045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3358/6756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:25 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:26.962073 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:26.962712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:26.970304 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:26.970782 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:26.971717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:26.972206 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:27.105690 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:27.113845 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-996e2cc3-31f7-42a7-a818-a686709f3c4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.155736 Jul 30 22:06:27.114429 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3399/6757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:26 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:06:28.134851 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:28.135513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:28.142612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:28.143087 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:28.144163 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:28.144624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:28.281894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:28.289693 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-74d3a2d0-135a-4800-9ddc-877233837a37 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.158799 Jul 30 22:06:28.290282 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3359/6758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:28 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:29.311758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:29.312396 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:29.320083 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:29.320611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:29.321400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:29.321977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:29.459496 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:29.467800 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3bde349d-b8ed-4aee-86b7-65217914d080 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.160123 Jul 30 22:06:29.468367 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3400/6759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:29 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:30.488785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:30.489399 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:30.497084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:30.497557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:30.498347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:30.498812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:30.631243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:30.640496 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-34f1867d-38f3-4903-9b6e-0db149312fae tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.154279 Jul 30 22:06:30.640496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3360/6760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:30 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:31.665387 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:31.665938 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:31.673575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:31.674049 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:31.674865 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:31.675347 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:31.806380 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:31.814142 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-63b5dbd0-2896-4d14-94fa-62a881ef70f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.152798 Jul 30 22:06:31.814727 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3401/6761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:31 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:32.835226 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:32.835894 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:32.842998 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:32.843525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:32.844329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:32.844794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:32.980763 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:32.988377 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-914b7b15-af32-4024-ac8b-b1565b5e63f1 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.157064 Jul 30 22:06:32.988955 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3361/6762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:32 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:34.012245 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:34.013231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:34.022140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:34.022616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:34.023467 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:34.023933 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:34.158447 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:34.166837 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30f16276-fa00-4f39-83d1-d21b3be2f65d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.161010 Jul 30 22:06:34.167460 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3402/6763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:34 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:35.188295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:35.188878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:35.196257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:35.196750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:35.198046 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:35.198523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:35.330564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:35.338265 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0ae8d8d7-63ee-456f-afb1-fc780058a731 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.153974 Jul 30 22:06:35.338836 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3362/6764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:35 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:36.360167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:36.360795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:36.368088 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:36.368557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:36.369403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:36.369911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:36.505223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:36.513545 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bb80a2fa-bcd3-48e1-b6bb-084f3bef9a4f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1697 microversion: 2.1 time: 0.157393 Jul 30 22:06:36.514120 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3403/6765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:36 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:37.535683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:37.536318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:37.544108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:37.544582 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:37.545446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:37.545908 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:37.681200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:37.689366 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bf82fce5-dc16-4c0d-af4b-b58fb66ced14 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1696 microversion: 2.1 time: 0.157964 Jul 30 22:06:37.690067 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3363/6766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:37 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:06:37.956692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "name": "network-vif-unplugged", "status": "completed", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:37.968236 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:37.968699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:37.981066 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] Creating event network-vif-unplugged:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch2-master-1 Jul 30 22:06:37.986572 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] Instance 05070fc7-382c-4913-87f0-8a320ee2b05f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 22:06:38.002314 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0ba06997-472b-4bbc-9b88-1b3654146582 req-0f7f1281-d896-4d2c-8d89-4cc6e2c403d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049399 Jul 30 22:06:38.003042 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3404/6767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:06:38.710212 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:38.710910 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:38.719435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:38.719918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:38.720739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:38.721213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:38.864433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:38.872324 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1f9ed148-6e4c-49fe-a0cd-8d5ae4e96872 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1696 microversion: 2.1 time: 0.166087 Jul 30 22:06:38.872919 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3364/6768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:38 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:39.895926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:39.896653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:39.903565 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:39.904040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:39.904831 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:39.905299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:40.040078 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:40.047956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:40.050790 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:40.051272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:40.055826 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f471d6de-1d9b-41ef-9db0-ac8df3558807 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1694 microversion: 2.1 time: 0.165445 Jul 30 22:06:40.056472 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3405/6769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:39 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:40.063012 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] Creating event network-changed:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch2-master-1 Jul 30 22:06:40.068417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] Instance 05070fc7-382c-4913-87f0-8a320ee2b05f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 30 22:06:40.079413 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-7be4a2a7-e624-4358-bbe1-3ebb76327c88 req-a9b2d7c0-a5ec-44ca-a347-3c19e692a26d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042966 Jul 30 22:06:40.080008 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3365/6770] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:06:41.077064 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:41.077693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:41.084799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.085260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.086042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.086495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.222977 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:41.231259 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e42da24c-cbe4-4734-9ae7-7b8a3e1558bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1691 microversion: 2.1 time: 0.158157 Jul 30 22:06:41.231852 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3406/6771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:41 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:06:41.252808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:41.253465 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:41.259805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.260285 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.261080 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.261547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.320532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-293481c6-93f7-4223-993c-341c545d1d0f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action" status: 204 len: 0 microversion: 2.1 time: 0.072579 Jul 30 22:06:41.321506 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3366/6772] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:06:41 2022] POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:06:41.330983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:41.331620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:41.339017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.339834 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.341006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.341534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.554926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:41.562703 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c59e31e9-14e6-4167-bfaa-2ad6a2218f1f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1691 microversion: 2.1 time: 0.236846 Jul 30 22:06:41.563311 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3407/6773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:41 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:41.583895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:41.584530 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:41.591453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.592118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.592924 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:41.593387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:41.734280 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:41.741970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-46cdd450-e65c-444b-96ef-d99494c57091 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1691 microversion: 2.1 time: 0.162472 Jul 30 22:06:41.742552 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3367/6774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:41 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:06:42.762327 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:06:42.762987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:06:42.770328 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:42.770795 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:42.771597 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:42.772050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:42.905209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:06:42.913113 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-96cb6c01-b0a9-41e9-85d2-3ee002b1e234 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1683 microversion: 2.1 time: 0.154782 Jul 30 22:06:42.914091 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3408/6775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:06:42 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:06:44.673613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9a1237ca-cdd3-4793-9313-f8712e472120 req-1185382a-6988-4347-84cc-f12766c93bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "name": "network-vif-plugged", "status": "completed", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:06:44.684118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9a1237ca-cdd3-4793-9313-f8712e472120 req-1185382a-6988-4347-84cc-f12766c93bae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:06:44.684593 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9a1237ca-cdd3-4793-9313-f8712e472120 req-1185382a-6988-4347-84cc-f12766c93bae service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:06:44.695586 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9a1237ca-cdd3-4793-9313-f8712e472120 req-1185382a-6988-4347-84cc-f12766c93bae service nova] Creating event network-vif-plugged:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch2-master-1 Jul 30 22:06:44.701116 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9a1237ca-cdd3-4793-9313-f8712e472120 req-1185382a-6988-4347-84cc-f12766c93bae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098936 Jul 30 22:06:44.701643 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3368/6776] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:07:05.101323 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:05.103636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:05.106175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=28 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:05.106869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:05.114616 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:05.115094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:05.115941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:05.116408 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:05.171506 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b90ed74e-9cf6-4317-a150-16af512d8783 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action" status: 200 len: 24565 microversion: 2.1 time: 0.073960 Jul 30 22:07:05.172115 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3409/6777] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:07:05 2022] POST /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f/action => generated 24565 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:07:12.694505 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:12.695165 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:12.703476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c2bfed88-95f7-4073-9c74-a3dd2e3b3659 req-9b2d26f5-426d-4245-ad08-1aa4c3b36f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:12.710746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=24 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:12.712745 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:12.715968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2bfed88-95f7-4073-9c74-a3dd2e3b3659 req-9b2d26f5-426d-4245-ad08-1aa4c3b36f6b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:12.716425 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c2bfed88-95f7-4073-9c74-a3dd2e3b3659 req-9b2d26f5-426d-4245-ad08-1aa4c3b36f6b service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:12.718622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:12.719091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:12.720120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:12.720436 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:12.732110 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c2bfed88-95f7-4073-9c74-a3dd2e3b3659 req-9b2d26f5-426d-4245-ad08-1aa4c3b36f6b service nova] Creating event network-changed:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch2-master-1 Jul 30 22:07:12.737435 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c2bfed88-95f7-4073-9c74-a3dd2e3b3659 req-9b2d26f5-426d-4245-ad08-1aa4c3b36f6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037986 Jul 30 22:07:12.738459 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3410/6778] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:07:12.751728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:07:12.838964 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-196aadc3-2c36-4e35-8fa3-990d7f362afd tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 204 len: 0 microversion: 2.1 time: 0.148568 Jul 30 22:07:12.839693 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3369/6779] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:07:12 2022] DELETE /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:07:12.849582 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:12.850526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:12.858525 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:12.859177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:12.860503 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:12.861299 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:13.036833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:13.044908 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3859aa0-237a-4a8e-97a5-5f80dff8f341 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1689 microversion: 2.1 time: 0.200238 Jul 30 22:07:13.045517 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3411/6780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:12 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:14.066545 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:14.067264 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:14.075047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:14.075564 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:14.076384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:14.076855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:14.217260 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:14.225005 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-39fde2ac-7cd8-4e95-a246-40052dd3154b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 200 len: 1689 microversion: 2.1 time: 0.162743 Jul 30 22:07:14.225584 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3370/6781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:14 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:14.724932 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-28815cf1-9d77-4a96-8522-bbad8c84a9c1 req-c61b0032-9ebb-4d35-b95e-9fde3e12ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05070fc7-382c-4913-87f0-8a320ee2b05f", "name": "network-vif-deleted", "tag": "e421d89e-3e05-4746-b6bd-a82997e2f0b3"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:14.737375 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-28815cf1-9d77-4a96-8522-bbad8c84a9c1 req-c61b0032-9ebb-4d35-b95e-9fde3e12ecf6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:14.737873 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-28815cf1-9d77-4a96-8522-bbad8c84a9c1 req-c61b0032-9ebb-4d35-b95e-9fde3e12ecf6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:14.750256 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-28815cf1-9d77-4a96-8522-bbad8c84a9c1 req-c61b0032-9ebb-4d35-b95e-9fde3e12ecf6 service nova] Creating event network-vif-deleted:e421d89e-3e05-4746-b6bd-a82997e2f0b3 for instance 05070fc7-382c-4913-87f0-8a320ee2b05f on nch2-master-1 Jul 30 22:07:14.755094 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-28815cf1-9d77-4a96-8522-bbad8c84a9c1 req-c61b0032-9ebb-4d35-b95e-9fde3e12ecf6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034005 Jul 30 22:07:14.755746 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3412/6782] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:07:15.247610 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:15.248464 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 05070fc7-382c-4913-87f0-8a320ee2b05f] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:15.255427 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:15.255915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:15.256705 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:15.257167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:15.271933 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] HTTP exception thrown: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Request method failure captured: Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f HTTP/1.1 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aqAjxpRDMzILrwQxccs6C-ZzDazvIwiUGz1A41XloMiJAws9JiQDj6CCsnA7oi6NGSI4c25ONck_H85rNQvWJvK1mto-SqpRdtvEaIB8QI38CbNQVQ7cs2CPhjf-fgMgskxRktfEIw_CuixiYjzhTDmGM78aSBSC1lQFXQ2WRfjUDY Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd23983804f14a2c83c88db64491820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd23983804f14a2c83c88db64491820c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ec9fa31beca14813baa00869e5e7952a Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '05070fc7-382c-4913-87f0-8a320ee2b05f'} Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:07:15.273597 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Returning 404 to user: Instance 05070fc7-382c-4913-87f0-8a320ee2b05f could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3746b66b-bc5f-4f7f-9b9d-a91b107655df tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f" status: 404 len: 111 microversion: 2.1 time: 0.031741 Jul 30 22:07:15.279331 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3371/6783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:15 2022] GET /compute/v2.1/servers/05070fc7-382c-4913-87f0-8a320ee2b05f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:07:18.284554 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-589c3de6-8f8c-4c69-be03-87ef7ff94f92 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '.version_select at 0x7fbb4f9ac670>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:18.308467 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-589c3de6-8f8c-4c69-be03-87ef7ff94f92 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1028533157" status: 202 len: 0 microversion: 2.1 time: 0.030136 Jul 30 22:07:18.309110 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3413/6784] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 22:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1028533157 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:07:18.334254 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-09f924a6-0b76-42a1-b695-f3ebe5f3343d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: .version_select at 0x7fbb4fc5ff70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1406613434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb+maUnI1Hm2ztlEkc5KDjDw+/UcDJVGe0iHFOThOvLjiCS9MebrQLFErdYs2f0HzIC8/+WhdhyrHiFRQmUDRxiUGsA0bf1dDw2wh1anuUbxi/CetLCUQNjq67LZ/C1lA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:18.351686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-09f924a6-0b76-42a1-b695-f3ebe5f3343d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:07:18.358877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-09f924a6-0b76-42a1-b695-f3ebe5f3343d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:07:18.388739 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-09f924a6-0b76-42a1-b695-f3ebe5f3343d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058542 Jul 30 22:07:18.389413 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3372/6785] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:07:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:07:24.084013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1976261238", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "6ce7fb12-f558-41dd-aceb-8043affa8cb8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1406613434", "security_groups": [{"name": "tempest-secgroup-smoke-1831461195"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:24.214413 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] validate_networks() for [('6ce7fb12-f558-41dd-aceb-8043affa8cb8', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:07:24.644365 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:07:24.644813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:07:24.645315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:07:24.646054 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:07:24.646652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:07:24.659987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:24.660836 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:24.661683 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:24.662147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:24.681277 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:07:24.686918 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:07:24.701178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:07:24.703644 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:07:24.752558 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3aa829e-440c-471a-bbb3-0cae0481da71 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673251 Jul 30 22:07:24.753338 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3414/6786] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:07:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:07:24.766720 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7397f5b1-0119-4bbd-88ce-a2f464ea46a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:24.767428 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7397f5b1-0119-4bbd-88ce-a2f464ea46a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:24.833923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7397f5b1-0119-4bbd-88ce-a2f464ea46a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:24.841802 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7397f5b1-0119-4bbd-88ce-a2f464ea46a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1267 microversion: 2.1 time: 0.080898 Jul 30 22:07:24.842376 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3373/6787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:24 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:25.863844 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:25.865114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:25.872850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:25.873325 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:25.874308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:25.874776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:25.940168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:25.948754 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-52207cf7-ef87-45ab-b76a-a2f3f2375340 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1325 microversion: 2.1 time: 0.089679 Jul 30 22:07:25.949361 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3415/6788] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:25 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:26.970406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:26.971191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:26.978265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:26.981133 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:26.981746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:26.982771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:26.983614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:27.246476 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:27.254161 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4de72b9e-0c60-4c6f-adad-87a5862ca211 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.287865 Jul 30 22:07:27.255351 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3374/6789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:26 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:27.583920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c429b090-1f42-4ec4-9bfd-9f86b84bd2de req-06555ba5-d13b-48fc-b998-af89a8778ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202fdd47-33ae-4881-b441-ef443ac71b36", "tag": "9bb5777f-cd60-435a-8320-d9e416fc34b1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:27.595850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c429b090-1f42-4ec4-9bfd-9f86b84bd2de req-06555ba5-d13b-48fc-b998-af89a8778ae8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:27.596905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c429b090-1f42-4ec4-9bfd-9f86b84bd2de req-06555ba5-d13b-48fc-b998-af89a8778ae8 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:27.612002 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c429b090-1f42-4ec4-9bfd-9f86b84bd2de req-06555ba5-d13b-48fc-b998-af89a8778ae8 service nova] Creating event network-changed:9bb5777f-cd60-435a-8320-d9e416fc34b1 for instance 202fdd47-33ae-4881-b441-ef443ac71b36 on nch2-master-1 Jul 30 22:07:27.617081 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c429b090-1f42-4ec4-9bfd-9f86b84bd2de req-06555ba5-d13b-48fc-b998-af89a8778ae8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Jul 30 22:07:27.617993 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3416/6790] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:07:28.279875 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:28.280596 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:28.287829 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:28.288318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:28.289126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:28.289601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:28.429105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:28.437261 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d655a784-f096-4879-bf00-b42c851d576c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.161375 Jul 30 22:07:28.437839 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3375/6791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:28 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:29.458680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:29.460169 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:29.468111 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:29.468621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:29.469418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:29.469880 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:29.608728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:29.616515 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-875a8de5-996d-4eea-bdf9-a19264ed6ee6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.162228 Jul 30 22:07:29.617097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3417/6792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:29 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:30.637672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:30.638317 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:30.645659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:30.646141 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:30.646944 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:30.647446 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:30.806164 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:30.815503 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3ca0dda4-ed62-4a8e-b6ba-febfe86349bf tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.182299 Jul 30 22:07:30.816528 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3376/6793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:30 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:31.837550 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:31.838223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:31.845515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:31.845988 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:31.846777 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:31.847235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:31.984800 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:31.992523 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f643354c-2c51-491f-84d8-c7f025968bd6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.159712 Jul 30 22:07:31.993117 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3418/6794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:31 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:32.789708 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d0615d76-af51-432e-a827-36b00eb1161b req-4bfb32f7-5917-495a-b59f-e0e664cd520c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202fdd47-33ae-4881-b441-ef443ac71b36", "name": "network-vif-plugged", "status": "completed", "tag": "9bb5777f-cd60-435a-8320-d9e416fc34b1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:32.799979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d0615d76-af51-432e-a827-36b00eb1161b req-4bfb32f7-5917-495a-b59f-e0e664cd520c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:32.800460 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d0615d76-af51-432e-a827-36b00eb1161b req-4bfb32f7-5917-495a-b59f-e0e664cd520c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:32.813394 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d0615d76-af51-432e-a827-36b00eb1161b req-4bfb32f7-5917-495a-b59f-e0e664cd520c service nova] Creating event network-vif-plugged:9bb5777f-cd60-435a-8320-d9e416fc34b1 for instance 202fdd47-33ae-4881-b441-ef443ac71b36 on nch2-master-1 Jul 30 22:07:32.818532 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d0615d76-af51-432e-a827-36b00eb1161b req-4bfb32f7-5917-495a-b59f-e0e664cd520c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Jul 30 22:07:32.819196 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3377/6795] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:07:33.013806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:33.014465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:33.021810 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:33.022273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:33.023084 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:33.023566 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:33.159517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:33.167571 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-62cc4993-7f49-44c6-aab7-424f0f75cb4a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1393 microversion: 2.1 time: 0.157699 Jul 30 22:07:33.168147 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3419/6796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:33 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:34.190175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:34.190903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:34.197816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:34.198323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:34.199142 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:34.199640 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:34.332461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:34.340163 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9876914d-fa49-4b84-a512-355614b83453 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1564 microversion: 2.1 time: 0.155055 Jul 30 22:07:34.340742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3378/6797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:34 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:34.360724 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:34.361357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:34.370530 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:34.370998 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:34.371818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:34.372275 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:34.502801 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:34.511376 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7517859a-f632-4b1c-a73f-b7080669819c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1564 microversion: 2.1 time: 0.154475 Jul 30 22:07:34.511962 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3420/6798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:34 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:36.461097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:07:36.462383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-98a2aa3e-0cfd-4a63-98cc-844381232ec1 req-d998efe8-b3d0-435c-8897-9c47eb9d4139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202fdd47-33ae-4881-b441-ef443ac71b36", "tag": "9bb5777f-cd60-435a-8320-d9e416fc34b1"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:07:36.462904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:07:36.467626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:36.468319 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:36.468865 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:36.470012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:36.472688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:36.473587 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:36.474615 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:36.475526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:36.476196 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-98a2aa3e-0cfd-4a63-98cc-844381232ec1 req-d998efe8-b3d0-435c-8897-9c47eb9d4139 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:07:36.476658 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-98a2aa3e-0cfd-4a63-98cc-844381232ec1 req-d998efe8-b3d0-435c-8897-9c47eb9d4139 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:07:36.481361 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=49 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:36.490394 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-98a2aa3e-0cfd-4a63-98cc-844381232ec1 req-d998efe8-b3d0-435c-8897-9c47eb9d4139 service nova] Creating event network-changed:9bb5777f-cd60-435a-8320-d9e416fc34b1 for instance 202fdd47-33ae-4881-b441-ef443ac71b36 on nch2-master-1 Jul 30 22:07:36.496052 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-98a2aa3e-0cfd-4a63-98cc-844381232ec1 req-d998efe8-b3d0-435c-8897-9c47eb9d4139 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037921 Jul 30 22:07:36.496659 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3421/6799] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:07:36.718590 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:07:36.726437 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8ba2eb47-a29e-45d9-bf37-04507d87a8d5 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1564 microversion: 2.1 time: 0.271109 Jul 30 22:07:36.727033 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3379/6800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:07:36 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:07:59.974442 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:00.027205 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:08:00.029642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:00.036081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:00.036562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:00.037389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:00.037854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:00.092870 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f1ab417d-77f6-4d1d-8eba-6d5101e6ce72 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action" status: 200 len: 24567 microversion: 2.1 time: 0.121190 Jul 30 22:08:00.093494 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3422/6801] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:07:59 2022] POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action => generated 24567 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:08:11.150319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-80a7a48e-84ef-4bbc-9c42-7c107985d37a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:08:11.152566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:11.153454 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:11.160598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80a7a48e-84ef-4bbc-9c42-7c107985d37a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:11.161019 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-80a7a48e-84ef-4bbc-9c42-7c107985d37a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:11.184909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-80a7a48e-84ef-4bbc-9c42-7c107985d37a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Going to try to stop instance {{(pid=130983) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 22:08:11.225619 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-80a7a48e-84ef-4bbc-9c42-7c107985d37a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action" status: 202 len: 0 microversion: 2.1 time: 0.079423 Jul 30 22:08:11.226247 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3380/6802] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:08:11 2022] POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:08:11.235665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:11.236419 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:11.239399 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:11.240105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:11.248712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:11.249177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:11.249985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:11.250446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:11.388613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:11.398170 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2e17ac0e-def5-47d8-9b8e-4755b4718d39 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.166865 Jul 30 22:08:11.398752 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3423/6803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:11 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:12.421746 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:12.422483 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:12.428929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:12.429413 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:12.430216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:12.430689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:12.568803 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:12.577127 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c323e7a1-62b3-4de7-baf0-2c47de73b1c8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.160543 Jul 30 22:08:12.577702 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3381/6804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:12 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:13.598193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:13.598835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:13.606147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:13.606624 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:13.607444 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:13.607911 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:13.742045 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:13.749819 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-89aab4c3-e699-43d6-9f1b-29b9e95807ab tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.155597 Jul 30 22:08:13.750411 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3424/6805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:13 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:14.771750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:14.772402 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:14.780049 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:14.780526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:14.781314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:14.781782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:14.913313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:14.921522 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7ce722c3-b3a5-4fb8-ba7e-28644f465f82 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.153957 Jul 30 22:08:14.922097 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3382/6806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:14 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:15.942678 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:15.943322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:15.950866 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:15.951357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:15.952146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:15.952604 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:16.090101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:16.097876 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1fee9687-de2b-42ab-a67c-f42e7f46c43f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.159151 Jul 30 22:08:16.098472 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3425/6807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:15 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:17.119314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:17.119955 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:17.129076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:17.130329 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:17.131153 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:17.131650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:17.263102 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:17.271058 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-82670a8a-7038-43f5-98e6-6d3e335ffdcc tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.155965 Jul 30 22:08:17.271666 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3383/6808] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:17 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:18.296257 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:18.296847 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:18.303983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:18.304478 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:18.305249 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:18.305711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:18.442437 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:18.450365 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4a64210b-47bc-4fab-89a8-bc5a83e6abad tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.158717 Jul 30 22:08:18.450959 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3426/6809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:18 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:19.471612 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:19.472257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:19.479964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:19.480453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:19.481256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:19.481729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:19.614751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:19.622983 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9d1288d8-e178-48c6-8390-aa284661bd88 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.155322 Jul 30 22:08:19.623597 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3384/6810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:19 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:20.644544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:20.645183 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:20.652357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:20.652837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:20.653628 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:20.654093 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:20.787991 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:20.795786 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-41ce2595-6205-4c98-8d94-e36ddb4a84f4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.155460 Jul 30 22:08:20.796386 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3427/6811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:20 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:21.817154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:21.817786 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:21.825121 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:21.825601 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:21.826388 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:21.826850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:21.961946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:21.970523 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f66999ad-4cf0-4df6-8a80-91f079ddcf34 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.157295 Jul 30 22:08:21.971102 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3385/6812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:21 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:22.991631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:22.992209 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:23.000232 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:23.000708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:23.001510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:23.001975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:23.142905 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:23.151070 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2226591b-af9b-4ed2-9273-577ef4ec3507 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.163540 Jul 30 22:08:23.151703 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3428/6813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:22 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:24.172458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:24.173098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:24.180118 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:24.180600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:24.181394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:24.181904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:24.318011 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:24.326307 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5180903b-5b6b-4530-b5c3-a81f0d0b04a8 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.157811 Jul 30 22:08:24.327045 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3386/6814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:24 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:25.347863 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:25.348508 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:25.355769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:25.356239 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:25.357026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:25.357482 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:25.490040 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:25.498022 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-61ef64d5-7785-47e3-a0b4-ff65d5d676c3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.154290 Jul 30 22:08:25.498606 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3429/6815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:25 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:26.519977 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:26.520614 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:26.529376 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:26.529854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:26.530645 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:26.531109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:26.666925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:26.674608 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ba5caa4d-df00-49a2-933c-17c147e51c95 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1693 microversion: 2.1 time: 0.158703 Jul 30 22:08:26.675162 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3387/6816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:26 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:27.696066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:27.696694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:27.704342 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:27.704814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:27.705626 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:27.706124 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:27.851850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:27.860419 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-11524009-d834-4c43-907b-8939f7dd0501 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1670 microversion: 2.1 time: 0.168658 Jul 30 22:08:27.861032 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3430/6817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:27 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:28.956470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:08:28.958707 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:28.965873 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:28.966379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:28.967172 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:28.967667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:29.016418 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bc4166e1-1ea2-4cc0-8226-f30d5463b857 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action" status: 200 len: 38359 microversion: 2.1 time: 0.063736 Jul 30 22:08:29.017081 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3388/6818] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:08:28 2022] POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action => generated 38359 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:08:29.029424 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4beb0e5a-913d-4e17-b4df-e7348176968c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:08:29.036598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4beb0e5a-913d-4e17-b4df-e7348176968c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:29.037019 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4beb0e5a-913d-4e17-b4df-e7348176968c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:29.062363 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4beb0e5a-913d-4e17-b4df-e7348176968c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Going to try to start instance {{(pid=130984) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 22:08:29.104037 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4beb0e5a-913d-4e17-b4df-e7348176968c tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action" status: 202 len: 0 microversion: 2.1 time: 0.078507 Jul 30 22:08:29.104662 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3431/6819] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:08:29 2022] POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:08:29.113964 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:29.114706 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:29.123109 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:29.123623 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:29.125372 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:29.125976 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:29.357192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:29.365206 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29b5ffcc-a18a-4493-8e8b-aa2d59d78551 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1679 microversion: 2.1 time: 0.255555 Jul 30 22:08:29.366003 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3389/6820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:29 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:30.389941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:08:30.390679 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:30.399709 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:30.400308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:30.401174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:30.401639 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:30.538751 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:08:30.546534 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-14bd425b-9518-45ef-a4ed-9b77ac90f1e7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1683 microversion: 2.1 time: 0.162812 Jul 30 22:08:30.547111 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3432/6821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:08:30 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:08:38.700301 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:08:38.700906 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:08:56.742374 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:08:56.744689 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:08:56.747257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=20 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:56.747975 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:56.754907 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:56.755440 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:56.756258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:08:56.756733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:08:56.814565 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6197ef20-ee9d-4dad-99d2-30b2848e851d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action" status: 200 len: 62914 microversion: 2.1 time: 0.076188 Jul 30 22:08:56.815211 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3390/6822] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:08:56 2022] POST /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36/action => generated 62914 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:09:03.931118 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:03.931816 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:03.934144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5d935149-2fc4-4d34-a3fc-9186136ea963 req-71e4971e-ea17-4a8c-9cc3-1875460cacc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202fdd47-33ae-4881-b441-ef443ac71b36", "tag": "9bb5777f-cd60-435a-8320-d9e416fc34b1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:03.935814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=20 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:03.936499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:03.943763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:03.944307 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:03.945140 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:03.945598 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:03.946272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5d935149-2fc4-4d34-a3fc-9186136ea963 req-71e4971e-ea17-4a8c-9cc3-1875460cacc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:03.946979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5d935149-2fc4-4d34-a3fc-9186136ea963 req-71e4971e-ea17-4a8c-9cc3-1875460cacc9 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:03.962042 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5d935149-2fc4-4d34-a3fc-9186136ea963 req-71e4971e-ea17-4a8c-9cc3-1875460cacc9 service nova] Creating event network-changed:9bb5777f-cd60-435a-8320-d9e416fc34b1 for instance 202fdd47-33ae-4881-b441-ef443ac71b36 on nch2-master-1 Jul 30 22:09:03.967205 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5d935149-2fc4-4d34-a3fc-9186136ea963 req-71e4971e-ea17-4a8c-9cc3-1875460cacc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038080 Jul 30 22:09:03.967857 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3391/6823] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:09:03.976711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:09:04.068992 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-80b54908-e8fc-4e5d-85dd-8faa4ac4c72a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 204 len: 0 microversion: 2.1 time: 0.142032 Jul 30 22:09:04.069790 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3433/6824] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:09:03 2022] DELETE /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:09:04.079076 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:04.080009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:04.087684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:04.088186 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:04.089551 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:04.090198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:04.248983 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:04.256907 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f3d6b8e3-78b2-464b-a094-90226c2bdaee tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1689 microversion: 2.1 time: 0.182283 Jul 30 22:09:04.257493 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3392/6825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:04 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:09:05.278965 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:05.279643 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:05.286825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:05.287314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:05.288129 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:05.288596 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:05.431080 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:05.439583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c137790c-581d-4416-9d26-bb45a7a3cfb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1689 microversion: 2.1 time: 0.165152 Jul 30 22:09:05.441555 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3434/6826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:05 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:06.083034 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-58d32d96-0d85-4eb7-b42f-4bf8ef89d987 req-4ad7e4f5-8972-418f-85da-7fde98aed0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202fdd47-33ae-4881-b441-ef443ac71b36", "name": "network-vif-deleted", "tag": "9bb5777f-cd60-435a-8320-d9e416fc34b1"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:06.093974 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58d32d96-0d85-4eb7-b42f-4bf8ef89d987 req-4ad7e4f5-8972-418f-85da-7fde98aed0ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:06.094459 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-58d32d96-0d85-4eb7-b42f-4bf8ef89d987 req-4ad7e4f5-8972-418f-85da-7fde98aed0ba service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:06.106427 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-58d32d96-0d85-4eb7-b42f-4bf8ef89d987 req-4ad7e4f5-8972-418f-85da-7fde98aed0ba service nova] Creating event network-vif-deleted:9bb5777f-cd60-435a-8320-d9e416fc34b1 for instance 202fdd47-33ae-4881-b441-ef443ac71b36 on nch2-master-1 Jul 30 22:09:06.111322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-58d32d96-0d85-4eb7-b42f-4bf8ef89d987 req-4ad7e4f5-8972-418f-85da-7fde98aed0ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Jul 30 22:09:06.111914 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3393/6827] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:09:06.460985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:06.462031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:06.469031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:06.469495 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:06.470298 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:06.470748 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:06.515483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:06.516101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:06.516794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lazy-loading 'fault' on Instance uuid 202fdd47-33ae-4881-b441-ef443ac71b36 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:09:06.560879 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:06.568220 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2e86f2b-c863-4226-92f1-500a670e2e9f tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 200 len: 1357 microversion: 2.1 time: 0.111445 Jul 30 22:09:06.568834 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3435/6828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:06 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 1357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:07.593390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:07.594119 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 202fdd47-33ae-4881-b441-ef443ac71b36] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:07.600580 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:07.601055 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:07.601844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:07.602315 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:07.615702 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] HTTP exception thrown: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Request method failure captured: Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 HTTP/1.1 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5aqAjxpRDMzILrwQxccs6C-ZzDazvIwiUGz1A41XloMiJAws9JiQDj6CCsnA7oi6NGSI4c25ONck_H85rNQvWJvK1mto-SqpRdtvEaIB8QI38CbNQVQ7cs2CPhjf-fgMgskxRktfEIw_CuixiYjzhTDmGM78aSBSC1lQFXQ2WRfjUDY Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd23983804f14a2c83c88db64491820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd23983804f14a2c83c88db64491820c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: ec9fa31beca14813baa00869e5e7952a Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '202fdd47-33ae-4881-b441-ef443ac71b36'} Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:09:07.617336 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Returning 404 to user: Instance 202fdd47-33ae-4881-b441-ef443ac71b36 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79f9277d-0a48-4025-b164-8f4ad3171658 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36" status: 404 len: 111 microversion: 2.1 time: 0.032484 Jul 30 22:09:07.622400 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3394/6829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:07 2022] GET /compute/v2.1/servers/202fdd47-33ae-4881-b441-ef443ac71b36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:09:10.907369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23ec0c36-dc49-4d62-8d52-51314df90f8d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '.version_select at 0x7fbb5cd34790>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:10.930390 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23ec0c36-dc49-4d62-8d52-51314df90f8d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406613434" status: 202 len: 0 microversion: 2.1 time: 0.028579 Jul 30 22:09:10.930996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3436/6830] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Jul 30 22:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406613434 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 22:09:10.963929 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-480c6b9b-6394-4c7c-8a5d-960c81597ab9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: .version_select at 0x7fbb4fd40940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-972337673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNklubn6Xn1u1A+oKZpM+YoCuGuC+DRG6pePS85cTgaQRSvNf+N0n0BcSx9I4jYbVE6fYM5Mf4CF3wSKZJ6euBibgUoiqIb67yopZfMr1tS2c7gosrXubMAF+slU2+2XNw=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:10.980462 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-480c6b9b-6394-4c7c-8a5d-960c81597ab9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:09:10.986516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-480c6b9b-6394-4c7c-8a5d-960c81597ab9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:09:11.018506 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-480c6b9b-6394-4c7c-8a5d-960c81597ab9 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059131 Jul 30 22:09:11.019386 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3395/6831] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:09:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:09:16.516252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-485341834", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "networks": [{"uuid": "694dc52b-bf61-42a9-853f-4d570fcbf04d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-972337673", "security_groups": [{"name": "tempest-secgroup-smoke-290378686"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:16.567657 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:16.667764 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] validate_networks() for [('694dc52b-bf61-42a9-853f-4d570fcbf04d', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:09:17.182101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:09:17.182779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:09:17.183465 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:09:17.184075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:09:17.184794 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:09:17.196406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:17.197145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:17.198692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:17.199822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:17.222356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:09:17.228699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Getting quotas for user ec9fa31beca14813baa00869e5e7952a and project cd23983804f14a2c83c88db64491820c. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:09:17.244426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:09:17.247315 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:09:17.309570 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-13723eb2-8045-432a-96f0-7133c1a61372 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796932 Jul 30 22:09:17.317102 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3437/6832] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:09:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:09:17.324814 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-01bd3f05-a585-438e-ab4f-a058d68343f3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:17.326092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-01bd3f05-a585-438e-ab4f-a058d68343f3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:17.403056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-01bd3f05-a585-438e-ab4f-a058d68343f3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:17.411149 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-01bd3f05-a585-438e-ab4f-a058d68343f3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1265 microversion: 2.1 time: 0.092501 Jul 30 22:09:17.412473 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3396/6833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:17 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:09:18.445213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:18.445862 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:18.455710 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:18.458621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:18.459476 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:18.459970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:18.558475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:18.566892 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ed947ce7-8439-4ca4-aa6e-4f2f6e110fb7 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1323 microversion: 2.1 time: 0.135166 Jul 30 22:09:18.567530 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3438/6834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:18 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1323 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:19.588825 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:19.589470 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:19.591600 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=16 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:19.600002 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:19.600765 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:19.601574 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:19.602144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:19.746948 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:19.754882 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-78418960-8ef3-40d1-9c5c-6abaaad4a9d4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.170494 Jul 30 22:09:19.755496 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3397/6835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:19 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:19.898869 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7bb5da69-5723-4bd5-bffa-b5151fa3ed19 req-4cf86177-c415-4a9f-9ace-5b1fd1e9f655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8091166e-e7b4-4eed-ba5e-7bc50e3c0300", "tag": "bed2c2b5-fa52-4321-be7c-f82d62295d8d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:19.910532 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7bb5da69-5723-4bd5-bffa-b5151fa3ed19 req-4cf86177-c415-4a9f-9ace-5b1fd1e9f655 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:19.911001 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7bb5da69-5723-4bd5-bffa-b5151fa3ed19 req-4cf86177-c415-4a9f-9ace-5b1fd1e9f655 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:19.923759 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7bb5da69-5723-4bd5-bffa-b5151fa3ed19 req-4cf86177-c415-4a9f-9ace-5b1fd1e9f655 service nova] Creating event network-changed:bed2c2b5-fa52-4321-be7c-f82d62295d8d for instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 on nch1-master-1 Jul 30 22:09:19.928974 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7bb5da69-5723-4bd5-bffa-b5151fa3ed19 req-4cf86177-c415-4a9f-9ace-5b1fd1e9f655 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034695 Jul 30 22:09:19.929590 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3439/6836] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:09:20.776307 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:20.776895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:20.784072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:20.784555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:20.785352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:20.785816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:20.920659 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:20.928345 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60dafa75-cb88-4875-87db-e34483a55812 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.156466 Jul 30 22:09:20.928915 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3398/6837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:20 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:21.951818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:21.952568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:21.958898 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:21.959403 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:21.960194 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:21.960652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:22.094917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:22.102590 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-395d434c-d636-4f1c-b61e-8c34fb358505 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.156414 Jul 30 22:09:22.103174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3440/6838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:21 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:23.123064 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:23.123670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:23.130845 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:23.131343 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:23.132138 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:23.132603 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:23.266354 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:23.274223 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa8d0292-f451-475a-bc6e-93464de20e27 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.155169 Jul 30 22:09:23.274908 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3399/6839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:23 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:24.297359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:24.298075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:24.304368 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:24.304842 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:24.305631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:24.306092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:24.440825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:24.448448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-06c9994f-33c8-4955-ba4d-428c17ba32bb tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.155479 Jul 30 22:09:24.449027 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3441/6840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:24 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:25.030276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9380b477-c8c6-49f1-9e18-671977ed1e9c req-c6985c0f-a6de-4a83-af8c-3c63ff479675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8091166e-e7b4-4eed-ba5e-7bc50e3c0300", "name": "network-vif-plugged", "status": "completed", "tag": "bed2c2b5-fa52-4321-be7c-f82d62295d8d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:25.040945 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9380b477-c8c6-49f1-9e18-671977ed1e9c req-c6985c0f-a6de-4a83-af8c-3c63ff479675 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:25.041425 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9380b477-c8c6-49f1-9e18-671977ed1e9c req-c6985c0f-a6de-4a83-af8c-3c63ff479675 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:25.055256 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9380b477-c8c6-49f1-9e18-671977ed1e9c req-c6985c0f-a6de-4a83-af8c-3c63ff479675 service nova] Creating event network-vif-plugged:bed2c2b5-fa52-4321-be7c-f82d62295d8d for instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 on nch1-master-1 Jul 30 22:09:25.061012 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9380b477-c8c6-49f1-9e18-671977ed1e9c req-c6985c0f-a6de-4a83-af8c-3c63ff479675 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Jul 30 22:09:25.061620 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3400/6841] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:09:25.469026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:25.469562 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:25.476579 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:25.477042 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:25.477818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:25.478270 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:25.612983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:25.621318 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cbd88602-447d-48ad-9601-23cddf3e3d69 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1390 microversion: 2.1 time: 0.156319 Jul 30 22:09:25.621894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3442/6842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:25 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:26.643179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:26.644190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:26.650613 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:26.651089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:26.652068 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:26.652538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:26.783651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:26.791708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5fbc7aeb-30f5-4131-9594-6ffeda405ba4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1562 microversion: 2.1 time: 0.153570 Jul 30 22:09:26.792285 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3401/6843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:26 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:26.813168 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:26.813791 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:26.820837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:26.821303 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:26.822720 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:26.823175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:26.952766 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:26.960889 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c2e8ce1-a4dd-4bed-bbd4-ab4b8cea01ed tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1562 microversion: 2.1 time: 0.151625 Jul 30 22:09:26.961480 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3443/6844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:26 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:28.932641 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:09:28.933295 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:28.935403 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:28.937299 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:28.937443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-623b0928-24d2-4c4c-bac4-0f6d4b9090c4 req-ae492248-ba66-47de-969c-50ee87b64b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8091166e-e7b4-4eed-ba5e-7bc50e3c0300", "tag": "bed2c2b5-fa52-4321-be7c-f82d62295d8d"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:28.942951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:28.943140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:28.943758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:28.943967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:28.945361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:28.945938 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:28.951438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-623b0928-24d2-4c4c-bac4-0f6d4b9090c4 req-ae492248-ba66-47de-969c-50ee87b64b45 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:28.951940 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-623b0928-24d2-4c4c-bac4-0f6d4b9090c4 req-ae492248-ba66-47de-969c-50ee87b64b45 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:28.964948 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-623b0928-24d2-4c4c-bac4-0f6d4b9090c4 req-ae492248-ba66-47de-969c-50ee87b64b45 service nova] Creating event network-changed:bed2c2b5-fa52-4321-be7c-f82d62295d8d for instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 on nch1-master-1 Jul 30 22:09:28.970211 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-623b0928-24d2-4c4c-bac4-0f6d4b9090c4 req-ae492248-ba66-47de-969c-50ee87b64b45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038476 Jul 30 22:09:28.971158 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3444/6845] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:09:29.108651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:09:29.117056 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6289f0f9-a557-4aea-9326-986f0ec230b2 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1562 microversion: 2.1 time: 0.188859 Jul 30 22:09:29.118151 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3402/6846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:09:28 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:09:50.372855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:50.373900 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=36 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:50.378928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:09:50.381383 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:09:50.390104 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:50.390580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:50.391405 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:09:50.391870 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:09:50.458740 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2965b85c-5a49-44c9-bfdb-e3a60d711062 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action" status: 200 len: 24573 microversion: 2.1 time: 0.088965 Jul 30 22:09:50.459419 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3445/6847] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:09:50 2022] POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action => generated 24573 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:10:01.463151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:01.463759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:01.465935 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:01.466777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:01.473502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:01.474015 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:01.474824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:01.475325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:01.499252 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lazy-loading 'flavor' on Instance uuid 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:10:01.565493 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-02504646-18b6-41bb-a47b-0c632a0e6efe tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action" status: 202 len: 0 microversion: 2.1 time: 0.106699 Jul 30 22:10:01.566307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3403/6848] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:10:01 2022] POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:10:01.575936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:01.576756 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:01.579613 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=4 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:01.580344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:01.586789 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:01.587268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:01.588092 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:01.588552 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:01.772446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:01.780828 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5d77b9c-4b30-4685-955d-f5b1f5d051ef tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1688 microversion: 2.1 time: 0.209811 Jul 30 22:10:01.781410 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3446/6849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:01 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1688 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:02.804008 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:02.804656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:02.812549 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:02.813032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:02.813832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:02.814298 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:02.998729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:03.006540 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8e0e5099-b608-41f4-8e9d-90a1e9de24e6 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1671 microversion: 2.1 time: 0.206993 Jul 30 22:10:03.007107 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3404/6850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:02 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:04.097830 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:04.100157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:04.113454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.113454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.113454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.113454 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.164105 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-770a2adc-ad57-4079-9d7d-61f45cc6ebd3 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action" status: 200 len: 38424 microversion: 2.1 time: 0.070120 Jul 30 22:10:04.164807 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3447/6851] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:10:04 2022] POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action => generated 38424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:10:04.176753 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:04.177294 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:04.184921 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.185421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.186243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.186704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.251911 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5efe4eb1-a4ea-4dcd-a380-ce345916d55b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action" status: 202 len: 0 microversion: 2.1 time: 0.078613 Jul 30 22:10:04.255791 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3405/6852] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:10:04 2022] POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 22:10:04.262423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:04.263146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:04.271600 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.272065 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.272874 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:04.273324 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:04.497585 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:04.506912 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-cb94b45c-3ea2-4f97-b796-7f31afad8fde tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1677 microversion: 2.1 time: 0.249388 Jul 30 22:10:04.507459 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3448/6853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:04 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:05.535857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:05.536584 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:05.543325 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:05.543802 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:05.544638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:05.545101 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:05.691151 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:05.699856 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cf669931-39f2-4db4-996e-14fa65230590 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1677 microversion: 2.1 time: 0.169186 Jul 30 22:10:05.700438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3406/6854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:05 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:06.722473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:06.723435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:06.731443 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:06.731987 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:06.732851 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:06.733360 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:06.879350 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:06.887557 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ef225b88-15ae-4495-9466-22975cf8fe64 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1680 microversion: 2.1 time: 0.169164 Jul 30 22:10:06.888128 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3449/6855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:06 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:06.981962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:06.984658 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:06.992385 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:06.992860 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:06.993996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:06.995067 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:07.036205 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fed4ff4c-4500-4a3f-9d9d-875a13e0294b tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action" status: 200 len: 38424 microversion: 2.1 time: 0.057919 Jul 30 22:10:07.036927 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3407/6856] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:10:06 2022] POST /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300/action => generated 38424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 22:10:08.027712 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:08.028317 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:08.031230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-9b6f6291-0f69-4182-978f-58c602d35ae2 req-7ff34b77-030d-4c49-ad88-3b4f1ca540a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8091166e-e7b4-4eed-ba5e-7bc50e3c0300", "tag": "bed2c2b5-fa52-4321-be7c-f82d62295d8d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:08.035409 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:08.035924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:08.037018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:08.037730 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:08.042738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9b6f6291-0f69-4182-978f-58c602d35ae2 req-7ff34b77-030d-4c49-ad88-3b4f1ca540a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:08.043227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-9b6f6291-0f69-4182-978f-58c602d35ae2 req-7ff34b77-030d-4c49-ad88-3b4f1ca540a5 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:08.055443 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-9b6f6291-0f69-4182-978f-58c602d35ae2 req-7ff34b77-030d-4c49-ad88-3b4f1ca540a5 service nova] Creating event network-changed:bed2c2b5-fa52-4321-be7c-f82d62295d8d for instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 on nch1-master-1 Jul 30 22:10:08.061397 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-9b6f6291-0f69-4182-978f-58c602d35ae2 req-7ff34b77-030d-4c49-ad88-3b4f1ca540a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034928 Jul 30 22:10:08.062078 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3408/6857] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:10:08.066237 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:10:08.154662 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-20f8c129-5add-437e-9c65-abfe47ea154d tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 204 len: 0 microversion: 2.1 time: 0.130518 Jul 30 22:10:08.155986 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3450/6858] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:10:08 2022] DELETE /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:10:08.167901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:08.168719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:08.175808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:08.176297 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:08.177105 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:08.177575 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:08.318854 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:08.326652 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-14c2fdd7-c243-4e45-bba4-4cd9c9f40d6a tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1686 microversion: 2.1 time: 0.165893 Jul 30 22:10:08.327239 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3409/6859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:08 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:10:09.352076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:09.352804 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:09.360642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:09.361114 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:09.361910 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:09.362875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:09.531708 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec9fa31beca14813baa00869e5e7952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd23983804f14a2c83c88db64491820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:09.539569 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c42792b-8ae1-47c7-a1c4-5511b082ba0e tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 200 len: 1686 microversion: 2.1 time: 0.191793 Jul 30 22:10:09.540174 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3451/6860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:09 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:10:10.111007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5f6742d9-b423-4d9c-9780-ee04cdc14d40 req-de37209e-eb46-4903-8beb-c41b7b397748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8091166e-e7b4-4eed-ba5e-7bc50e3c0300", "name": "network-vif-deleted", "tag": "bed2c2b5-fa52-4321-be7c-f82d62295d8d"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:10.122230 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f6742d9-b423-4d9c-9780-ee04cdc14d40 req-de37209e-eb46-4903-8beb-c41b7b397748 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:10.122711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5f6742d9-b423-4d9c-9780-ee04cdc14d40 req-de37209e-eb46-4903-8beb-c41b7b397748 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:10.134582 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5f6742d9-b423-4d9c-9780-ee04cdc14d40 req-de37209e-eb46-4903-8beb-c41b7b397748 service nova] Creating event network-vif-deleted:bed2c2b5-fa52-4321-be7c-f82d62295d8d for instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 on nch1-master-1 Jul 30 22:10:10.140363 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5f6742d9-b423-4d9c-9780-ee04cdc14d40 req-de37209e-eb46-4903-8beb-c41b7b397748 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Jul 30 22:10:10.140981 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3410/6861] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:10:10.562534 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:10.563173 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] [instance: 8091166e-e7b4-4eed-ba5e-7bc50e3c0300] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:10.570295 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:10.570770 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:10.571590 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:10.572187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:10.593493 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] HTTP exception thrown: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Request method failure captured: Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 HTTP/1.1 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5aqAjxpRDMzILrwQxccs6C-ZzDazvIwiUGz1A41XloMiJAws9JiQDj6CCsnA7oi6NGSI4c25ONck_H85rNQvWJvK1mto-SqpRdtvEaIB8QI38CbNQVQ7cs2CPhjf-fgMgskxRktfEIw_CuixiYjzhTDmGM78aSBSC1lQFXQ2WRfjUDY Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd23983804f14a2c83c88db64491820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd23983804f14a2c83c88db64491820c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd23983804f14a2c83c88db64491820c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cd23983804f14a2c83c88db64491820c Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1646644092 Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: ec9fa31beca14813baa00869e5e7952a Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1646644092-project Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '8091166e-e7b4-4eed-ba5e-7bc50e3c0300'} Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:10:10.596234 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Returning 404 to user: Instance 8091166e-e7b4-4eed-ba5e-7bc50e3c0300 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-10fbbab5-4201-4f96-b049-68921f08caa4 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300" status: 404 len: 111 microversion: 2.1 time: 0.039164 Jul 30 22:10:10.600823 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3452/6862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:10 2022] GET /compute/v2.1/servers/8091166e-e7b4-4eed-ba5e-7bc50e3c0300 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:10:13.910259 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5c973955-3b65-48d7-8642-9052cc537a19 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] Calling method '.version_select at 0x7fbb4fc698b0>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:13.937923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5c973955-3b65-48d7-8642-9052cc537a19 tempest-TestNetworkAdvancedServerOps-1646644092 tempest-TestNetworkAdvancedServerOps-1646644092-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-972337673" status: 202 len: 0 microversion: 2.1 time: 0.033018 Jul 30 22:10:13.938938 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3411/6863] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Jul 30 22:10:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-972337673 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:10:25.278780 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:25.280125 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:25.503944 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bdab6321-249c-404b-8f71-6a81f5bdac68 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'create', calling method: .version_select at 0x7fbb4fe9bf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1744600683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTcQ2EKEcJceiUieBC0kfxJOjE6rwQ6Edf0psGaqRpi2lL4CpJQfFHoq27ElVfoKwEtpNWc2OXDuqRxVzQ8FeEk1rKdu6I14of213h+DKd+aaOiZSlpIZ/pvCGBIzsPXA=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:25.520835 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bdab6321-249c-404b-8f71-6a81f5bdac68 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for project cb0d987d5adc45fbb03290b133ee0641. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:10:25.526517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-bdab6321-249c-404b-8f71-6a81f5bdac68 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for user eba4265a2b324928b7aee20262b850fe and project cb0d987d5adc45fbb03290b133ee0641. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:10:25.558592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bdab6321-249c-404b-8f71-6a81f5bdac68 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.285933 Jul 30 22:10:25.559976 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3453/6864] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:10:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:10:26.582125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-383728703", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1744600683", "security_groups": [{"name": "tempest-secgroup-smoke-1737889820"}], "networks": [{"uuid": "90114180-0d45-4b0f-8a19-0ae9838b2048"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:26.591926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:26.592703 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:26.694850 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] validate_networks() for [('90114180-0d45-4b0f-8a19-0ae9838b2048', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:10:27.080882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:10:27.081341 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:10:27.082120 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:10:27.082819 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:10:27.083269 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:10:27.092654 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:27.093032 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:27.093877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:27.094352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:27.113091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for project cb0d987d5adc45fbb03290b133ee0641. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:10:27.119499 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for user eba4265a2b324928b7aee20262b850fe and project cb0d987d5adc45fbb03290b133ee0641. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:10:27.134092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:10:27.136830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:10:27.184732 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-70ad697a-9a95-4142-b969-057a8daadf24 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.606606 Jul 30 22:10:27.187547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3412/6865] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:10:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:10:27.197200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-625a18c6-6fa5-4768-a0c9-fe2cc087020e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:27.197840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-625a18c6-6fa5-4768-a0c9-fe2cc087020e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:27.274003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-625a18c6-6fa5-4768-a0c9-fe2cc087020e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:27.281583 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-625a18c6-6fa5-4768-a0c9-fe2cc087020e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1246 microversion: 2.1 time: 0.089319 Jul 30 22:10:27.282769 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3454/6866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:27 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:28.304967 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:28.307233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:28.317079 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:28.317810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:28.318820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:28.319826 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:28.395004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:28.410577 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-258d681d-1bd6-4ad8-a68b-99b75fb0b3b6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1306 microversion: 2.1 time: 0.111269 Jul 30 22:10:28.411189 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3413/6867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:28 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:29.433699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:29.434919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:29.442793 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:29.443589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:29.444620 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:29.445151 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:29.698826 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:29.712770 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f4b177b4-ab08-4e75-8d4c-b4aeac6de617 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.283219 Jul 30 22:10:29.713943 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3455/6868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:29 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:29.889751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-290e1e58-8c0b-4b30-b92b-102515a8516c req-cbabe266-f5ba-44fc-b93f-9e60c38f2f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:29.900487 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-290e1e58-8c0b-4b30-b92b-102515a8516c req-cbabe266-f5ba-44fc-b93f-9e60c38f2f02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:29.900962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-290e1e58-8c0b-4b30-b92b-102515a8516c req-cbabe266-f5ba-44fc-b93f-9e60c38f2f02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:29.913263 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-290e1e58-8c0b-4b30-b92b-102515a8516c req-cbabe266-f5ba-44fc-b93f-9e60c38f2f02 service nova] Creating event network-changed:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:10:29.918363 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-290e1e58-8c0b-4b30-b92b-102515a8516c req-cbabe266-f5ba-44fc-b93f-9e60c38f2f02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096622 Jul 30 22:10:29.919153 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3414/6869] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:10:30.750430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:30.751066 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:30.758263 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:30.758735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:30.759568 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:30.760030 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:30.906681 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:30.914317 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9e914202-8840-4b32-bf81-7919574c59aa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.167958 Jul 30 22:10:30.914927 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3456/6870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:30 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:31.936968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:31.937704 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:31.944201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:31.944684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:31.945486 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:31.945961 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:32.088954 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:32.096987 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fd2fa0ff-1ccf-4fe0-8e24-8d16e6600750 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.165334 Jul 30 22:10:32.097579 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3415/6871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:31 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:33.118123 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:33.118811 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:33.125934 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:33.126406 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:33.127187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:33.127673 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:33.263909 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:33.271814 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-f5f96b31-3acd-4295-8bee-8903c8c2fb6c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.157689 Jul 30 22:10:33.272399 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3457/6872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:33 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:34.293233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:34.293903 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:34.301345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:34.301822 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:34.302611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:34.303074 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:34.436379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:34.443970 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cce0483d-f6ed-432a-bd2c-93f06e1bf3c3 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.155254 Jul 30 22:10:34.444547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3416/6873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:34 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:35.465952 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:35.466514 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:35.474338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:35.474853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:35.475976 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:35.476432 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:35.611024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:35.619052 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-1c8e0c86-0d0a-4514-98cc-cf9bda020ccd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.157595 Jul 30 22:10:35.619867 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3458/6874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:35 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:35.763430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6d6cb9da-c9c6-47f8-8367-88da9cd29b06 req-812ab61f-37ba-4e0d-aadd-a93e153f678d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "name": "network-vif-plugged", "status": "completed", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:35.779170 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6d6cb9da-c9c6-47f8-8367-88da9cd29b06 req-812ab61f-37ba-4e0d-aadd-a93e153f678d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:35.779661 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6d6cb9da-c9c6-47f8-8367-88da9cd29b06 req-812ab61f-37ba-4e0d-aadd-a93e153f678d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:35.792701 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6d6cb9da-c9c6-47f8-8367-88da9cd29b06 req-812ab61f-37ba-4e0d-aadd-a93e153f678d service nova] Creating event network-vif-plugged:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:10:35.797708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6d6cb9da-c9c6-47f8-8367-88da9cd29b06 req-812ab61f-37ba-4e0d-aadd-a93e153f678d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039480 Jul 30 22:10:35.798315 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3417/6875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:10:36.639969 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:36.640601 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:36.647928 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:36.648400 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:36.649185 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:36.649641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:36.782575 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:36.791111 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e798116-a7ba-49f8-b249-425088728ab6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1372 microversion: 2.1 time: 0.154731 Jul 30 22:10:36.792202 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3459/6876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:36 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:37.811218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:37.812125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:37.816482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:37.817207 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:37.824608 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:37.825692 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:37.826538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:37.827009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:37.966126 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:37.973752 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-20db8fa7-b632-4e61-bf42-54a861e3723d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1557 microversion: 2.1 time: 0.164355 Jul 30 22:10:37.974338 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3418/6877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:37 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:37.994153 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:10:37.994828 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:10:37.996783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:38.003374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:38.003856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:38.004655 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:38.005134 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:38.140558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:10:38.148437 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2db33f7b-8c8e-46c3-b261-0b554531232f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1557 microversion: 2.1 time: 0.158723 Jul 30 22:10:38.149013 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3460/6878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:10:37 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:10:39.831258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-aac044f4-f3f7-40a3-9f63-8ff5b0e627b8 req-543b60af-1da6-471b-b637-95dff2dea718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:10:39.842159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aac044f4-f3f7-40a3-9f63-8ff5b0e627b8 req-543b60af-1da6-471b-b637-95dff2dea718 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:10:39.842638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-aac044f4-f3f7-40a3-9f63-8ff5b0e627b8 req-543b60af-1da6-471b-b637-95dff2dea718 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:10:39.853888 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-aac044f4-f3f7-40a3-9f63-8ff5b0e627b8 req-543b60af-1da6-471b-b637-95dff2dea718 service nova] Creating event network-changed:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:10:39.860067 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-aac044f4-f3f7-40a3-9f63-8ff5b0e627b8 req-543b60af-1da6-471b-b637-95dff2dea718 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Jul 30 22:10:39.860671 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3419/6879] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:11:57.593480 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:11:57.594057 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:12:37.270695 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:12:37.272181 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:12:37.278352 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:12:37.278917 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:37.281602 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:37.282749 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=36 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:37.292741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:37.293461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:37.294687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:37.295450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:37.320418 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lazy-loading 'flavor' on Instance uuid b4255462-ae03-4e40-91fc-57b2a95c2f92 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:12:37.507661 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-5134583b-e883-4c2e-8721-4a7edc0a383a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92/action" status: 202 len: 0 microversion: 2.1 time: 0.239249 Jul 30 22:12:37.508264 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3461/6880] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:12:37 2022] POST /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:12:37.515967 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:12:37.516697 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:37.517534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=32 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:37.523167 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:37.523923 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:37.532384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:37.532866 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:37.533738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:37.534211 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:37.674210 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:37.681867 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-31131536-b849-4d0d-b4e9-5d3f37ecf3cb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.168596 Jul 30 22:12:37.682438 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3420/6881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:37 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:38.704580 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:38.705308 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:38.715955 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:38.716427 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:38.717273 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:38.718017 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:38.722580 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57208. Jul 30 22:12:38.723440 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57210. Jul 30 22:12:38.857162 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:38.864961 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-fa927a89-bc95-4b3b-ac35-273cdebc2c0a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.165968 Jul 30 22:12:38.865538 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3462/6882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:38 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:39.884089 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:12:39.887624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:39.888272 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:39.898326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:39.898835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:39.900275 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:39.900740 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:39.906068 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57214. Jul 30 22:12:40.040940 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:40.048486 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f2089db5-fb7a-4db5-9570-8612bd69d866 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.165849 Jul 30 22:12:40.049057 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3421/6883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:39 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:41.069618 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:41.070294 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:41.077541 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:41.078020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:41.078813 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:41.079329 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:41.220145 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:41.228395 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-297b70bf-4bcc-46db-99ff-5f45be7a96f2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.162341 Jul 30 22:12:41.229244 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3463/6884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:41 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:42.249193 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:42.249813 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:42.258758 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:42.259839 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:42.260632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:42.261091 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:42.277384 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57220. Jul 30 22:12:42.394815 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:42.402375 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8fd5417e-5ceb-447d-8299-6b4a664970be tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.157160 Jul 30 22:12:42.402945 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3422/6885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:42 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:43.422526 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:43.423161 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:43.430343 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:43.430814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:43.431631 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:43.432089 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:43.561533 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:43.569109 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-87a65dfa-3952-4121-9756-80f09c4dee34 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.150569 Jul 30 22:12:43.569691 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3464/6886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:43 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:44.591893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:44.592531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:44.599581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:44.600061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:44.600855 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:44.601324 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:44.733836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:44.741496 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d705f06e-9034-470d-a268-2a57c4691aea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.154121 Jul 30 22:12:44.742065 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3423/6887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:44 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:45.762223 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:45.762772 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:45.770167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:45.770641 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:45.771461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:45.771922 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:45.905314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:45.913045 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e9175099-231e-4ca3-a32d-8652d66daed4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.154900 Jul 30 22:12:45.913623 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3465/6888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:45 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:46.935057 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:46.935760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:46.942762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:46.943237 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:46.944050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:46.944513 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:47.080233 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:47.087834 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-9a7ffa62-e45e-489e-8d76-5461e47ff264 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.157163 Jul 30 22:12:47.088397 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3424/6889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:46 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:12:48.108634 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:48.109260 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:48.116393 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:48.116855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:48.117629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:48.118076 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:48.255822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:48.264201 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-129fa79a-da39-4700-99fd-c2f1f68412c4 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1703 microversion: 2.1 time: 0.159505 Jul 30 22:12:48.264777 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3466/6890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:48 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1703 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:49.285617 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:49.286156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:49.293253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:49.293729 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:49.294518 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:49.294980 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:49.426455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:49.434082 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2dd7335c-351a-4cbc-a862-d279a9d91670 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1703 microversion: 2.1 time: 0.152467 Jul 30 22:12:49.434661 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3425/6891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:49 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1703 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:50.455055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:50.455941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:50.466471 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:50.467152 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:50.467611 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:50.468665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:50.610242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:50.618672 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a320a100-9dc0-4e47-97ad-80d40086169b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.167501 Jul 30 22:12:50.636265 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3467/6892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:50 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:51.649367 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:51.651913 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:51.659900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:51.660453 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:51.661318 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:51.662025 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:52.174817 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:52.185555 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-dc0fee39-912f-41b8-b6e6-81836cb0137f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.540054 Jul 30 22:12:52.186154 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3426/6893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:51 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:52.524561 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-7d85563a-f8c3-4573-89ac-da8b9f42c58b req-95eb6cbb-0851-4f1b-b519-d85421716f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "name": "network-vif-plugged", "status": "completed", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:12:52.537941 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7d85563a-f8c3-4573-89ac-da8b9f42c58b req-95eb6cbb-0851-4f1b-b519-d85421716f5d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:52.540283 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-7d85563a-f8c3-4573-89ac-da8b9f42c58b req-95eb6cbb-0851-4f1b-b519-d85421716f5d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:52.554767 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-7d85563a-f8c3-4573-89ac-da8b9f42c58b req-95eb6cbb-0851-4f1b-b519-d85421716f5d service nova] Creating event network-vif-plugged:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:12:52.560363 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-7d85563a-f8c3-4573-89ac-da8b9f42c58b req-95eb6cbb-0851-4f1b-b519-d85421716f5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130465 Jul 30 22:12:52.560971 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3468/6894] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:12:53.209996 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:53.210836 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:53.219089 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:53.219686 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:53.220557 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:53.221096 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:53.391430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:53.399348 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-5a8ed017-4d42-4b8a-aa44-14cabc24e4ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.193661 Jul 30 22:12:53.400520 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3427/6895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:53 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:54.424122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:54.425614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:54.436535 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:54.437013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:54.437821 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:54.438282 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:54.599107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:54.608643 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b63a0b4e-551d-49b7-84c9-1b6d8868301b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.189713 Jul 30 22:12:54.609329 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3469/6896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:54 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:12:55.638256 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:55.638922 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:55.646900 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:55.647414 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:55.648248 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:55.648718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:55.812534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:55.820509 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb006574-571a-434f-a082-c51f48ca3dba tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.190703 Jul 30 22:12:55.821104 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3428/6897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:55 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:56.844571 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:56.845975 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:56.854193 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:56.854746 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:56.855652 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:56.856187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:57.011544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:57.021098 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c1d0e54c-7423-41fd-acda-6dc5442cb53f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.181020 Jul 30 22:12:57.022052 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3470/6898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:56 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:58.042337 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:58.043868 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:58.053892 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:58.054737 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:58.055870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:58.056567 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:58.511430 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:58.522473 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d10c0a10-d9d8-4a24-8aef-26a4de353ce0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.484184 Jul 30 22:12:58.523068 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3429/6899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:58 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:12:59.543806 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:12:59.544433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:12:59.551558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:59.552024 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:59.552797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:12:59.553246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:12:59.688827 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:12:59.696575 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-615ec650-27c8-402a-b0f8-7f27aee2aeea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1698 microversion: 2.1 time: 0.157361 Jul 30 22:12:59.697170 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3471/6900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:12:59 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:00.717794 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:00.718326 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:00.725353 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:00.725832 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:00.726622 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:00.727084 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:00.860785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:00.869223 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b606c55-1b19-4e6f-aa54-8ef6a6f8794f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1680 microversion: 2.1 time: 0.154875 Jul 30 22:13:00.869794 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3430/6901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:00 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:01.890680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:01.891338 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:01.898569 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:01.899037 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:01.900489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:01.900943 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:02.039420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:02.047556 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-66c0fc35-b741-4c92-9824-dd5d32aaf3eb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1680 microversion: 2.1 time: 0.160418 Jul 30 22:13:02.048145 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3472/6902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:01 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:02.405743 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-da7e9ebd-2d21-4175-acc5-a81eef71a68e req-2240576f-8ddb-43e7-b834-aff9848f47d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "name": "network-vif-unplugged", "status": "completed", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:13:02.417915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da7e9ebd-2d21-4175-acc5-a81eef71a68e req-2240576f-8ddb-43e7-b834-aff9848f47d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:02.418493 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-da7e9ebd-2d21-4175-acc5-a81eef71a68e req-2240576f-8ddb-43e7-b834-aff9848f47d1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:02.445678 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-da7e9ebd-2d21-4175-acc5-a81eef71a68e req-2240576f-8ddb-43e7-b834-aff9848f47d1 service nova] Creating event network-vif-unplugged:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:13:02.451502 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-da7e9ebd-2d21-4175-acc5-a81eef71a68e req-2240576f-8ddb-43e7-b834-aff9848f47d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049457 Jul 30 22:13:02.452428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3431/6903] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:13:03.069274 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:03.069919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:03.077187 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:03.077666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:03.078459 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:03.078924 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:03.213728 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:03.221440 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-964cf024-eab0-4330-8d80-c391f218f578 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1623 microversion: 2.1 time: 0.156212 Jul 30 22:13:03.222024 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3473/6904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:03 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1623 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:03.242628 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:13:03.243391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:03.249777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:03.250200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:03.251000 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:03.251510 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:03.335966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130983) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 22:13:03.400907 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [533b2953-e5c9-488b-bf43-abeecf053ec2] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:13:04.408488 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [533b2953-e5c9-488b-bf43-abeecf053ec2] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57322. Jul 30 22:13:04.411717 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-33bb341f-aac7-4a36-940e-24e490794ede tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92/action" status: 202 len: 0 microversion: 2.1 time: 1.173372 Jul 30 22:13:04.412349 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3432/6905] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:13:03 2022] POST /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92/action => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:13:04.421379 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:04.422020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:04.428907 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:04.429382 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:04.430178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:04.430665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:04.563875 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:04.571612 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c3cb172b-737d-4928-b04b-2625e6a7c628 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1631 microversion: 2.1 time: 0.154223 Jul 30 22:13:04.572206 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3474/6906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:04 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1631 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:05.595085 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:05.595687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:05.601917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:05.602468 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:05.603221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:05.603722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:05.736125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:05.744682 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ca12f053-df49-4020-a4a3-5efc672570ab tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.155271 Jul 30 22:13:05.745265 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3433/6907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:05 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:06.767621 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:06.768190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:06.779192 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:06.779852 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:06.781448 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:06.782391 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:06.928796 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:06.938989 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-185cc943-d516-479d-8a0a-654402897da8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.176554 Jul 30 22:13:06.940383 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3475/6908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:06 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:07.961314 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:07.962730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:07.965364 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:07.971145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:07.971663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:07.972492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:07.972973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:07.978770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:08.130216 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:08.138561 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cc6a164a-ab9b-4d84-93c2-d31f2379f73a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.181277 Jul 30 22:13:08.139490 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3434/6909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:07 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:09.161309 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:09.161919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:09.164131 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=31 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:09.170450 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:09.170956 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:09.171818 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:09.172293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:09.177702 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:09.318321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:09.330425 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-12a3e897-357d-45d1-9bc8-8ebf7b74b2a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.173152 Jul 30 22:13:09.340625 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3476/6910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:09 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:10.351770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:10.353106 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:10.360381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:10.360950 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:10.361876 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:10.362417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:10.516853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:10.528852 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8594d4ee-75ee-46d5-a99b-640f83d0e963 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.180813 Jul 30 22:13:10.541420 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3435/6911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:10 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:11.552147 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:11.552805 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:11.561233 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:11.561701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:11.563735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:11.564204 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:11.718609 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:11.727194 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a7f0d0ed-32e6-4ed4-b112-154e1277e49e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.179282 Jul 30 22:13:11.732247 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3477/6912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:11 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:12.750768 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:12.751611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:12.757918 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:12.758394 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:12.760180 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:12.760856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:12.911140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:12.920235 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6342ce67-5876-476a-9c6c-2a8068d77653 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.174169 Jul 30 22:13:12.924205 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3436/6913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:12 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:13.944032 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:13.944651 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:13.952356 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:13.952823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:13.953614 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:13.954063 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:14.091488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:14.099162 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-d2c9dfab-2091-4893-999d-c27ebe2efea7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.159241 Jul 30 22:13:14.099762 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3478/6914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:13 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:15.120718 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:15.121361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:15.128390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:15.128870 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:15.129669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:15.130134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:15.268070 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:15.276727 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e3c6b87e-729e-4c34-b8dc-efc8f81fa8a2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.159989 Jul 30 22:13:15.277306 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3437/6915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:15 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:16.297904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:16.298457 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:16.305558 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:16.306033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:16.306820 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:16.307278 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:16.443717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:16.451440 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8841c4da-caf3-488b-9fd2-e1d9c6964d0f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.157560 Jul 30 22:13:16.452077 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3479/6916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:16 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:17.474563 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:17.475213 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:17.484293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:17.484777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:17.485591 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:17.486061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:17.617952 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:17.625690 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c04d5b13-f9fe-4866-ae70-805ca0025e95 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.156070 Jul 30 22:13:17.626270 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3438/6917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:17 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:18.590453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-941ee638-325c-46ca-8043-4b5dd12bfc06 req-75b01b15-e9bf-45db-82c5-9c202716bd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "name": "network-vif-plugged", "status": "completed", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:13:18.604731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-941ee638-325c-46ca-8043-4b5dd12bfc06 req-75b01b15-e9bf-45db-82c5-9c202716bd4c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:18.604731 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-941ee638-325c-46ca-8043-4b5dd12bfc06 req-75b01b15-e9bf-45db-82c5-9c202716bd4c service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:18.615552 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-941ee638-325c-46ca-8043-4b5dd12bfc06 req-75b01b15-e9bf-45db-82c5-9c202716bd4c service nova] Creating event network-vif-plugged:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:13:18.621244 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-941ee638-325c-46ca-8043-4b5dd12bfc06 req-75b01b15-e9bf-45db-82c5-9c202716bd4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034755 Jul 30 22:13:18.621848 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3480/6918] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:13:18.648094 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:18.649750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:18.656531 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:18.657347 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:18.658323 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:18.658783 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:18.809904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:18.817935 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-58438111-3c62-4900-a718-4816fec7e7ea tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.174251 Jul 30 22:13:18.818608 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3439/6919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:18 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:19.839893 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:19.840699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:19.848004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:19.848485 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:19.849242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:19.849693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:19.995732 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:20.001161 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7b28b039-209a-4e66-bccb-098563e3d1ac tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1689 microversion: 2.1 time: 0.165653 Jul 30 22:13:20.001760 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3481/6920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:19 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:21.022408 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:13:21.023098 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:13:21.030244 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:21.030730 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:21.031570 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:13:21.032050 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:13:21.166820 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:13:21.174490 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-94d4e037-7425-47f3-aaf7-ac08b7704d36 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1676 microversion: 2.1 time: 0.156403 Jul 30 22:13:21.175072 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3440/6921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:13:21 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:13:37.614392 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:13:37.614953 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:14:31.961402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:31.962072 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:31.964355 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=11 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:31.964904 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-5e204c43-f910-46da-a9b5-644fe4ee39a5 req-6b9f10ac-a2a9-4a18-b798-1e9f37007b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:31.965357 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=31 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:31.971271 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:31.971768 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:31.972694 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:31.973591 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:31.974308 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=13 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:31.975234 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=41 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:31.977933 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5e204c43-f910-46da-a9b5-644fe4ee39a5 req-6b9f10ac-a2a9-4a18-b798-1e9f37007b37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:31.978637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-5e204c43-f910-46da-a9b5-644fe4ee39a5 req-6b9f10ac-a2a9-4a18-b798-1e9f37007b37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:31.996632 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-5e204c43-f910-46da-a9b5-644fe4ee39a5 req-6b9f10ac-a2a9-4a18-b798-1e9f37007b37 service nova] Creating event network-changed:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:14:32.002102 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-5e204c43-f910-46da-a9b5-644fe4ee39a5 req-6b9f10ac-a2a9-4a18-b798-1e9f37007b37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043066 Jul 30 22:14:32.002717 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3441/6922] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:14:32.002951 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:14:32.094526 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-47ae3fbc-7453-4a84-b884-cf7ac48a4921 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 204 len: 0 microversion: 2.1 time: 0.138082 Jul 30 22:14:32.095721 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3482/6923] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:14:31 2022] DELETE /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:14:32.105605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:32.106479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:32.113424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:32.114192 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:32.115144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:32.115739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:32.265305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:32.273509 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4e678a5-fada-4847-86af-8dd7e552672e tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.172984 Jul 30 22:14:32.274197 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3442/6924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:32 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:33.296371 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:33.297085 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:33.304625 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:33.305101 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:33.305895 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:33.306394 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:33.519653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:33.528618 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-70bdf973-40e2-426c-9f37-e37041f28beb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 200 len: 1682 microversion: 2.1 time: 0.236613 Jul 30 22:14:33.530210 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3483/6925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:33 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:33.895963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d199753e-aad0-48cd-9320-536e0260ccd7 req-e2cd5f3e-c8f3-45c6-a106-85156bc2cf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4255462-ae03-4e40-91fc-57b2a95c2f92", "name": "network-vif-deleted", "tag": "a4090aca-b068-4894-a016-28325a08dbcc"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:33.907862 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d199753e-aad0-48cd-9320-536e0260ccd7 req-e2cd5f3e-c8f3-45c6-a106-85156bc2cf2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:33.908424 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d199753e-aad0-48cd-9320-536e0260ccd7 req-e2cd5f3e-c8f3-45c6-a106-85156bc2cf2f service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:33.919731 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d199753e-aad0-48cd-9320-536e0260ccd7 req-e2cd5f3e-c8f3-45c6-a106-85156bc2cf2f service nova] Creating event network-vif-deleted:a4090aca-b068-4894-a016-28325a08dbcc for instance b4255462-ae03-4e40-91fc-57b2a95c2f92 on nch2-master-1 Jul 30 22:14:33.925201 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d199753e-aad0-48cd-9320-536e0260ccd7 req-e2cd5f3e-c8f3-45c6-a106-85156bc2cf2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094280 Jul 30 22:14:33.925895 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3443/6926] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:14:34.554456 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:34.555013 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: b4255462-ae03-4e40-91fc-57b2a95c2f92] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:34.562668 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:34.563141 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:34.563970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:34.564431 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:34.579352 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] HTTP exception thrown: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Request method failure captured: Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 HTTP/1.1 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5axMXvZg614rPytTSjXvvG5IgbLoWCBzzWO9O8XB8bvKZS-P36Jsauz33OCVZXBh8YXrTaSHy1wTmaiKZ7ZwVYs0Rx1WgPU8k4BMrlIrdx2EoJrg5Dt08APEuqnE8p9dWQmTL9CLgO7_bCs8-2kQDh62CtKJmcF67ogJU597FoIQEy0 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: cb0d987d5adc45fbb03290b133ee0641 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestShelveInstance-1765977873 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb0d987d5adc45fbb03290b133ee0641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestShelveInstance-1765977873 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: cb0d987d5adc45fbb03290b133ee0641 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestShelveInstance-1765977873 Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestShelveInstance-1765977873-project Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: eba4265a2b324928b7aee20262b850fe Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestShelveInstance-1765977873-project Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': 'b4255462-ae03-4e40-91fc-57b2a95c2f92'} Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:14:34.581070 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Returning 404 to user: Instance b4255462-ae03-4e40-91fc-57b2a95c2f92 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-33777612-c8d1-4584-8490-a17f0abd770f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92" status: 404 len: 111 microversion: 2.1 time: 0.036610 Jul 30 22:14:34.586693 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3484/6927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:34 2022] GET /compute/v2.1/servers/b4255462-ae03-4e40-91fc-57b2a95c2f92 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:14:34.744114 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b0a9c7f4-5269-441d-8e61-06bd030c3a97 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '.version_select at 0x7fbb4c414280>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:34.750592 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0a9c7f4-5269-441d-8e61-06bd030c3a97 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [0e9bd2dc-48a9-4a4d-9fa2-fda906f66a7d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:14:35.757383 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0a9c7f4-5269-441d-8e61-06bd030c3a97 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [0e9bd2dc-48a9-4a4d-9fa2-fda906f66a7d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57526. Jul 30 22:14:35.777660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b0a9c7f4-5269-441d-8e61-06bd030c3a97 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744600683" status: 202 len: 0 microversion: 2.1 time: 1.037992 Jul 30 22:14:35.778232 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3444/6928] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 22:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744600683 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:14:35.800689 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-30ceab72-f16b-4d4e-b685-72ada7116dfd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'create', calling method: .version_select at 0x7fbb4fc7edc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2016645837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQrLcPTR3F1RfnW10ldPnTlm02/GKm86E6ZD98kjTip3YCMCvvlRWBTUu3+CtOhYayZY0VGJFxvRQdSaQwxh0yB+QxrOOsUzmZONUq3KVs14FcjUCx6VZm7K5IkiKEI5w=="}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:35.817492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-30ceab72-f16b-4d4e-b685-72ada7116dfd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for project cb0d987d5adc45fbb03290b133ee0641. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:14:35.824499 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-30ceab72-f16b-4d4e-b685-72ada7116dfd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for user eba4265a2b324928b7aee20262b850fe and project cb0d987d5adc45fbb03290b133ee0641. Resources: {'key_pairs'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:14:35.856190 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-30ceab72-f16b-4d4e-b685-72ada7116dfd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.059434 Jul 30 22:14:35.856801 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3485/6929] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:14:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:14:38.291099 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1275884753", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2016645837", "security_groups": [{"name": "tempest-secgroup-smoke-2087253906"}], "networks": [{"uuid": "90114180-0d45-4b0f-8a19-0ae9838b2048"}], "block_device_mapping_v2": [{"uuid": "f42faa96-6987-42a1-b293-48f11aaae816", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:38.406004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] validate_networks() for [('90114180-0d45-4b0f-8a19-0ae9838b2048', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:14:38.773655 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:14:38.774134 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:14:38.774648 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:14:38.775092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:14:38.775568 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:14:38.784626 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:38.785108 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:38.785959 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:38.786434 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:38.803611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for project cb0d987d5adc45fbb03290b133ee0641. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:14:38.809485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Getting quotas for user eba4265a2b324928b7aee20262b850fe and project cb0d987d5adc45fbb03290b133ee0641. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:14:38.878218 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:14:38.880480 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f42faa96-6987-42a1-b293-48f11aaae816',volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:14:39.016030 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f4c54947-c4d9-4883-86d4-94b180e45490 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729677 Jul 30 22:14:39.016689 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3445/6930] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:14:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:14:39.028021 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2780d31c-d8bc-4499-a47d-a60a2177e0a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:39.028775 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-2780d31c-d8bc-4499-a47d-a60a2177e0a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:39.089927 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-2780d31c-d8bc-4499-a47d-a60a2177e0a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:39.097543 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2780d31c-d8bc-4499-a47d-a60a2177e0a7 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1089 microversion: 2.1 time: 0.073469 Jul 30 22:14:39.097804 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3486/6931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:39 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:40.119058 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:40.119824 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:40.128631 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:40.129538 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:40.130526 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:40.131073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:40.209258 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:40.217957 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-baf06dd6-10b4-49ef-a00c-7c2f288caee2 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1205 microversion: 2.1 time: 0.103760 Jul 30 22:14:40.218551 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3446/6932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:40 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:41.239537 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:41.240174 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:41.247258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:41.247762 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:41.248557 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:41.249014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:41.340265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-1c6aee56-c81a-40dd-b5db-7c8c42619998 req-ef6bc642-d835-4cff-bda8-ffba1564c54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:41.355656 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1c6aee56-c81a-40dd-b5db-7c8c42619998 req-ef6bc642-d835-4cff-bda8-ffba1564c54e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:41.356506 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-1c6aee56-c81a-40dd-b5db-7c8c42619998 req-ef6bc642-d835-4cff-bda8-ffba1564c54e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:41.370708 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-1c6aee56-c81a-40dd-b5db-7c8c42619998 req-ef6bc642-d835-4cff-bda8-ffba1564c54e service nova] Creating event network-changed:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch1-master-1 Jul 30 22:14:41.376549 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-1c6aee56-c81a-40dd-b5db-7c8c42619998 req-ef6bc642-d835-4cff-bda8-ffba1564c54e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041009 Jul 30 22:14:41.377171 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3447/6933] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:14:41.393178 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:41.402931 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7cc50ac-21e8-4a71-944c-26bdd7801170 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.167450 Jul 30 22:14:41.403552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3487/6934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:41 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:42.425946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:42.426687 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:42.433472 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:42.433962 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:42.434777 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:42.435253 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:42.649554 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:42.658614 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1d575bc-f28a-487a-aa60-f0fd123193fb tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.238031 Jul 30 22:14:42.659445 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3448/6935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:42 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:43.680253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:43.680890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:43.689026 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:43.689488 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:43.690268 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:43.690718 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:43.819799 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:43.827756 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-bbedc120-b872-498d-acd9-cbdaa8273c37 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.151288 Jul 30 22:14:43.828343 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3488/6936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:43 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:44.847761 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:44.848404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:44.855525 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:44.856035 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:44.856828 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:44.857296 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:44.990883 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:44.999412 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7bf6f4c9-780b-4799-acd3-d665be75dfb6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.155506 Jul 30 22:14:44.999995 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3449/6937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:44 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:46.021018 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:46.021667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:46.029776 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:46.030238 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:46.031020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:46.031511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:46.166853 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:46.174434 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0d0142f2-a3d6-42c2-8b90-a6c6b705ffaa tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.157339 Jul 30 22:14:46.175008 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3489/6938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:46 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:47.194490 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:47.195137 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:47.202370 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:47.202856 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:47.203723 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:47.204201 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:47.336481 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:47.344663 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-aa989a69-ca21-4650-b26c-440247529d89 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.154161 Jul 30 22:14:47.345237 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3450/6939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:47 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:48.365903 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:48.366529 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:48.373548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:48.374028 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:48.374783 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:48.375228 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:48.509184 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:48.517752 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23b7d299-e7c9-47bb-8dd9-c200e406bb91 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.155697 Jul 30 22:14:48.518578 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3490/6940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:48 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:48.645864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-25ba58dc-f327-4328-9b2b-e3db076bc6f2 req-4c63784b-db52-4f3a-b908-a15bd48ef5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "name": "network-vif-plugged", "status": "completed", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:48.658020 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25ba58dc-f327-4328-9b2b-e3db076bc6f2 req-4c63784b-db52-4f3a-b908-a15bd48ef5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:48.658678 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-25ba58dc-f327-4328-9b2b-e3db076bc6f2 req-4c63784b-db52-4f3a-b908-a15bd48ef5e1 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:48.671952 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-25ba58dc-f327-4328-9b2b-e3db076bc6f2 req-4c63784b-db52-4f3a-b908-a15bd48ef5e1 service nova] Creating event network-vif-plugged:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch1-master-1 Jul 30 22:14:48.677130 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-25ba58dc-f327-4328-9b2b-e3db076bc6f2 req-4c63784b-db52-4f3a-b908-a15bd48ef5e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Jul 30 22:14:48.677751 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3451/6941] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:14:49.538493 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:49.539130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:49.541177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:49.548817 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:49.549291 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:49.550094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:49.550560 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:49.693982 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:49.702146 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-669bd9fd-7134-4418-9938-103a9a8d041f tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1261 microversion: 2.1 time: 0.167631 Jul 30 22:14:49.702740 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3491/6942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:49 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:50.720682 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:50.721491 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:50.726818 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:50.727598 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:50.735576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:50.736066 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:50.736877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:50.737391 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:50.869072 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:50.876923 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-b43dc291-e825-4a9a-8545-0abb4ff49c9a tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1445 microversion: 2.1 time: 0.157264 Jul 30 22:14:50.877507 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3452/6943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:50 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:50.896823 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:14:50.897722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:14:50.905246 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:50.905717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:50.906510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:50.906966 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:51.041884 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:14:51.049517 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-24ea1f1b-67d1-41c7-ad37-438c1904df0c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1445 microversion: 2.1 time: 0.156633 Jul 30 22:14:51.050093 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3492/6944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:14:50 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:14:52.923381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-a0e2ca5f-ec96-447d-99b1-bde975618420 req-62bd64c1-a662-455f-a051-6fa2c388be86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:14:52.934695 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a0e2ca5f-ec96-447d-99b1-bde975618420 req-62bd64c1-a662-455f-a051-6fa2c388be86 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:14:52.935176 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-a0e2ca5f-ec96-447d-99b1-bde975618420 req-62bd64c1-a662-455f-a051-6fa2c388be86 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:14:52.947482 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-a0e2ca5f-ec96-447d-99b1-bde975618420 req-62bd64c1-a662-455f-a051-6fa2c388be86 service nova] Creating event network-changed:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch1-master-1 Jul 30 22:14:52.953720 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-a0e2ca5f-ec96-447d-99b1-bde975618420 req-62bd64c1-a662-455f-a051-6fa2c388be86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035828 Jul 30 22:14:52.954345 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3453/6945] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:15:17.603344 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:15:17.604014 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:16:57.622362 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:16:57.623108 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:16:57.952597 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:16:57.958067 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:16:57.958640 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:57.959423 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:58.057809 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:16:58.058369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:16:58.064584 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:16:58.065090 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:16:58.065868 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:16:58.066321 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:16:58.089627 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lazy-loading 'flavor' on Instance uuid 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:16:58.161010 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [095607c8-8532-4803-83b4-f062521275a7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:16:58.966060 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57754. Jul 30 22:16:58.968871 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57756. Jul 30 22:16:59.168003 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [095607c8-8532-4803-83b4-f062521275a7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57758. Jul 30 22:16:59.171345 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-889993cc-1f70-482e-b337-c5131069d8a5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282/action" status: 202 len: 0 microversion: 2.1 time: 1.220869 Jul 30 22:16:59.171984 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3493/6946] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:16:57 2022] POST /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282/action => generated 0 bytes in 1222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:16:59.178779 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:16:59.179812 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:16:59.180709 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:59.181652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=48 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:59.187175 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:16:59.188379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:16:59.198107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:16:59.198595 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:16:59.199458 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:16:59.199941 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:16:59.413417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:16:59.421322 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-507d7cc7-3602-408d-8b9a-2b6eac5f0a2b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.244748 Jul 30 22:16:59.421899 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3454/6947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:16:59 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:00.443511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:00.445402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:00.453461 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:00.453936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:00.454735 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:00.455224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:00.639215 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:00.647628 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9f534be3-d3c0-42c2-a465-e905735532e9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.209309 Jul 30 22:17:00.648206 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3494/6948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:00 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:01.669179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:01.669750 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:01.681810 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:01.682288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:01.683320 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:01.683793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:01.694599 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57784. Jul 30 22:17:01.705668 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57786. Jul 30 22:17:01.827140 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:01.835566 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-c52f6838-a102-4786-b5a7-2cb593855392 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.170534 Jul 30 22:17:01.836183 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3455/6949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:01 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:02.857172 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:02.857803 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:02.865436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:02.865897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:02.866677 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:02.867132 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:03.332289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:03.340709 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-c002049b-b496-4ace-9b18-0d5371e61470 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.487473 Jul 30 22:17:03.341284 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3495/6950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:02 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:04.362194 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:04.362833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:04.370849 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:04.371359 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:04.372156 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:04.372638 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:04.513263 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:04.521223 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cbb56de3-9c10-454d-8094-ab308e65c02d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.163069 Jul 30 22:17:04.521808 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3456/6951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:04 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:05.542110 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:05.542741 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:05.549995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:05.550466 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:05.551255 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:05.552293 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:05.680854 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:05.688624 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4d2ec1eb-e2e9-4d89-b131-ba8beac7f621 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.150461 Jul 30 22:17:05.689208 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3496/6952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:05 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:06.710236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:06.710917 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:06.718219 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:06.718744 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:06.719644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:06.720125 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:06.855475 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:06.863386 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e536cac2-2d65-4288-bb4f-eef3e4d478cd tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.157224 Jul 30 22:17:06.863972 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3457/6953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:06 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:07.885704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:07.886332 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:07.893389 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:07.893855 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:07.894630 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:07.895082 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:08.048047 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:08.056505 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0084920-bd8c-4fde-9013-07dbf573f69b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.174760 Jul 30 22:17:08.057097 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3497/6954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:07 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:09.077698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:09.078379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:09.086152 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:09.086639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:09.087484 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:09.087966 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:09.224131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:09.231934 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-355c4309-a7df-4408-b807-78ce1f09a716 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.158241 Jul 30 22:17:09.232515 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3458/6955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:09 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:10.258003 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:10.258548 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:10.265665 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:10.266130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:10.266904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:10.267479 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:10.396779 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:10.404720 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7c3e07ad-2353-4717-a59c-62bd5f6778a6 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.151299 Jul 30 22:17:10.405296 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3498/6956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:10 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:11.426352 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:11.427607 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:11.434699 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:11.435179 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:11.436017 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:11.436492 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:11.580027 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:11.587994 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-63f76cde-561f-45a2-a69e-05d5020bfca8 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.165671 Jul 30 22:17:11.588583 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3459/6957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:11 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:12.609081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:12.609687 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:12.618011 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.618460 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:12.619231 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.619701 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:12.757636 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:12.765326 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e957d716-b48f-4ee9-8b73-bc7b0522bf56 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1509 microversion: 2.1 time: 0.160210 Jul 30 22:17:12.765894 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3499/6958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:12 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:12.786857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:17:12.787534 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:12.794669 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.795159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:12.796004 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.796482 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:12.825451 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130983) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 22:17:12.890091 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "POST /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282/action" status: 202 len: 0 microversion: 2.1 time: 0.107922 Jul 30 22:17:12.890662 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3460/6959] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:17:12 2022] POST /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:17:12.899446 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:12.900075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:12.906374 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.906876 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:12.907638 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:12.908087 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:13.048491 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:13.056480 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-b7c1de7e-8fa4-49cd-aaf5-0ceff2463715 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1517 microversion: 2.1 time: 0.161476 Jul 30 22:17:13.057060 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3500/6960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:12 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:17:14.078934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:14.079762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:14.086122 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:14.086592 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:14.087419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:14.087890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:14.221069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:14.229392 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1bc395c6-1639-4f4e-87e4-80db7c4ce0ae tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1519 microversion: 2.1 time: 0.155519 Jul 30 22:17:14.229982 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3461/6961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:14 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:15.253726 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-6e980ccb-58a2-4d22-80d0-a0973c5974ae req-61702815-be52-49e2-9e15-bdce6f691402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:17:15.263426 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:15.264075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:15.271421 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:15.271899 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:15.272706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:15.273167 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:15.284286 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6e980ccb-58a2-4d22-80d0-a0973c5974ae req-61702815-be52-49e2-9e15-bdce6f691402 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:15.284775 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-6e980ccb-58a2-4d22-80d0-a0973c5974ae req-61702815-be52-49e2-9e15-bdce6f691402 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:15.298822 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-6e980ccb-58a2-4d22-80d0-a0973c5974ae req-61702815-be52-49e2-9e15-bdce6f691402 service nova] Creating event network-vif-unplugged:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch2-master-1 Jul 30 22:17:15.304798 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-6e980ccb-58a2-4d22-80d0-a0973c5974ae req-61702815-be52-49e2-9e15-bdce6f691402 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056055 Jul 30 22:17:15.305428 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3462/6962] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:17:15.445717 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:15.453443 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-7618a6f4-80e9-4ac7-83ae-598fa8335e58 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.205692 Jul 30 22:17:15.454016 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3501/6963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:15 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:17:16.475649 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:16.476384 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:16.482926 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:16.483455 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:16.484255 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:16.484728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:16.619816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:16.627567 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-f13aa676-913d-449f-8697-bd61b50b6872 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.157271 Jul 30 22:17:16.628307 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3463/6964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:16 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:17.336481 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3141418f-014c-4d14-9680-6e2ceaf3de32 req-ed754457-ca15-46ed-aa78-7a98d74f9cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:17:17.355536 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3141418f-014c-4d14-9680-6e2ceaf3de32 req-ed754457-ca15-46ed-aa78-7a98d74f9cfa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:17.355999 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3141418f-014c-4d14-9680-6e2ceaf3de32 req-ed754457-ca15-46ed-aa78-7a98d74f9cfa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:17.371737 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3141418f-014c-4d14-9680-6e2ceaf3de32 req-ed754457-ca15-46ed-aa78-7a98d74f9cfa service nova] Creating event network-changed:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch2-master-1 Jul 30 22:17:17.377433 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3141418f-014c-4d14-9680-6e2ceaf3de32 req-ed754457-ca15-46ed-aa78-7a98d74f9cfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046016 Jul 30 22:17:17.378036 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3502/6965] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:17:17.649722 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:17.650579 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:17.657611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:17.658092 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:17.658897 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:17.659401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:17.789987 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:17.797680 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-d1b304b5-2b61-4e70-aa9f-2f773530243c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.152512 Jul 30 22:17:17.798257 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3464/6966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:17 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:18.819753 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:18.820489 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:18.826983 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:18.827492 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:18.828289 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:18.828750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:18.966926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:18.977140 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f43127a-6973-472a-b13b-ca28faba11e5 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.162714 Jul 30 22:17:18.977716 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3503/6967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:18 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:20.003965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:20.005528 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:20.015523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:20.016038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:20.016853 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:20.017331 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:20.155731 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:20.163962 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3068d068-344e-4903-a306-5733483b9449 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.169769 Jul 30 22:17:20.164534 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3465/6968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:19 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:21.185100 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:21.185761 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:21.192785 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:21.193269 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:21.194661 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:21.195112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:21.328919 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:21.337117 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9511f54d-e8ed-4417-9c39-2b83fd73fe3c tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.156001 Jul 30 22:17:21.337709 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3504/6969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:21 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:21.624461 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-8fff5973-b690-40f7-b3ae-ae7b96ab5c80 req-5fc9fc02-d9a3-4b4b-8e11-fe907738b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "name": "network-vif-plugged", "status": "completed", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:17:21.636864 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8fff5973-b690-40f7-b3ae-ae7b96ab5c80 req-5fc9fc02-d9a3-4b4b-8e11-fe907738b1e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:21.638672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-8fff5973-b690-40f7-b3ae-ae7b96ab5c80 req-5fc9fc02-d9a3-4b4b-8e11-fe907738b1e7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:21.655940 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-8fff5973-b690-40f7-b3ae-ae7b96ab5c80 req-5fc9fc02-d9a3-4b4b-8e11-fe907738b1e7 service nova] Creating event network-vif-plugged:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch2-master-1 Jul 30 22:17:21.661216 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-8fff5973-b690-40f7-b3ae-ae7b96ab5c80 req-5fc9fc02-d9a3-4b4b-8e11-fe907738b1e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040527 Jul 30 22:17:21.662020 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3466/6970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:17:22.360235 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:22.360861 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:22.368589 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:22.369157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:22.370122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:22.370608 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:22.505075 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:22.513254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-4570337c-ff00-4689-9344-b75d6a20df63 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1575 microversion: 2.1 time: 0.156968 Jul 30 22:17:22.513825 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3505/6971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:22 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:17:23.536671 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:17:23.537901 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:17:23.544406 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:23.544895 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:23.545711 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:17:23.546188 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:17:23.675751 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:17:23.684019 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e8b615b1-1ff1-492e-a4e2-70acf1a33bcf tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1562 microversion: 2.1 time: 0.152754 Jul 30 22:17:23.684600 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3467/6972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:17:23 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:18:37.612689 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:18:37.613316 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:18:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:18:43.217693 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=26 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:43.223573 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:43.227822 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:43.228346 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:18:43.231586 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:43.232804 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:43.238629 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:43.239112 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:43.239989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:43.240470 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:43.270970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Going to try to terminate instance {{(pid=130984) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:18:43.291200 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f87d618b-3655-46da-b112-db9ad5300959 req-123dac8c-075e-4251-a0cb-ab55bcc93e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:18:43.302759 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f87d618b-3655-46da-b112-db9ad5300959 req-123dac8c-075e-4251-a0cb-ab55bcc93e37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:43.304236 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f87d618b-3655-46da-b112-db9ad5300959 req-123dac8c-075e-4251-a0cb-ab55bcc93e37 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:43.320160 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f87d618b-3655-46da-b112-db9ad5300959 req-123dac8c-075e-4251-a0cb-ab55bcc93e37 service nova] Creating event network-changed:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch2-master-1 Jul 30 22:18:43.325470 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f87d618b-3655-46da-b112-db9ad5300959 req-123dac8c-075e-4251-a0cb-ab55bcc93e37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105721 Jul 30 22:18:43.326472 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3468/6973] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:18:43.358398 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-ccca6622-e5f5-4adb-920d-299f5d9050b9 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 204 len: 0 microversion: 2.1 time: 0.142100 Jul 30 22:18:43.359860 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3506/6974] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:18:43 2022] DELETE /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:18:43.377223 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:43.378925 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:18:43.385624 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:43.386190 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:43.387282 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:43.387844 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:43.527198 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:18:43.535086 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-60977888-c6f8-45c1-be67-996d43ad28ee tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.165105 Jul 30 22:18:43.535778 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3469/6975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:18:43 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:18:44.558778 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:44.559453 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:18:44.567367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:44.567850 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:44.568650 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:44.569107 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:44.711006 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:18:44.719172 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-618fdb2c-a566-48b2-8ece-86cea7d33bd0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1568 microversion: 2.1 time: 0.164830 Jul 30 22:18:44.720004 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3507/6976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:18:44 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:18:45.377728 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-f12a86e5-979b-4788-a993-7a29e429c141 req-1819c902-ec09-4165-b18f-956a88b23527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d69e840-2cfa-44fb-a7b7-b2f39bb93282", "name": "network-vif-deleted", "tag": "e4e1fc9c-21cf-460a-989f-7c093ffb7cf9"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:18:45.392330 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f12a86e5-979b-4788-a993-7a29e429c141 req-1819c902-ec09-4165-b18f-956a88b23527 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:45.392842 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-f12a86e5-979b-4788-a993-7a29e429c141 req-1819c902-ec09-4165-b18f-956a88b23527 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:45.408172 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-f12a86e5-979b-4788-a993-7a29e429c141 req-1819c902-ec09-4165-b18f-956a88b23527 service nova] Creating event network-vif-deleted:e4e1fc9c-21cf-460a-989f-7c093ffb7cf9 for instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 on nch2-master-1 Jul 30 22:18:45.414869 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-f12a86e5-979b-4788-a993-7a29e429c141 req-1819c902-ec09-4165-b18f-956a88b23527 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041770 Jul 30 22:18:45.415757 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3470/6977] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:18:45.741531 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:45.742177 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:18:45.750378 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:45.750857 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:45.753722 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:45.754392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:45.797433 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:45.798218 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:45.799663 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.objects.instance [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lazy-loading 'fault' on Instance uuid 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 {{(pid=130984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:18:45.845989 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba4265a2b324928b7aee20262b850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0d987d5adc45fbb03290b133ee0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:18:45.857254 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-6ee5c1e7-7883-4b41-b7f6-1f91276b502d tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 200 len: 1225 microversion: 2.1 time: 0.120502 Jul 30 22:18:45.857855 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3508/6978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:18:45 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:18:46.880673 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:46.881438 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] [instance: 4d69e840-2cfa-44fb-a7b7-b2f39bb93282] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:18:46.888784 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:46.889274 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:46.890095 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:18:46.890573 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:18:46.905034 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] HTTP exception thrown: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Request method failure captured: Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 HTTP/1.1 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5axMXvZg614rPytTSjXvvG5IgbLoWCBzzWO9O8XB8bvKZS-P36Jsauz33OCVZXBh8YXrTaSHy1wTmaiKZ7ZwVYs0Rx1WgPU8k4BMrlIrdx2EoJrg5Dt08APEuqnE8p9dWQmTL9CLgO7_bCs8-2kQDh62CtKJmcF67ogJU597FoIQEy0 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: cb0d987d5adc45fbb03290b133ee0641 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestShelveInstance-1765977873 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb0d987d5adc45fbb03290b133ee0641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb0d987d5adc45fbb03290b133ee0641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestShelveInstance-1765977873 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: cb0d987d5adc45fbb03290b133ee0641 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestShelveInstance-1765977873 Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestShelveInstance-1765977873-project Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: eba4265a2b324928b7aee20262b850fe Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestShelveInstance-1765977873-project Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': '4d69e840-2cfa-44fb-a7b7-b2f39bb93282'} Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:18:46.906688 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Returning 404 to user: Instance 4d69e840-2cfa-44fb-a7b7-b2f39bb93282 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-a3283075-a33c-4a59-9a62-0114cd92461b tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282" status: 404 len: 111 microversion: 2.1 time: 0.032455 Jul 30 22:18:46.912103 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3471/6979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:18:46 2022] GET /compute/v2.1/servers/4d69e840-2cfa-44fb-a7b7-b2f39bb93282 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:18:47.073264 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-58ea416e-001c-4052-90fc-2daf7bc593a0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] Calling method '.version_select at 0x7fbb6299b9d0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:18:47.100299 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-58ea416e-001c-4052-90fc-2daf7bc593a0 tempest-TestShelveInstance-1765977873 tempest-TestShelveInstance-1765977873-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2016645837" status: 202 len: 0 microversion: 2.1 time: 0.031501 Jul 30 22:18:47.100948 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3509/6980] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Jul 30 22:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2016645837 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:19:04.479812 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=8 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:04.482540 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=12 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:04.766878 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ddb5a147-3603-447e-8e72-89dcf503d39f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Action: 'create', calling method: .version_select at 0x7fbb4fea2f70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1172936709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxMzDHBDqFBky0yD4R37D3lbrIu/ka7DgXc/GOzY6g8RGyo8osjwTiOrQpvP/VXSsHARc2abuzMa2G350T3SS3s/GuftXf6+YNNbM7tOT0NTcsokeWh8UTGt8pJbkRgQA=="}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:19:04.785401 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ddb5a147-3603-447e-8e72-89dcf503d39f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:19:04.795373 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-ddb5a147-3603-447e-8e72-89dcf503d39f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for user 12027d76069b44eb97904ce6443c5f95 and project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'key_pairs'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:19:04.833245 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ddb5a147-3603-447e-8e72-89dcf503d39f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.359108 Jul 30 22:19:04.834199 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3472/6981] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 30 22:19:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:19:05.884322 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:05.885081 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:05.890014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1799961604", "imageRef": "991d1dec-81bf-4a5b-923e-56f2270c6dfd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1172936709", "security_groups": [{"name": "tempest-secgroup-smoke-1486460476"}], "networks": [{"uuid": "63cff099-d7b0-45ae-b17c-9790b1856728"}]}} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:19:06.000695 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.network.neutron [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] validate_networks() for [('63cff099-d7b0-45ae-b17c-9790b1856728', None, None, None, None, None)] {{(pid=130984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:19:06.845212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Flavor limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:19:06.845971 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Image limits 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:19:06.846462 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Flavor pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:19:06.846890 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Image pref 0:0:0 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:19:06.847376 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.virt.hardware [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:19:06.856517 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:06.856986 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:06.857797 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:06.858248 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:06.876475 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:19:06.882369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.quota [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for user 12027d76069b44eb97904ce6443c5f95 and project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'cores', 'instances', 'ram'} {{(pid=130984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:19:06.895429 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Going to run 1 instances... {{(pid=130984) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:19:06.898397 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='991d1dec-81bf-4a5b-923e-56f2270c6dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:19:06.945463 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-9683c154-e8be-4818-8418-e0895ad96cea tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063001 Jul 30 22:19:06.946295 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3510/6982] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:19:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:19:06.958780 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-4e65793c-449c-4c33-8229-fca338af0360 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:06.968423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-4e65793c-449c-4c33-8229-fca338af0360 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:07.041012 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-4e65793c-449c-4c33-8229-fca338af0360 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:07.049638 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-4e65793c-449c-4c33-8229-fca338af0360 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1249 microversion: 2.1 time: 0.095530 Jul 30 22:19:07.050947 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3473/6983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:06 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:08.071871 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:08.072511 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:08.080281 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:08.080838 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:08.081837 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:08.082563 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:08.163808 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:08.175578 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e10c478a-7105-4995-a89f-3a9e5d21200f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1309 microversion: 2.1 time: 0.108423 Jul 30 22:19:08.177733 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3511/6984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:08 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:09.198650 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:09.199419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:09.208103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:09.208620 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:09.209529 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:09.210038 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:09.467979 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:09.476612 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-bbd54c59-f4df-4d7a-8bde-5e1e98abb88c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.282160 Jul 30 22:19:09.477465 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3474/6985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:09 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:09.865980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-eae54460-a74d-476e-a718-6fab2b2d3f5b req-2d4315f3-93c2-44ff-a9f9-64f47ba81719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:19:09.878130 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-eae54460-a74d-476e-a718-6fab2b2d3f5b req-2d4315f3-93c2-44ff-a9f9-64f47ba81719 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:09.878691 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-eae54460-a74d-476e-a718-6fab2b2d3f5b req-2d4315f3-93c2-44ff-a9f9-64f47ba81719 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:09.891270 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-eae54460-a74d-476e-a718-6fab2b2d3f5b req-2d4315f3-93c2-44ff-a9f9-64f47ba81719 service nova] Creating event network-changed:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:19:09.896311 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-eae54460-a74d-476e-a718-6fab2b2d3f5b req-2d4315f3-93c2-44ff-a9f9-64f47ba81719 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035384 Jul 30 22:19:09.896934 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3512/6986] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:19:10.498131 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:10.498680 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:10.505840 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:10.506305 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:10.507112 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:10.507606 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:10.654760 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:10.663059 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3e4f8530-06d5-46de-a8e3-706209c8d744 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.168941 Jul 30 22:19:10.663688 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3475/6987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:10 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:11.685190 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:11.685897 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:11.692287 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:11.692750 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:11.693521 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:11.693967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:11.825050 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:11.833247 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-3e2db46d-c6cc-419a-851d-1cf226a067e9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.153172 Jul 30 22:19:11.833820 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3513/6988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:11 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:12.854159 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:12.854806 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:12.862349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:12.862833 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:12.863666 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:12.864144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:12.996195 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:13.003781 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-312c9d0d-dc5a-415c-aa2e-c2d9a2ffb60f tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.153654 Jul 30 22:19:13.004357 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3476/6989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:12 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:14.024179 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:14.024825 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:14.032198 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:14.032671 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:14.033509 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:14.033967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:14.171970 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:14.180216 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-98beaf8f-862d-40b8-b090-3fae7d36adad tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.159961 Jul 30 22:19:14.180791 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3514/6990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:14 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:15.201738 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:15.202389 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:15.209566 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:15.210053 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:15.210857 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:15.211349 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:15.356841 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:15.364961 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6c697140-c4c5-41af-9829-e17b58bee46d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.167259 Jul 30 22:19:15.365547 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3477/6991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:15 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:16.232477 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-3216f13d-9bc1-4128-9b35-ba78543babdc req-2d06bba2-6ed5-416b-aae1-1e6314a57753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "name": "network-vif-plugged", "status": "completed", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:19:16.242344 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3216f13d-9bc1-4128-9b35-ba78543babdc req-2d06bba2-6ed5-416b-aae1-1e6314a57753 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:16.242846 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-3216f13d-9bc1-4128-9b35-ba78543babdc req-2d06bba2-6ed5-416b-aae1-1e6314a57753 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:16.254448 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-3216f13d-9bc1-4128-9b35-ba78543babdc req-2d06bba2-6ed5-416b-aae1-1e6314a57753 service nova] Creating event network-vif-plugged:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:19:16.259519 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-3216f13d-9bc1-4128-9b35-ba78543babdc req-2d06bba2-6ed5-416b-aae1-1e6314a57753 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103228 Jul 30 22:19:16.260118 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3515/6992] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:19:16.386792 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:16.387602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:16.394651 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:16.395052 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:16.395890 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:16.396358 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:16.539433 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:16.547191 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-35ce3e36-ed88-4907-80e8-c6519e5f5ff6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1375 microversion: 2.1 time: 0.164770 Jul 30 22:19:16.547820 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3478/6993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:16 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:19:17.568071 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:17.568985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=6 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:17.574314 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:17.575055 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:17.583392 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:17.583856 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:17.584632 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:17.585077 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:17.719033 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:17.727071 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-e6ea3726-20c6-41ec-bd10-8c37c4469bef tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1560 microversion: 2.1 time: 0.159934 Jul 30 22:19:17.727704 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3516/6994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:17 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:17.746973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:19:17.747667 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:19:17.749581 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:17.756516 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:17.757009 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:17.757816 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:17.758291 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:17.891345 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:19:17.899154 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-7c63efb2-cb12-443e-b31b-ed01cf811900 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1560 microversion: 2.1 time: 0.156068 Jul 30 22:19:17.899770 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3479/6995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:19:17 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:19:19.593699 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ac08b6ed-6678-4ab2-afb6-a320b37c8ed8 req-43603d73-174e-4ae9-b439-dc5d52cc4d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:19:19.604240 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ac08b6ed-6678-4ab2-afb6-a320b37c8ed8 req-43603d73-174e-4ae9-b439-dc5d52cc4d02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:19:19.604700 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ac08b6ed-6678-4ab2-afb6-a320b37c8ed8 req-43603d73-174e-4ae9-b439-dc5d52cc4d02 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:19:19.616780 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ac08b6ed-6678-4ab2-afb6-a320b37c8ed8 req-43603d73-174e-4ae9-b439-dc5d52cc4d02 service nova] Creating event network-changed:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:19:19.621809 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ac08b6ed-6678-4ab2-afb6-a320b37c8ed8 req-43603d73-174e-4ae9-b439-dc5d52cc4d02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031909 Jul 30 22:19:19.622417 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3517/6996] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:20:18.718215 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:20:18.718860 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:20:49.756190 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:20:49.756915 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:21:12.151656 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:21:12.152640 ncdv-master-1 devstack@n-api.service[130983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 22:21:12.153457 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:12.154662 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=36 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:12.158898 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-753962641"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:12.161393 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:12.168896 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:12.169382 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:12.170191 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:12.170670 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:12.363792 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-fe6a4ceb-771b-43a4-bf73-2b4a06938c14 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "POST /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29/action" status: 202 len: 0 microversion: 2.1 time: 0.213730 Jul 30 22:21:12.364442 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3480/6997] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:21:12 2022] POST /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 22:21:18.583087 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:21:18.584084 ncdv-master-1 devstack@n-api.service[130984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 30 22:21:18.584967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:18.585980 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=32 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:18.591422 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-ccb72b7e-6d31-4990-b25c-297a79f6812a req-cc979ee1-4f72-4551-91ab-181c8f7c46aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "name": "network-vif-plugged", "status": "completed", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:18.609929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ccb72b7e-6d31-4990-b25c-297a79f6812a req-cc979ee1-4f72-4551-91ab-181c8f7c46aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:18.610510 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-ccb72b7e-6d31-4990-b25c-297a79f6812a req-cc979ee1-4f72-4551-91ab-181c8f7c46aa service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:18.625592 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-ccb72b7e-6d31-4990-b25c-297a79f6812a req-cc979ee1-4f72-4551-91ab-181c8f7c46aa service nova] Creating event network-vif-plugged:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:21:18.636189 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-ccb72b7e-6d31-4990-b25c-297a79f6812a req-cc979ee1-4f72-4551-91ab-181c8f7c46aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055428 Jul 30 22:21:18.637431 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3518/6998] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:21:25.920473 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:25.922485 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:25.927014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-808356353", "imageRef": "af28a606-a7f0-43a2-8029-d9ad18c9c5b1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1172936709", "security_groups": [{"name": "tempest-secgroup-smoke-1486460476"}], "networks": [{"uuid": "63cff099-d7b0-45ae-b17c-9790b1856728"}]}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:25.958879 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [83128a1a-83bd-4c87-959a-c9030165d405] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58360. Jul 30 22:21:25.964187 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b9ff72-cd96-442a-a162-72fc7df000e1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58358. Jul 30 22:21:26.053719 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.network.neutron [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] validate_networks() for [('63cff099-d7b0-45ae-b17c-9790b1856728', None, None, None, None, None)] {{(pid=130983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 22:21:26.480097 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Flavor limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 22:21:26.480561 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Image limits 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 22:21:26.481075 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Flavor pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 22:21:26.481523 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Image pref 0:0:0 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 22:21:26.481973 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.virt.hardware [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 22:21:26.491435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:26.491927 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:26.492782 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:26.493257 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:26.510909 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 22:21:26.516882 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.quota [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Getting quotas for user 12027d76069b44eb97904ce6443c5f95 and project 993b687d3fbc463bbb1a465aaa1dab7e. Resources: {'cores', 'instances', 'ram'} {{(pid=130983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 22:21:26.529698 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Going to run 1 instances... {{(pid=130983) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 22:21:26.532276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af28a606-a7f0-43a2-8029-d9ad18c9c5b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 22:21:26.580369 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1b613572-d7e4-4c9d-b1ca-46f0324efc6e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.662062 Jul 30 22:21:26.581048 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3481/6999] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 30 22:21:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 22:21:26.592666 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-0406fb2d-2d0d-4319-8ba0-9fe41e8fec77 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:26.593440 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-0406fb2d-2d0d-4319-8ba0-9fe41e8fec77 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:26.608195 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [a243eed1-d700-4cf5-a2e1-2f03b42e8d26] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58376. Jul 30 22:21:26.609211 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6945d7-0699-480a-b27a-f6d9c48e48d7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58374. Jul 30 22:21:26.660544 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-0406fb2d-2d0d-4319-8ba0-9fe41e8fec77 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:26.668272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-0406fb2d-2d0d-4319-8ba0-9fe41e8fec77 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1248 microversion: 2.1 time: 0.080000 Jul 30 22:21:26.668832 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3519/7000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:26 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 22:21:27.689716 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:27.690423 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:27.699479 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:27.699968 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:27.700770 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:27.701417 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:27.775683 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:27.784984 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-cb6df09b-88da-47d3-925c-bf126e536ae9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1306 microversion: 2.1 time: 0.099791 Jul 30 22:21:27.785765 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3482/7001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:27 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:28.648200 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-c0568848-cadb-4ec2-abc3-cdd9fc7ef0a7 req-9995dd40-08d5-4021-9722-2c85cdf6d2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "name": "network-vif-unplugged", "status": "completed", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:28.660402 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:28.677004 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c0568848-cadb-4ec2-abc3-cdd9fc7ef0a7 req-9995dd40-08d5-4021-9722-2c85cdf6d2d4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:28.677483 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-c0568848-cadb-4ec2-abc3-cdd9fc7ef0a7 req-9995dd40-08d5-4021-9722-2c85cdf6d2d4 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:28.701584 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-c0568848-cadb-4ec2-abc3-cdd9fc7ef0a7 req-9995dd40-08d5-4021-9722-2c85cdf6d2d4 service nova] Creating event network-vif-unplugged:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:21:28.722272 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-c0568848-cadb-4ec2-abc3-cdd9fc7ef0a7 req-9995dd40-08d5-4021-9722-2c85cdf6d2d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077946 Jul 30 22:21:28.723594 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3520/7002] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:21:28.807877 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:28.808435 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:28.820602 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:28.821378 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:28.822202 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:28.822672 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:29.003965 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:29.012864 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-ce44c2e4-7272-4643-8e8e-f01336faaec3 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.210349 Jul 30 22:21:29.013460 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3483/7003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:28 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:30.035978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:30.036646 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:30.047175 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:30.047949 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:30.048747 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:30.049369 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:30.202165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:30.210432 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-12db3841-6d80-4298-8e22-28a6b6e2188d tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.179790 Jul 30 22:21:30.211033 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3521/7004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:30 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:31.232524 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:31.233199 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:31.240928 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:31.242618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:31.243547 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:31.244036 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:31.408605 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:31.425942 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-6220c2eb-02e8-4a98-9243-d5cd5dbec834 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.197307 Jul 30 22:21:31.427402 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3484/7005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:31 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:32.448094 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:32.451253 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:32.459920 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:32.460474 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:32.461515 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:32.461968 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:32.626242 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:32.634647 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-473f7f7d-a00b-4a4b-82a2-39ac2ff56d5b tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.190416 Jul 30 22:21:32.635650 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3522/7006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:32 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:33.658313 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:33.658934 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:33.666732 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:33.667221 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:33.668071 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:33.668542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:33.820145 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:33.829339 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3b88202f-3655-4dae-a8c4-53611dfe44b1 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.176197 Jul 30 22:21:33.830172 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3485/7007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:33 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:34.850258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:34.850926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:34.858473 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:34.858936 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:34.859758 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:34.860212 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:35.000031 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:35.009080 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-23eb9d96-768c-47ca-8f67-4b9178fa1b17 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.162850 Jul 30 22:21:35.009668 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3523/7008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:34 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:35.975785 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [req-d20e8b87-15e6-46e1-80e9-c5d3ae80ecd4 req-06af5cff-8d43-4268-b3c1-4acbdd536d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:35.989135 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d20e8b87-15e6-46e1-80e9-c5d3ae80ecd4 req-06af5cff-8d43-4268-b3c1-4acbdd536d12 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:35.989771 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [req-d20e8b87-15e6-46e1-80e9-c5d3ae80ecd4 req-06af5cff-8d43-4268-b3c1-4acbdd536d12 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:36.004887 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.compute.server_external_events [req-d20e8b87-15e6-46e1-80e9-c5d3ae80ecd4 req-06af5cff-8d43-4268-b3c1-4acbdd536d12 service nova] Creating event network-changed:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:21:36.010571 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [req-d20e8b87-15e6-46e1-80e9-c5d3ae80ecd4 req-06af5cff-8d43-4268-b3c1-4acbdd536d12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040033 Jul 30 22:21:36.011832 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3486/7009] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:21:36.030121 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:36.030888 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:36.038840 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:36.039420 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:36.040288 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:36.040814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:36.275686 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:36.283749 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-a0a84ee6-0f68-4f6f-83a1-e369772c7714 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.257931 Jul 30 22:21:36.284343 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3524/7010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:36 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:37.301915 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:37.302830 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell0:SELECT=6 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:37.308411 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:37.309154 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:37.316618 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:37.317104 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:37.317916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:37.318390 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:37.457893 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:37.465624 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-8a704c37-61aa-465b-b146-4b25ceb7416e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.164816 Jul 30 22:21:37.466336 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3487/7011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:37 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:38.487367 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:38.488002 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:38.490005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell0:SELECT=2 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:38.496300 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:38.496769 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:38.497551 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:38.498005 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:38.629035 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:38.636957 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-556337fe-a458-43b2-b59b-dd6d9c4fd3f4 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.153499 Jul 30 22:21:38.637552 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3525/7012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:38 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:39.658502 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:39.659061 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:39.666243 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:39.666717 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:39.667556 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:39.668018 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:39.800576 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:39.808154 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-2cdfad7f-d5be-4f58-818d-92412127d092 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.154000 Jul 30 22:21:39.808742 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3488/7013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:39 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:40.830043 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:40.830706 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:40.838105 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:40.838576 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:40.839430 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:40.839926 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:40.987642 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:40.995547 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-71cc22e7-f321-41cc-9702-29c46593ec0e tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.170024 Jul 30 22:21:40.996143 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3526/7014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:40 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:42.017419 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:42.018069 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:42.025227 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:42.025714 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:42.026520 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:42.026997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:42.162007 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:42.169943 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-79637a31-16a6-4267-b892-958fa64ed4f2 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.156992 Jul 30 22:21:42.170531 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3489/7015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:42 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:42.868062 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-9ab650f2-6b9a-4c32-8e0e-65e8a89b2aa2 req-4dcabc45-49e1-4a30-ad69-7491d4483868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "name": "network-vif-plugged", "status": "completed", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:42.878995 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ab650f2-6b9a-4c32-8e0e-65e8a89b2aa2 req-4dcabc45-49e1-4a30-ad69-7491d4483868 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:42.879556 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-9ab650f2-6b9a-4c32-8e0e-65e8a89b2aa2 req-4dcabc45-49e1-4a30-ad69-7491d4483868 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:42.891124 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-9ab650f2-6b9a-4c32-8e0e-65e8a89b2aa2 req-4dcabc45-49e1-4a30-ad69-7491d4483868 service nova] Creating event network-vif-plugged:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:21:42.896174 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-9ab650f2-6b9a-4c32-8e0e-65e8a89b2aa2 req-4dcabc45-49e1-4a30-ad69-7491d4483868 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Jul 30 22:21:42.896774 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3527/7016] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:21:43.190168 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:43.190805 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:43.197808 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:43.198283 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:43.199073 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:43.199558 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:43.334293 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:43.341883 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-895bceb3-7965-4a8b-8aaf-f6e5962dae42 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1374 microversion: 2.1 time: 0.155742 Jul 30 22:21:43.342460 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3490/7017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:43 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:44.365217 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:44.365929 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:44.372306 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:44.372763 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:44.373567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:44.374012 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:44.508878 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:44.516551 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-69f7d086-55b0-4f2e-9254-521205c58073 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1559 microversion: 2.1 time: 0.157135 Jul 30 22:21:44.517122 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3528/7018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:44 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:44.537039 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:21:44.537684 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:21:44.544644 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:44.545123 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:44.545916 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:44.546379 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:44.688776 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:21:44.696518 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-26dc8ce1-7f5d-416c-88dd-c4a9ecb9f403 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1559 microversion: 2.1 time: 0.163351 Jul 30 22:21:44.697101 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3491/7019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:21:44 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:21:46.644859 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-aeb6949e-d65c-4655-9018-402ae5432e67 req-d9677f7f-4a1e-4ddf-8f6e-bceb6c4674a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:21:46.654692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-aeb6949e-d65c-4655-9018-402ae5432e67 req-d9677f7f-4a1e-4ddf-8f6e-bceb6c4674a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:21:46.655149 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-aeb6949e-d65c-4655-9018-402ae5432e67 req-d9677f7f-4a1e-4ddf-8f6e-bceb6c4674a7 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:21:46.666325 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-aeb6949e-d65c-4655-9018-402ae5432e67 req-d9677f7f-4a1e-4ddf-8f6e-bceb6c4674a7 service nova] Creating event network-changed:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:21:46.671394 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-aeb6949e-d65c-4655-9018-402ae5432e67 req-d9677f7f-4a1e-4ddf-8f6e-bceb6c4674a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085876 Jul 30 22:21:46.671996 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3529/7020] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:21:57.621229 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:21:57.621890 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:21:57.631669 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:21:57.631846 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:21:59.138676 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:21:59.139194 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:23:14.066319 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:14.067117 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=58 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:14.071555 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-670117087"}} {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:14.073911 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:14.081381 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:14.081863 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:14.082663 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:14.083136 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:14.481660 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-1bfe37bd-22ff-4637-8d04-73b6c10fe552 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "POST /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93/action" status: 202 len: 0 microversion: 2.1 time: 0.416799 Jul 30 22:23:14.482715 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3492/7021] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 30 22:23:14 2022] POST /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 30 22:23:21.263962 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_api:SELECT=26 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:21.268258 ncdv-master-1 devstack@n-api.service[130984]: DEBUG dbcounter [-] [130984] Writing DB stats nova_cell1:SELECT=48 {{(pid=130984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:21.274122 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-001871a4-86d7-492e-9a39-287573514c88 req-c75c257c-46d5-4238-bd70-5dc507af9e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "name": "network-vif-plugged", "status": "completed", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:21.287978 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-001871a4-86d7-492e-9a39-287573514c88 req-c75c257c-46d5-4238-bd70-5dc507af9e07 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:21.288784 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-001871a4-86d7-492e-9a39-287573514c88 req-c75c257c-46d5-4238-bd70-5dc507af9e07 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:21.306011 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-001871a4-86d7-492e-9a39-287573514c88 req-c75c257c-46d5-4238-bd70-5dc507af9e07 service nova] Creating event network-vif-plugged:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:23:21.312702 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-001871a4-86d7-492e-9a39-287573514c88 req-c75c257c-46d5-4238-bd70-5dc507af9e07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053832 Jul 30 22:23:21.315804 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3530/7022] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:23:28.180639 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:28.181265 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:28.183733 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_api:SELECT=2 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:28.184885 ncdv-master-1 devstack@n-api.service[130983]: DEBUG dbcounter [-] [130983] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:28.185020 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-0ee544de-7abd-49d1-886e-e892c3bb5b60 req-a524642b-1028-4146-8c46-d20c9aec647e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:28.192276 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:28.192774 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:28.193597 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:28.194107 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:28.195052 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0ee544de-7abd-49d1-886e-e892c3bb5b60 req-a524642b-1028-4146-8c46-d20c9aec647e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:28.195704 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-0ee544de-7abd-49d1-886e-e892c3bb5b60 req-a524642b-1028-4146-8c46-d20c9aec647e service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:28.208660 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-0ee544de-7abd-49d1-886e-e892c3bb5b60 req-a524642b-1028-4146-8c46-d20c9aec647e service nova] Creating event network-changed:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:23:28.214269 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-0ee544de-7abd-49d1-886e-e892c3bb5b60 req-a524642b-1028-4146-8c46-d20c9aec647e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034477 Jul 30 22:23:28.219446 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3531/7023] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:23:28.225652 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:23:28.320763 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-0856fea8-5413-4513-b4f5-54cb811fcec9 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 204 len: 0 microversion: 2.1 time: 0.143587 Jul 30 22:23:28.322015 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3493/7024] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:23:28 2022] DELETE /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:23:28.330653 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:28.332165 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:28.338680 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:28.339157 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:28.339985 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:28.340439 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:28.531593 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:23:28.539423 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-8f2a9be6-f696-4787-a633-061fd30be731 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1682 microversion: 2.1 time: 0.212916 Jul 30 22:23:28.540003 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3532/7025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:28 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:23:29.560309 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:29.561056 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:29.568637 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:29.569130 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:29.569946 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:29.570421 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:29.729144 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:23:29.738808 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-e171bee4-1b4d-4d59-af0a-cca7196e1612 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1682 microversion: 2.1 time: 0.182957 Jul 30 22:23:29.739549 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3494/7026] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:29 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:23:30.334711 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-2c04439d-3e63-4fa7-813c-174be12a91d5 req-2a729962-959d-4cf2-9596-fafcdd3997c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad3da80-f9c0-46a0-a490-f245f158be93", "name": "network-vif-deleted", "tag": "25ddf154-71ee-4a29-929a-eda2482df5a6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:30.349252 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2c04439d-3e63-4fa7-813c-174be12a91d5 req-2a729962-959d-4cf2-9596-fafcdd3997c6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:30.349714 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-2c04439d-3e63-4fa7-813c-174be12a91d5 req-2a729962-959d-4cf2-9596-fafcdd3997c6 service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:30.365502 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-2c04439d-3e63-4fa7-813c-174be12a91d5 req-2a729962-959d-4cf2-9596-fafcdd3997c6 service nova] Creating event network-vif-deleted:25ddf154-71ee-4a29-929a-eda2482df5a6 for instance 7ad3da80-f9c0-46a0-a490-f245f158be93 on nch2-master-1 Jul 30 22:23:30.372413 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-2c04439d-3e63-4fa7-813c-174be12a91d5 req-2a729962-959d-4cf2-9596-fafcdd3997c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042094 Jul 30 22:23:30.373129 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3533/7027] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:23:30.761963 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:30.763404 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:30.771509 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:30.771997 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:30.772848 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:30.773377 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:30.806772 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:30.807169 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:30.807888 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.objects.instance [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lazy-loading 'fault' on Instance uuid 7ad3da80-f9c0-46a0-a490-f245f158be93 {{(pid=130983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 22:23:30.850014 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:23:30.857032 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-588c7910-7e54-4bdb-9866-14cd0d26aee6 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 200 len: 1338 microversion: 2.1 time: 0.099737 Jul 30 22:23:30.857597 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3495/7028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:30 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:23:31.880296 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:31.881014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: 7ad3da80-f9c0-46a0-a490-f245f158be93] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:31.887438 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:31.887904 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:31.888685 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:31.889135 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:31.902314 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.wsgi [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] HTTP exception thrown: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Request method failure captured: Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: request: GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 HTTP/1.1 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Accept: application/json Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Accept-Encoding: identity Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Connection: close Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Content-Length: 0 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Content-Type: application/json Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Host: 10.222.0.17 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: Openstack-System-Scope: None Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: User-Agent: python-urllib3/1.26.10 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Auth-Token: gAAAAABi5a5TNooKd6Ms6ly9-7u3t0_1PkEQ0nb3cMNFvp3Im35oF4NNntwhiOkZWlynigZlctWZ-hgAnFG-9xGTfc-KPOYiWIxH558bhksd5Ropp4ujdLTdZVl_HQHWlbLJdEky7nSFdn-Tco0lKd7_uBQ5ZdXsqoq0kGT7UtZZTv9sjS6p-_M Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Id: None Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Domain-Name: None Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Identity-Status: Confirmed Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Is-Admin-Project: True Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Id: default Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Domain-Name: Default Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Id: 993b687d3fbc463bbb1a465aaa1dab7e Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Project-Name: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Role: reader,member Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Roles: reader,member Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_993b687d3fbc463bbb1a465aaa1dab7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Id: 993b687d3fbc463bbb1a465aaa1dab7e Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-Tenant-Name: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-User: tempest-TestSnapshotPattern-398819887-project Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Id: default Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-User-Domain-Name: Default Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-User-Id: 12027d76069b44eb97904ce6443c5f95 Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: X-User-Name: tempest-TestSnapshotPattern-398819887-project Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: method: > Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: exception: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: action_args: {'id': '7ad3da80-f9c0-46a0-a490-f245f158be93'} Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:23:31.903967 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: ERROR nova.api.openstack.wsgi Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Returning 404 to user: Instance 7ad3da80-f9c0-46a0-a490-f245f158be93 could not be found. {{(pid=130984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-874bf286-d9a2-441f-bb7f-9fa6d388508a tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93" status: 404 len: 111 microversion: 2.1 time: 0.031065 Jul 30 22:23:31.909567 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3534/7029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:31 2022] GET /compute/v2.1/servers/7ad3da80-f9c0-46a0-a490-f245f158be93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:23:33.231047 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:33.231611 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:33.232892 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-948069d8-f0a7-4ea6-9f35-f2ac7603b620 req-ecce309e-afcc-4351-84a4-2fe2c6f5564d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:33.239157 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:33.239958 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:33.241062 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:33.241762 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:33.244359 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-948069d8-f0a7-4ea6-9f35-f2ac7603b620 req-ecce309e-afcc-4351-84a4-2fe2c6f5564d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:33.244814 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-948069d8-f0a7-4ea6-9f35-f2ac7603b620 req-ecce309e-afcc-4351-84a4-2fe2c6f5564d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:33.256987 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-948069d8-f0a7-4ea6-9f35-f2ac7603b620 req-ecce309e-afcc-4351-84a4-2fe2c6f5564d service nova] Creating event network-changed:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:23:33.262019 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-948069d8-f0a7-4ea6-9f35-f2ac7603b620 req-ecce309e-afcc-4351-84a4-2fe2c6f5564d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032816 Jul 30 22:23:33.262633 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3535/7030] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 22:23:33.273739 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Going to try to terminate instance {{(pid=130983) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 22:23:33.373550 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3a57fd33-10a5-4f0f-a7e0-af7ba952a499 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 204 len: 0 microversion: 2.1 time: 0.146446 Jul 30 22:23:33.374477 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3496/7031] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 30 22:23:33 2022] DELETE /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 22:23:33.388014 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:33.388833 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.compute.api [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130984) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:33.396667 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:33.397224 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:33.398435 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:33.399213 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:33.545539 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.policy [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:23:33.553746 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-51312af6-826e-4bc6-8bfb-c702ace46018 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1684 microversion: 2.1 time: 0.174787 Jul 30 22:23:33.554336 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3536/7032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:33 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:23:34.576542 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:34.577288 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:34.584541 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:34.585028 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:34.585835 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:34.586311 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:34.744361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.policy [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12027d76069b44eb97904ce6443c5f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b687d3fbc463bbb1a465aaa1dab7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 22:23:34.752115 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-29725129-7c97-425f-88f7-abd4a221d001 tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 200 len: 1684 microversion: 2.1 time: 0.179995 Jul 30 22:23:34.752704 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3497/7033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:34 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 22:23:35.345146 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [req-e6f04ea1-af95-4fbf-99e0-240da0e02870 req-1b8d8563-104c-44eb-8033-61a19fbce16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e6c45b-025e-409c-b96b-d66139541b29", "name": "network-vif-deleted", "tag": "703a6dc7-338e-477b-bdbd-1b664f2accb6"}]} {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 22:23:35.356226 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6f04ea1-af95-4fbf-99e0-240da0e02870 req-1b8d8563-104c-44eb-8033-61a19fbce16d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:35.356692 ncdv-master-1 devstack@n-api.service[130984]: DEBUG oslo_concurrency.lockutils [req-e6f04ea1-af95-4fbf-99e0-240da0e02870 req-1b8d8563-104c-44eb-8033-61a19fbce16d service nova] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:35.369472 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.compute.server_external_events [req-e6f04ea1-af95-4fbf-99e0-240da0e02870 req-1b8d8563-104c-44eb-8033-61a19fbce16d service nova] Creating event network-vif-deleted:703a6dc7-338e-477b-bdbd-1b664f2accb6 for instance a0e6c45b-025e-409c-b96b-d66139541b29 on nch1-master-1 Jul 30 22:23:35.374283 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [req-e6f04ea1-af95-4fbf-99e0-240da0e02870 req-1b8d8563-104c-44eb-8033-61a19fbce16d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032926 Jul 30 22:23:35.375096 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3537/7034] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 30 22:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 22:23:35.773764 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '>' {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:35.775103 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.compute.api [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] [instance: a0e6c45b-025e-409c-b96b-d66139541b29] Fetching instance by UUID {{(pid=130983) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 22:23:35.785300 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:35.785793 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:35.786632 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 22:23:35.787361 ncdv-master-1 devstack@n-api.service[130983]: DEBUG oslo_concurrency.lockutils [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Lock "03a3405d-a30a-427e-89b9-941a414efbcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 22:23:35.802562 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.wsgi [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] HTTP exception thrown: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Request method failure captured: Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: request: GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 HTTP/1.1 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Accept: application/json Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Accept-Encoding: identity Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Connection: close Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Content-Length: 0 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Content-Type: application/json Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Host: 10.222.0.17 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: Openstack-System-Scope: None Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: User-Agent: python-urllib3/1.26.10 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Auth-Token: gAAAAABi5a5TNooKd6Ms6ly9-7u3t0_1PkEQ0nb3cMNFvp3Im35oF4NNntwhiOkZWlynigZlctWZ-hgAnFG-9xGTfc-KPOYiWIxH558bhksd5Ropp4ujdLTdZVl_HQHWlbLJdEky7nSFdn-Tco0lKd7_uBQ5ZdXsqoq0kGT7UtZZTv9sjS6p-_M Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Id: None Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Domain-Name: None Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Identity-Status: Confirmed Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Is-Admin-Project: True Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Id: default Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Domain-Name: Default Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Id: 993b687d3fbc463bbb1a465aaa1dab7e Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Project-Name: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Role: reader,member Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Roles: reader,member Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_993b687d3fbc463bbb1a465aaa1dab7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/993b687d3fbc463bbb1a465aaa1dab7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Id: 993b687d3fbc463bbb1a465aaa1dab7e Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-Tenant-Name: tempest-TestSnapshotPattern-398819887 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-User: tempest-TestSnapshotPattern-398819887-project Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Id: default Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-User-Domain-Name: Default Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-User-Id: 12027d76069b44eb97904ce6443c5f95 Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: X-User-Name: tempest-TestSnapshotPattern-398819887-project Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: method: > Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: exception: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: action_args: {'id': 'a0e6c45b-025e-409c-b96b-d66139541b29'} Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: {{(pid=130983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 22:23:35.804387 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: ERROR nova.api.openstack.wsgi Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: DEBUG nova.api.openstack.wsgi [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Returning 404 to user: Instance a0e6c45b-025e-409c-b96b-d66139541b29 could not be found. {{(pid=130983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 22:23:35.810809 ncdv-master-1 devstack@n-api.service[130983]: INFO nova.api.openstack.requestlog [None req-3d3753f4-ac75-45c4-b96c-d470099bc3bc tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29" status: 404 len: 111 microversion: 2.1 time: 0.036732 Jul 30 22:23:35.819322 ncdv-master-1 devstack@n-api.service[130983]: [pid: 130983|app: 0|req: 3498/7035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Jul 30 22:23:35 2022] GET /compute/v2.1/servers/a0e6c45b-025e-409c-b96b-d66139541b29 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 22:23:35.970436 ncdv-master-1 devstack@n-api.service[130984]: DEBUG nova.api.openstack.wsgi [None req-2bf57119-1552-4990-ab4e-b1643f01b86c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] Calling method '.version_select at 0x7fbb4fe6a8b0>' {{(pid=130984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 22:23:36.002791 ncdv-master-1 devstack@n-api.service[130984]: INFO nova.api.openstack.requestlog [None req-2bf57119-1552-4990-ab4e-b1643f01b86c tempest-TestSnapshotPattern-398819887 tempest-TestSnapshotPattern-398819887-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1172936709" status: 202 len: 0 microversion: 2.1 time: 0.036439 Jul 30 22:23:36.003421 ncdv-master-1 devstack@n-api.service[130984]: [pid: 130984|app: 0|req: 3538/7036] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Jul 30 22:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1172936709 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 22:25:17.631462 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:25:17.632122 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:25:19.147424 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:25:19.147991 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:25:49.765886 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:25:49.766548 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:26:58.730241 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:26:58.730969 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:28:37.639554 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:28:37.640050 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:28:37.642496 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:28:37.643080 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:28:39.155107 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:28:39.155693 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:28:48.720921 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:28:48.721489 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:29:09.773564 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:29:09.774208 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:30:18.739397 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:30:18.740770 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:31:57.649830 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:31:57.650398 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:31:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:31:57.652515 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:31:57.652691 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:31:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:31:59.163588 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:31:59.164193 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:32:08.731552 ncdv-master-1 devstack@n-api.service[130984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:32:08.732216 ncdv-master-1 devstack@n-api.service[130984]: Sat Jul 30 22:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 22:32:29.781922 ncdv-master-1 devstack@n-api.service[130983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 22:32:29.782500 ncdv-master-1 devstack@n-api.service[130983]: Sat Jul 30 22:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!